Jun 10 13:01:01.356447 ip-10-0-135-143 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 13:01:01.356462 ip-10-0-135-143 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 13:01:01.356472 ip-10-0-135-143 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 13:01:01.357017 ip-10-0-135-143 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 13:01:10.869597 ip-10-0-135-143 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 13:01:10.869614 ip-10-0-135-143 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 960ef12f08874e70863dd2e10cdbc4ad -- Jun 10 13:03:28.164839 ip-10-0-135-143 systemd[1]: Starting Kubernetes Kubelet... Jun 10 13:03:28.612373 ip-10-0-135-143 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:03:28.612373 ip-10-0-135-143 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 13:03:28.612373 ip-10-0-135-143 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:03:28.612373 ip-10-0-135-143 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 13:03:28.612373 ip-10-0-135-143 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:03:28.613180 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.612455 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 13:03:28.618788 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618762 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:28.618788 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618782 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:28.618788 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618787 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:28.618788 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618792 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:28.618788 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618796 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618801 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618806 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618815 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618820 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618828 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618832 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618836 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618840 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618844 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618848 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618852 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618857 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618861 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618866 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618870 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618875 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618879 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618887 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618891 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:28.619103 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618896 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618900 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618904 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618908 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618912 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618915 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618919 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618924 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618928 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618932 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618941 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618946 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618951 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618956 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618962 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618967 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618971 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618976 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618981 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618988 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:28.619942 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618992 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.618997 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619005 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619012 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619018 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619023 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619028 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619035 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619041 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619047 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619052 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619057 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619061 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619065 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619075 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619080 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619085 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619089 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619093 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:28.620835 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619098 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619102 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619106 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619111 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619116 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619121 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619126 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619132 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619141 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619146 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619151 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619156 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619160 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619164 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619169 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619178 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619184 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619190 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619195 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:28.621652 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619204 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619209 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619214 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619219 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619225 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619229 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619234 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619238 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619243 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619247 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619252 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619257 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619261 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619271 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619276 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619280 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.619285 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621727 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621738 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621742 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:28.622377 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621747 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621753 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621757 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621762 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621766 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621771 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621775 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621853 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.621999 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622003 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622008 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622011 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622014 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622017 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622020 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622022 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622025 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622028 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622032 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622035 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:28.622967 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622038 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622041 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622044 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622046 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622049 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622051 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622058 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622063 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622066 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622069 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622072 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622076 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622080 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622083 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622086 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622088 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622091 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622094 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622096 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:28.623490 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622099 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622102 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622105 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622108 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622110 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622114 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622117 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622120 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622122 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622125 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622128 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622130 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622133 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622135 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622140 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622143 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622145 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622148 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622153 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622155 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:28.623980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622158 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622162 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622165 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622167 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622170 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622174 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622177 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622181 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622184 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622188 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622191 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622194 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622197 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622202 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622205 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622208 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622210 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622213 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622215 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622218 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:28.624477 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622222 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622226 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622229 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622232 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622235 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622238 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622241 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622244 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622247 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622250 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622253 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622255 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622257 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622260 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622262 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622265 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622268 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622693 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622699 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622702 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:28.624987 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622705 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622708 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622711 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622714 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622717 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622720 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622725 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622728 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622730 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622733 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622735 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622739 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622741 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622745 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622747 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622750 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622753 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622756 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622758 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622761 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:28.625469 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622763 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622766 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622769 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622771 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622774 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622777 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622779 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622782 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622784 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622787 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622790 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622792 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622797 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622800 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622803 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622807 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622810 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622815 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622818 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:28.625980 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622821 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622824 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622827 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622830 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622832 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622835 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622838 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622841 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622844 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622847 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622849 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622852 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622855 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622857 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622860 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622864 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622867 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622870 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622873 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:28.626442 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622875 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622878 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622880 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622883 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622886 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622889 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622892 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622895 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622897 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622900 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622903 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622906 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622909 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622911 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622914 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622917 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622921 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622925 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622928 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:28.626916 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622930 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622933 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622939 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622942 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622945 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622947 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622950 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622952 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622955 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622957 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622960 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622963 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622965 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622968 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622971 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622974 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622976 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622979 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.622983 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623052 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623059 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 13:03:28.627436 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623065 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623070 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623088 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623091 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623095 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623099 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623102 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623105 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623109 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623112 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623115 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623118 2580 flags.go:64] FLAG: --cgroup-root="" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623121 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623124 2580 flags.go:64] FLAG: --client-ca-file="" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623127 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623130 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623135 2580 flags.go:64] FLAG: --cluster-domain="" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623138 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623141 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623144 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623147 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623151 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623154 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 13:03:28.627979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623157 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623160 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623163 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623166 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623169 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623172 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623176 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623180 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623183 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623186 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623188 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623191 2580 flags.go:64] FLAG: --enable-server="true" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623194 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623199 2580 flags.go:64] FLAG: --event-burst="100" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623202 2580 flags.go:64] FLAG: --event-qps="50" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623205 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623208 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623211 2580 flags.go:64] FLAG: --eviction-hard="" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623215 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623218 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623221 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623224 2580 flags.go:64] FLAG: --eviction-soft="" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623227 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623230 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623233 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 13:03:28.628601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623236 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623239 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623242 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623245 2580 flags.go:64] FLAG: --feature-gates="" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623248 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623251 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623254 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623257 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623260 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623263 2580 flags.go:64] FLAG: --help="false" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623266 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-135-143.ec2.internal" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623270 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623273 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623276 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623279 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623282 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623285 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623288 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623291 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623294 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623297 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623301 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623304 2580 flags.go:64] FLAG: --kube-reserved="" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623306 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 13:03:28.629220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623309 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623312 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623315 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623318 2580 flags.go:64] FLAG: --lock-file="" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623321 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623324 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623327 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623332 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623335 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623338 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623341 2580 flags.go:64] FLAG: --logging-format="text" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623344 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623347 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623350 2580 flags.go:64] FLAG: --manifest-url="" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623352 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623356 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623359 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623366 2580 flags.go:64] FLAG: --max-pods="110" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623369 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623372 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623375 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623378 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623381 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623384 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623387 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 13:03:28.629832 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623394 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623399 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623402 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623405 2580 flags.go:64] FLAG: --pod-cidr="" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623408 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623413 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623416 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623419 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623422 2580 flags.go:64] FLAG: --port="10250" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623425 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623428 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-041222363f7b7ef9b" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623431 2580 flags.go:64] FLAG: --qos-reserved="" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623434 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623437 2580 flags.go:64] FLAG: --register-node="true" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623440 2580 flags.go:64] FLAG: --register-with-taints="" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623444 2580 flags.go:64] FLAG: --registry-burst="10" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623447 2580 flags.go:64] FLAG: --registry-qps="5" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623450 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623452 2580 flags.go:64] FLAG: --reserved-memory="" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623456 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623460 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623463 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623465 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623468 2580 flags.go:64] FLAG: --runonce="false" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623471 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 13:03:28.630455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623476 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623479 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623482 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623485 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623487 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623490 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623493 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623496 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623520 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623524 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623527 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623530 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623533 2580 flags.go:64] FLAG: --system-cgroups="" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623536 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623541 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623544 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623547 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623551 2580 flags.go:64] FLAG: --tls-min-version="" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623554 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623556 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623560 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623562 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623565 2580 flags.go:64] FLAG: --v="2" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623569 2580 flags.go:64] FLAG: --version="false" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623574 2580 flags.go:64] FLAG: --vmodule="" Jun 10 13:03:28.631145 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623578 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.623581 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623697 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623703 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623706 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623709 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623712 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623716 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623719 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623722 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623724 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623727 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623729 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623732 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623735 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623739 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623742 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623744 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623747 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623750 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:28.631782 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623752 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623755 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623759 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623762 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623765 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623768 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623770 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623773 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623776 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623778 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623781 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623784 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623787 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623790 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623792 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623795 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623798 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623800 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623803 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:28.632267 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623808 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623811 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623813 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623816 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623819 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623823 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623827 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623830 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623833 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623836 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623838 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623841 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623844 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623846 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623849 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623852 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623854 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623857 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623860 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623862 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:28.632758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623865 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623867 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623870 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623872 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623875 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623878 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623881 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623883 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623886 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623889 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623891 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623894 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623898 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623901 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623903 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623906 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623909 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623912 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623915 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623917 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:28.633249 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623922 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623925 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623927 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623930 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623932 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623935 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623938 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623940 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623943 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623946 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623949 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623951 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623953 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623956 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623958 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623961 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623964 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623967 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623970 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623972 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:28.633758 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623975 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.623978 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.624768 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.631979 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.631996 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.632888 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.632896 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632952 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632957 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632961 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632964 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632967 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632970 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632973 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632976 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:28.634245 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632979 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632982 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632985 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632988 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632990 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632993 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632995 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.632998 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633001 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633004 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633007 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633010 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633012 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633015 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633017 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633022 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633030 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633034 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633038 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:28.634647 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633041 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633044 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633048 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633051 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633054 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633057 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633060 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633063 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633066 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633069 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633071 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633074 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633077 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633079 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633082 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633084 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633087 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633090 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633092 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:28.635100 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633095 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633098 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633100 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633103 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633106 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633108 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633111 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633114 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633116 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633119 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633121 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633125 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633127 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633130 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633133 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633137 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633139 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633142 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633145 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633147 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:28.635656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633150 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633152 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633155 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633158 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633160 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633163 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633166 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633168 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633171 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633173 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633176 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633178 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633181 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633183 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633186 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633188 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633191 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633194 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633196 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633199 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:28.636150 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633201 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633204 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633207 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633209 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633212 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633215 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633218 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633221 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633224 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633226 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633231 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633234 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633237 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.633242 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633354 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:28.636656 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633358 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633361 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633364 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633367 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633370 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633373 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633377 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633380 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633383 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633386 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633389 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633392 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633395 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633397 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633400 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633403 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633405 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633408 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633410 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633413 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:28.637026 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633416 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633418 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633422 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633425 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633427 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633430 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633433 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633435 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633438 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633442 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633446 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633449 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633452 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633455 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633458 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633461 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633464 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633466 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633469 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:28.637521 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633471 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633474 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633476 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633478 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633481 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633484 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633486 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633489 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633491 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633494 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633497 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633514 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633518 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633520 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633523 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633526 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633530 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633533 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633536 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:28.637985 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633540 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633543 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633546 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633548 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633551 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633553 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633556 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633558 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633561 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633564 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633567 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633569 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633572 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633574 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633577 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633580 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633582 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633585 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633587 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633590 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:28.638450 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633593 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633595 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633598 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633601 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633604 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633606 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633609 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633611 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633614 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633617 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633620 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633623 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633625 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633628 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633630 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633633 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633635 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633638 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633640 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:28.638944 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:28.633643 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:28.639417 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.633648 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:03:28.639417 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.633753 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 13:03:28.639417 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.636105 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 13:03:28.639417 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.637781 2580 server.go:1019] "Starting client certificate rotation" Jun 10 13:03:28.639417 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.637880 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 13:03:28.639417 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.637918 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 13:03:28.640934 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.640920 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 13:03:28.644894 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.644871 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 13:03:28.657898 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.657880 2580 log.go:25] "Validated CRI v1 runtime API" Jun 10 13:03:28.661902 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.661886 2580 log.go:25] "Validated CRI v1 image API" Jun 10 13:03:28.662805 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.662788 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 13:03:28.666321 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.666301 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 13:03:28.667738 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.667719 2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a81fdd57-3f28-4910-bee2-19ebcd1d3da9:/dev/nvme0n1p4 e039c78e-dccb-48aa-a1b0-bd1ce4621e6a:/dev/nvme0n1p3] Jun 10 13:03:28.667798 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.667739 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 13:03:28.674571 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.674458 2580 manager.go:216] Machine: {Timestamp:2026-06-10 13:03:28.672087984 +0000 UTC m=+0.378704568 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098246 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2141d998e3a6b80aa84d766a44802c SystemUUID:ec2141d9-98e3-a6b8-0aa8-4d766a44802c BootID:960ef12f-0887-4e70-863d-d2e10cdbc4ad Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:ae:1e:00:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:ae:1e:00:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:1d:48:89:fd:14 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 13:03:28.674571 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.674565 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 13:03:28.674702 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.674638 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 13:03:28.678144 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.678112 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 13:03:28.678303 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.678147 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-143.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 13:03:28.679017 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.679007 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 13:03:28.679052 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.679020 2580 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 13:03:28.679052 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.679028 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 13:03:28.679052 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.679042 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 13:03:28.680307 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.680297 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 13:03:28.684657 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.684645 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 10 13:03:28.684780 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.684771 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 13:03:28.684809 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.684802 2580 kubelet.go:486] "Attempting to sync node with API server" Jun 10 13:03:28.684837 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.684820 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 13:03:28.684867 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.684840 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 13:03:28.684867 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.684852 2580 kubelet.go:398] "Adding apiserver pod source" Jun 10 13:03:28.684925 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.684873 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 13:03:28.685220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.685209 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 13:03:28.685258 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.685227 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 13:03:28.687548 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.687532 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 13:03:28.689789 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.689771 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 13:03:28.689880 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.689812 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 13:03:28.691416 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691402 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 13:03:28.691520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691423 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 13:03:28.691520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691431 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 13:03:28.691520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691440 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 13:03:28.691520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691451 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 13:03:28.691520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691459 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 13:03:28.691520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691470 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 13:03:28.691520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691478 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 13:03:28.691520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691487 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 13:03:28.691520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691495 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 13:03:28.691784 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691528 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 13:03:28.691784 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.691539 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 13:03:28.692498 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.692486 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 13:03:28.692570 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.692515 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 13:03:28.695634 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.695619 2580 server.go:1268] "Started kubelet" Jun 10 13:03:28.695842 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.695771 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 13:03:28.695919 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.695853 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 13:03:28.695964 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.695804 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 13:03:28.696776 ip-10-0-135-143 systemd[1]: Started Kubernetes Kubelet. Jun 10 13:03:28.697665 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.697648 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-143.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 13:03:28.697773 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.697711 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 13:03:28.697773 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.697720 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 13:03:28.698075 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.697976 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 13:03:28.698657 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.698643 2580 server.go:310] "Adding debug handlers to kubelet server" Jun 10 13:03:28.702286 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.701159 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-143.ec2.internal.18b7b9edcff42d5f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-143.ec2.internal,UID:ip-10-0-135-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-143.ec2.internal,},FirstTimestamp:2026-06-10 13:03:28.695594335 +0000 UTC m=+0.402210919,LastTimestamp:2026-06-10 13:03:28.695594335 +0000 UTC m=+0.402210919,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-143.ec2.internal,}" Jun 10 13:03:28.705569 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.705541 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 13:03:28.707934 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.707913 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 13:03:28.708021 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.707915 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 13:03:28.708021 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.707998 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-143.ec2.internal\" not found" Jun 10 13:03:28.708853 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.708782 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 13:03:28.708928 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.708793 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 13:03:28.708928 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.708894 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 13:03:28.709061 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.709047 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 10 13:03:28.709115 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.709062 2580 reconciler.go:29] "Reconciler: start to sync state" Jun 10 13:03:28.709933 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.709905 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 13:03:28.710208 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.710185 2580 factory.go:55] Registering systemd factory Jun 10 13:03:28.710208 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.710208 2580 factory.go:223] Registration of the systemd container factory successfully Jun 10 13:03:28.710536 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.710522 2580 factory.go:153] Registering CRI-O factory Jun 10 13:03:28.710536 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.710538 2580 factory.go:223] Registration of the crio container factory successfully Jun 10 13:03:28.710662 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.710589 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 13:03:28.710662 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.710620 2580 factory.go:103] Registering Raw factory Jun 10 13:03:28.710662 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.710636 2580 manager.go:1196] Started watching for new ooms in manager Jun 10 13:03:28.711072 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.711045 2580 manager.go:349] Starting recovery of all containers Jun 10 13:03:28.719896 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.719726 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qqjjn" Jun 10 13:03:28.721987 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.721966 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 13:03:28.722610 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.722595 2580 manager.go:354] Recovery completed Jun 10 13:03:28.727032 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.727018 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:28.727884 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.727868 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qqjjn" Jun 10 13:03:28.730435 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.730417 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:28.730548 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.730449 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:28.730548 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.730463 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:28.731059 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.731043 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 13:03:28.731059 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.731055 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:28.731059 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.731057 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 13:03:28.731240 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.731075 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 10 13:03:28.731766 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.731752 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:28.731835 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.731782 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:28.731835 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.731796 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:28.732984 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.732961 2580 policy_none.go:49] "None policy: Start" Jun 10 13:03:28.733057 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.732987 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 13:03:28.733057 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.733001 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 13:03:28.734685 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.734673 2580 policy_none.go:47] "Start" Jun 10 13:03:28.776217 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.776200 2580 manager.go:337] "Starting Device Plugin manager" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.776236 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.776250 2580 server.go:87] "Starting device plugin registration server" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.776556 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.776566 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.776667 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.776745 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.776752 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.777383 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.777434 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-143.ec2.internal\" not found" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.779640 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.780913 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.780950 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.780969 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.780999 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 13:03:28.790752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.782621 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:28.877153 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.877067 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:28.878228 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.878212 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:28.878317 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.878241 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:28.878317 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.878251 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:28.878317 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.878274 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-143.ec2.internal" Jun 10 13:03:28.882036 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.882016 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-143.ec2.internal"] Jun 10 13:03:28.882115 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.882077 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:28.882971 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.882957 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:28.883045 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.882984 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:28.883045 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.882996 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:28.885288 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.885276 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:28.885409 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.885396 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" Jun 10 13:03:28.885444 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.885426 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:28.886012 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.885980 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:28.886012 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.885990 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:28.886012 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.886012 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:28.886196 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.886022 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:28.886196 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.886013 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:28.886196 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.886174 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:28.887212 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.887197 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-143.ec2.internal" Jun 10 13:03:28.887266 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.887222 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-143.ec2.internal\": node \"ip-10-0-135-143.ec2.internal\" not found" Jun 10 13:03:28.888388 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.888374 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-143.ec2.internal" Jun 10 13:03:28.888454 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.888398 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:28.890487 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.890474 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:28.890573 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.890499 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:28.890573 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:28.890531 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:28.912163 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.912135 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-143.ec2.internal\" not found" node="ip-10-0-135-143.ec2.internal" Jun 10 13:03:28.913218 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.913201 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-143.ec2.internal\" not found" Jun 10 13:03:28.916422 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:28.916408 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-143.ec2.internal\" not found" node="ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.010872 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.010843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c64566bf053807dcd0a8d3e6fc451169-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal\" (UID: \"c64566bf053807dcd0a8d3e6fc451169\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.011020 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.010880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c36a00a7cd7fefc8dfa55ac1a7232f3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-143.ec2.internal\" (UID: \"8c36a00a7cd7fefc8dfa55ac1a7232f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.011020 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.010908 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c64566bf053807dcd0a8d3e6fc451169-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal\" (UID: \"c64566bf053807dcd0a8d3e6fc451169\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.014095 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.014078 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-143.ec2.internal\" not found" Jun 10 13:03:29.111396 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.111366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c64566bf053807dcd0a8d3e6fc451169-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal\" (UID: \"c64566bf053807dcd0a8d3e6fc451169\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.111396 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.111399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c64566bf053807dcd0a8d3e6fc451169-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal\" (UID: \"c64566bf053807dcd0a8d3e6fc451169\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.111582 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.111416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c36a00a7cd7fefc8dfa55ac1a7232f3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-143.ec2.internal\" (UID: \"8c36a00a7cd7fefc8dfa55ac1a7232f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.111582 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.111473 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c64566bf053807dcd0a8d3e6fc451169-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal\" (UID: \"c64566bf053807dcd0a8d3e6fc451169\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.111582 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.111545 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c64566bf053807dcd0a8d3e6fc451169-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal\" (UID: \"c64566bf053807dcd0a8d3e6fc451169\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.111678 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.111587 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c36a00a7cd7fefc8dfa55ac1a7232f3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-143.ec2.internal\" (UID: \"8c36a00a7cd7fefc8dfa55ac1a7232f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.114461 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.114445 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-143.ec2.internal\" not found" Jun 10 13:03:29.215236 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.215180 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-143.ec2.internal\" not found" Jun 10 13:03:29.219334 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.219319 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.222709 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.222691 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.316050 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.316020 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-143.ec2.internal\" not found" Jun 10 13:03:29.416489 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.416465 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-143.ec2.internal\" not found" Jun 10 13:03:29.517115 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.517038 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-143.ec2.internal\" not found" Jun 10 13:03:29.617733 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.617699 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-143.ec2.internal\" not found" Jun 10 13:03:29.633685 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.633663 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:29.638104 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.638088 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 13:03:29.638222 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.638201 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 13:03:29.638262 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.638238 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 13:03:29.685434 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.685405 2580 apiserver.go:52] "Watching apiserver" Jun 10 13:03:29.706185 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.706151 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 13:03:29.707383 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.707362 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-2bb2k","openshift-dns/node-resolver-lxkv7","openshift-image-registry/node-ca-6s7xc","openshift-multus/network-metrics-daemon-jxf2x","openshift-network-diagnostics/network-check-target-jr8mb","openshift-network-operator/iptables-alerter-hf2sd","kube-system/konnectivity-agent-srxz8","openshift-multus/multus-647k5","openshift-multus/multus-additional-cni-plugins-ggr9j","openshift-ovn-kubernetes/ovnkube-node-sp54d","kube-system/global-pull-secret-syncer-97st9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78"] Jun 10 13:03:29.708325 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.708308 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.708406 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.708307 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 13:03:29.709927 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.709909 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6s7xc" Jun 10 13:03:29.712482 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.712457 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 13:03:29.712611 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.712462 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 13:03:29.712611 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.712462 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 13:03:29.712611 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.712597 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gp4pg\"" Jun 10 13:03:29.712766 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.712723 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:29.712809 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.712780 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:29.714677 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.714659 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgxtm\" (UniqueName: \"kubernetes.io/projected/9fc2d181-6aa1-4530-9c15-74d967622530-kube-api-access-pgxtm\") pod \"node-ca-6s7xc\" (UID: \"9fc2d181-6aa1-4530-9c15-74d967622530\") " pod="openshift-image-registry/node-ca-6s7xc" Jun 10 13:03:29.714764 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.714686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fc2d181-6aa1-4530-9c15-74d967622530-host\") pod \"node-ca-6s7xc\" (UID: \"9fc2d181-6aa1-4530-9c15-74d967622530\") " pod="openshift-image-registry/node-ca-6s7xc" Jun 10 13:03:29.714764 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.714700 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9fc2d181-6aa1-4530-9c15-74d967622530-serviceca\") pod \"node-ca-6s7xc\" (UID: \"9fc2d181-6aa1-4530-9c15-74d967622530\") " pod="openshift-image-registry/node-ca-6s7xc" Jun 10 13:03:29.715138 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.715119 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:29.717761 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.717742 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-647k5" Jun 10 13:03:29.717870 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.717808 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-frf67\"" Jun 10 13:03:29.717870 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.717851 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 13:03:29.717983 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.717870 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 13:03:29.720482 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.720462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.720614 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.720561 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 13:03:29.720614 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.720597 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 13:03:29.720797 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.720781 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 13:03:29.721309 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.721294 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6gvql\"" Jun 10 13:03:29.721309 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.721301 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 13:03:29.723060 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.723025 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lxkv7" Jun 10 13:03:29.723255 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.723238 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 13:03:29.723452 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.723436 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:03:29.723566 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.723552 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j46nh\"" Jun 10 13:03:29.723815 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.723801 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 13:03:29.726231 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.725808 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 13:03:29.726343 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.726324 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 13:03:29.726677 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.726654 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:29.726773 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.726729 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:29.728542 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.726816 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hqx5z\"" Jun 10 13:03:29.729037 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.729019 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hf2sd" Jun 10 13:03:29.731149 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.731115 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 12:58:28 +0000 UTC" deadline="2028-02-15 01:19:05.181962232 +0000 UTC" Jun 10 13:03:29.731149 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.731147 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.731276 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.731147 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14748h15m35.450817166s" Jun 10 13:03:29.731643 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.731625 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5qss6\"" Jun 10 13:03:29.731736 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.731625 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:03:29.731736 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.731634 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 13:03:29.731736 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.731689 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 13:03:29.733784 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.733770 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.734249 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.734229 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 13:03:29.734317 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.734229 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 13:03:29.734406 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.734384 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2bnjj\"" Jun 10 13:03:29.736124 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.736106 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:29.736220 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.736167 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:29.736220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.736173 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 13:03:29.736478 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.736461 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 13:03:29.736558 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.736466 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 13:03:29.736657 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.736639 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 13:03:29.736722 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.736705 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-88fnp\"" Jun 10 13:03:29.738186 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.738167 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 13:03:29.738274 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.738194 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 13:03:29.738593 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.738576 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.741128 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.741114 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 13:03:29.741257 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.741243 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 13:03:29.741322 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.741271 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 13:03:29.741402 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.741348 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-28rbg\"" Jun 10 13:03:29.743850 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.743832 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-crdpk" Jun 10 13:03:29.752315 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.752298 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-crdpk" Jun 10 13:03:29.810010 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.809988 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 13:03:29.810143 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.810049 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal"] Jun 10 13:03:29.810143 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.810062 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-143.ec2.internal" Jun 10 13:03:29.810316 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.810299 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 13:03:29.815826 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.815804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54b7e057-3679-484b-9c46-bc24300838bc-hosts-file\") pod \"node-resolver-lxkv7\" (UID: \"54b7e057-3679-484b-9c46-bc24300838bc\") " pod="openshift-dns/node-resolver-lxkv7" Jun 10 13:03:29.815916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.815826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1707dc8a-6bac-482e-9067-0e6def87b221-host-slash\") pod \"iptables-alerter-hf2sd\" (UID: \"1707dc8a-6bac-482e-9067-0e6def87b221\") " pod="openshift-network-operator/iptables-alerter-hf2sd" Jun 10 13:03:29.815916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.815881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwbtt\" (UniqueName: \"kubernetes.io/projected/1707dc8a-6bac-482e-9067-0e6def87b221-kube-api-access-qwbtt\") pod \"iptables-alerter-hf2sd\" (UID: \"1707dc8a-6bac-482e-9067-0e6def87b221\") " pod="openshift-network-operator/iptables-alerter-hf2sd" Jun 10 13:03:29.815916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.815904 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-cni-netd\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.816031 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.815918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l98f8\" (UniqueName: \"kubernetes.io/projected/2595b6db-b6d2-40ad-8701-041b3b49ec7b-kube-api-access-l98f8\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.816031 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.815933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-lib-modules\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.816031 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.815948 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54b7e057-3679-484b-9c46-bc24300838bc-tmp-dir\") pod \"node-resolver-lxkv7\" (UID: \"54b7e057-3679-484b-9c46-bc24300838bc\") " pod="openshift-dns/node-resolver-lxkv7" Jun 10 13:03:29.816031 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.815988 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-cni-bin\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.816159 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.816159 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2da8555-0d96-4880-8092-a54510d11495-dbus\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:29.816159 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816114 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:29.816159 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75kx6\" (UniqueName: \"kubernetes.io/projected/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-kube-api-access-75kx6\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:29.816285 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816166 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-os-release\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.816285 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816188 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-sys-fs\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.816285 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816213 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69thz\" (UniqueName: \"kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz\") pod \"network-check-target-jr8mb\" (UID: \"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd\") " pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:29.816285 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-host\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.816285 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816258 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1707dc8a-6bac-482e-9067-0e6def87b221-iptables-alerter-script\") pod \"iptables-alerter-hf2sd\" (UID: \"1707dc8a-6bac-482e-9067-0e6def87b221\") " pod="openshift-network-operator/iptables-alerter-hf2sd" Jun 10 13:03:29.816443 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9fc2d181-6aa1-4530-9c15-74d967622530-serviceca\") pod \"node-ca-6s7xc\" (UID: \"9fc2d181-6aa1-4530-9c15-74d967622530\") " pod="openshift-image-registry/node-ca-6s7xc" Jun 10 13:03:29.816443 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27812599-fe48-41e6-a6d9-8cd80efcd338-agent-certs\") pod \"konnectivity-agent-srxz8\" (UID: \"27812599-fe48-41e6-a6d9-8cd80efcd338\") " pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:29.816443 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816341 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-cni-binary-copy\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.816443 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816361 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-var-lib-kubelet\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.816443 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-device-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.816443 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816404 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.816443 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816420 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-slash\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.816443 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-socket-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.816729 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816464 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-sysconfig\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.816729 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816528 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-log-socket\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.816729 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816566 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-system-cni-dir\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.816729 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816610 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-kubernetes\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.816729 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-sysctl-d\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.816729 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-var-lib-openvswitch\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.816729 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21f87214-39e8-49ef-a8d8-43f3ea75d506-ovnkube-script-lib\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.816729 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2da8555-0d96-4880-8092-a54510d11495-kubelet-config\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:29.816729 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816708 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8567bd74-d5e4-4805-a217-c574405abec9-etc-tuned\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.816729 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27812599-fe48-41e6-a6d9-8cd80efcd338-konnectivity-ca\") pod \"konnectivity-agent-srxz8\" (UID: \"27812599-fe48-41e6-a6d9-8cd80efcd338\") " pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816756 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9fc2d181-6aa1-4530-9c15-74d967622530-serviceca\") pod \"node-ca-6s7xc\" (UID: \"9fc2d181-6aa1-4530-9c15-74d967622530\") " pod="openshift-image-registry/node-ca-6s7xc" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-cni-dir\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-socket-dir-parent\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-run-multus-certs\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-cnibin\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-modprobe-d\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816888 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-etc-openvswitch\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816910 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-daemon-config\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.816960 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-run-k8s-cni-cncf-io\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ck66\" (UniqueName: \"kubernetes.io/projected/21f87214-39e8-49ef-a8d8-43f3ea75d506-kube-api-access-2ck66\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817021 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-var-lib-cni-multus\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z27tb\" (UniqueName: \"kubernetes.io/projected/17725e76-3291-42e1-9ae8-e83422d325b4-kube-api-access-z27tb\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817050 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-registration-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-var-lib-kubelet\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817117 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm84g\" (UniqueName: \"kubernetes.io/projected/54b7e057-3679-484b-9c46-bc24300838bc-kube-api-access-wm84g\") pod \"node-resolver-lxkv7\" (UID: \"54b7e057-3679-484b-9c46-bc24300838bc\") " pod="openshift-dns/node-resolver-lxkv7" Jun 10 13:03:29.817162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817141 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21f87214-39e8-49ef-a8d8-43f3ea75d506-ovn-node-metrics-cert\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817163 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-hostroot\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817181 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-etc-kubernetes\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817210 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17725e76-3291-42e1-9ae8-e83422d325b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817230 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-systemd-units\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817315 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hzn6\" (UniqueName: \"kubernetes.io/projected/8567bd74-d5e4-4805-a217-c574405abec9-kube-api-access-9hzn6\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817371 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17725e76-3291-42e1-9ae8-e83422d325b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817395 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-run-ovn\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817426 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21f87214-39e8-49ef-a8d8-43f3ea75d506-ovnkube-config\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-run-netns\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqg25\" (UniqueName: \"kubernetes.io/projected/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-kube-api-access-zqg25\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8567bd74-d5e4-4805-a217-c574405abec9-tmp\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817649 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-kubelet\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-node-log\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.817831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817691 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-run-ovn-kubernetes\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817713 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-sysctl-conf\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817729 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-run\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fc2d181-6aa1-4530-9c15-74d967622530-host\") pod \"node-ca-6s7xc\" (UID: \"9fc2d181-6aa1-4530-9c15-74d967622530\") " pod="openshift-image-registry/node-ca-6s7xc" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817797 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-os-release\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817835 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9fc2d181-6aa1-4530-9c15-74d967622530-host\") pod \"node-ca-6s7xc\" (UID: \"9fc2d181-6aa1-4530-9c15-74d967622530\") " pod="openshift-image-registry/node-ca-6s7xc" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817884 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-conf-dir\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21f87214-39e8-49ef-a8d8-43f3ea75d506-env-overrides\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxtm\" (UniqueName: \"kubernetes.io/projected/9fc2d181-6aa1-4530-9c15-74d967622530-kube-api-access-pgxtm\") pod \"node-ca-6s7xc\" (UID: \"9fc2d181-6aa1-4530-9c15-74d967622530\") " pod="openshift-image-registry/node-ca-6s7xc" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817968 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-var-lib-cni-bin\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.817993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17725e76-3291-42e1-9ae8-e83422d325b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.818021 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.818045 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-run-netns\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.818069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-run-systemd\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.818093 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-run-openvswitch\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.818112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-cnibin\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.818135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-system-cni-dir\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.818695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.818184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-systemd\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.819170 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.818207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-sys\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.819392 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.819378 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 13:03:29.822082 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.820573 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-143.ec2.internal"] Jun 10 13:03:29.825821 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.825802 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 13:03:29.829112 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.829093 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgxtm\" (UniqueName: \"kubernetes.io/projected/9fc2d181-6aa1-4530-9c15-74d967622530-kube-api-access-pgxtm\") pod \"node-ca-6s7xc\" (UID: \"9fc2d181-6aa1-4530-9c15-74d967622530\") " pod="openshift-image-registry/node-ca-6s7xc" Jun 10 13:03:29.872281 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:29.872247 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64566bf053807dcd0a8d3e6fc451169.slice/crio-f32685d10c1d2d62039d19cce9f53b0fe51e4ff2069fb4455935852a6c76e787 WatchSource:0}: Error finding container f32685d10c1d2d62039d19cce9f53b0fe51e4ff2069fb4455935852a6c76e787: Status 404 returned error can't find the container with id f32685d10c1d2d62039d19cce9f53b0fe51e4ff2069fb4455935852a6c76e787 Jun 10 13:03:29.874844 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:29.874823 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c36a00a7cd7fefc8dfa55ac1a7232f3.slice/crio-f2d920718648d70d6ca6f81134efb95a9322814bff13634cb8c4f377eebf9f86 WatchSource:0}: Error finding container f2d920718648d70d6ca6f81134efb95a9322814bff13634cb8c4f377eebf9f86: Status 404 returned error can't find the container with id f2d920718648d70d6ca6f81134efb95a9322814bff13634cb8c4f377eebf9f86 Jun 10 13:03:29.879809 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.879782 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:03:29.919304 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919271 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-node-log\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.919448 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-run-ovn-kubernetes\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.919448 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-sysctl-conf\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.919448 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-run\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.919448 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919381 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-node-log\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.919448 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919389 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-run-ovn-kubernetes\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.919448 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919411 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-run\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.919448 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919418 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-os-release\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.919448 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-conf-dir\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919456 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-sysctl-conf\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21f87214-39e8-49ef-a8d8-43f3ea75d506-env-overrides\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919494 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-conf-dir\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919494 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-var-lib-cni-bin\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919543 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-var-lib-cni-bin\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919545 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17725e76-3291-42e1-9ae8-e83422d325b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919497 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-os-release\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919583 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-run-netns\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-run-systemd\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919627 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-run-netns\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919626 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919635 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-run-systemd\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-run-openvswitch\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919671 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-run-openvswitch\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-cnibin\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-system-cni-dir\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.919859 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-systemd\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-sys\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919754 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-system-cni-dir\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919725 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-cnibin\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54b7e057-3679-484b-9c46-bc24300838bc-hosts-file\") pod \"node-resolver-lxkv7\" (UID: \"54b7e057-3679-484b-9c46-bc24300838bc\") " pod="openshift-dns/node-resolver-lxkv7" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919787 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-systemd\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919796 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-sys\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919815 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54b7e057-3679-484b-9c46-bc24300838bc-hosts-file\") pod \"node-resolver-lxkv7\" (UID: \"54b7e057-3679-484b-9c46-bc24300838bc\") " pod="openshift-dns/node-resolver-lxkv7" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1707dc8a-6bac-482e-9067-0e6def87b221-host-slash\") pod \"iptables-alerter-hf2sd\" (UID: \"1707dc8a-6bac-482e-9067-0e6def87b221\") " pod="openshift-network-operator/iptables-alerter-hf2sd" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwbtt\" (UniqueName: \"kubernetes.io/projected/1707dc8a-6bac-482e-9067-0e6def87b221-kube-api-access-qwbtt\") pod \"iptables-alerter-hf2sd\" (UID: \"1707dc8a-6bac-482e-9067-0e6def87b221\") " pod="openshift-network-operator/iptables-alerter-hf2sd" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919860 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1707dc8a-6bac-482e-9067-0e6def87b221-host-slash\") pod \"iptables-alerter-hf2sd\" (UID: \"1707dc8a-6bac-482e-9067-0e6def87b221\") " pod="openshift-network-operator/iptables-alerter-hf2sd" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919871 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-cni-netd\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l98f8\" (UniqueName: \"kubernetes.io/projected/2595b6db-b6d2-40ad-8701-041b3b49ec7b-kube-api-access-l98f8\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919921 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-lib-modules\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54b7e057-3679-484b-9c46-bc24300838bc-tmp-dir\") pod \"node-resolver-lxkv7\" (UID: \"54b7e057-3679-484b-9c46-bc24300838bc\") " pod="openshift-dns/node-resolver-lxkv7" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919933 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-cni-netd\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.919966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-cni-bin\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920013 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-cni-bin\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.920636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920052 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-lib-modules\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920055 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21f87214-39e8-49ef-a8d8-43f3ea75d506-env-overrides\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2da8555-0d96-4880-8092-a54510d11495-dbus\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920094 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920108 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17725e76-3291-42e1-9ae8-e83422d325b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75kx6\" (UniqueName: \"kubernetes.io/projected/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-kube-api-access-75kx6\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920176 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2da8555-0d96-4880-8092-a54510d11495-dbus\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-os-release\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.920202 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-sys-fs\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69thz\" (UniqueName: \"kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz\") pod \"network-check-target-jr8mb\" (UID: \"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd\") " pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.920260 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret podName:c2da8555-0d96-4880-8092-a54510d11495 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:30.420237987 +0000 UTC m=+2.126854559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret") pod "global-pull-secret-syncer-97st9" (UID: "c2da8555-0d96-4880-8092-a54510d11495") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920261 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54b7e057-3679-484b-9c46-bc24300838bc-tmp-dir\") pod \"node-resolver-lxkv7\" (UID: \"54b7e057-3679-484b-9c46-bc24300838bc\") " pod="openshift-dns/node-resolver-lxkv7" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920318 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-os-release\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920328 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-sys-fs\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.921447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920350 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-host\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920377 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1707dc8a-6bac-482e-9067-0e6def87b221-iptables-alerter-script\") pod \"iptables-alerter-hf2sd\" (UID: \"1707dc8a-6bac-482e-9067-0e6def87b221\") " pod="openshift-network-operator/iptables-alerter-hf2sd" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920389 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-host\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27812599-fe48-41e6-a6d9-8cd80efcd338-agent-certs\") pod \"konnectivity-agent-srxz8\" (UID: \"27812599-fe48-41e6-a6d9-8cd80efcd338\") " pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-cni-binary-copy\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-var-lib-kubelet\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-device-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920532 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-var-lib-kubelet\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-slash\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-socket-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920600 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-device-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-sysconfig\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-log-socket\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920660 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-slash\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-system-cni-dir\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920662 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.922277 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-kubernetes\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920706 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-sysconfig\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-sysctl-d\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920721 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-log-socket\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920759 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-var-lib-openvswitch\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21f87214-39e8-49ef-a8d8-43f3ea75d506-ovnkube-script-lib\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920794 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-system-cni-dir\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920808 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2da8555-0d96-4880-8092-a54510d11495-kubelet-config\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8567bd74-d5e4-4805-a217-c574405abec9-etc-tuned\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920844 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-kubernetes\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27812599-fe48-41e6-a6d9-8cd80efcd338-konnectivity-ca\") pod \"konnectivity-agent-srxz8\" (UID: \"27812599-fe48-41e6-a6d9-8cd80efcd338\") " pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920891 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-cni-dir\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920915 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1707dc8a-6bac-482e-9067-0e6def87b221-iptables-alerter-script\") pod \"iptables-alerter-hf2sd\" (UID: \"1707dc8a-6bac-482e-9067-0e6def87b221\") " pod="openshift-network-operator/iptables-alerter-hf2sd" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920921 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-sysctl-d\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920973 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-cni-dir\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920976 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-socket-dir-parent\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920986 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2da8555-0d96-4880-8092-a54510d11495-kubelet-config\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.920920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-socket-dir-parent\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.923139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921004 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-var-lib-openvswitch\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921020 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-cni-binary-copy\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921030 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-run-multus-certs\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921056 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-cnibin\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921080 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-modprobe-d\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-etc-openvswitch\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-daemon-config\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921150 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-run-k8s-cni-cncf-io\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921155 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-run-multus-certs\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ck66\" (UniqueName: \"kubernetes.io/projected/21f87214-39e8-49ef-a8d8-43f3ea75d506-kube-api-access-2ck66\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921183 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-etc-modprobe-d\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-var-lib-cni-multus\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z27tb\" (UniqueName: \"kubernetes.io/projected/17725e76-3291-42e1-9ae8-e83422d325b4-kube-api-access-z27tb\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-registration-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921289 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-var-lib-kubelet\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921291 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21f87214-39e8-49ef-a8d8-43f3ea75d506-ovnkube-script-lib\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921125 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-cnibin\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.923975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm84g\" (UniqueName: \"kubernetes.io/projected/54b7e057-3679-484b-9c46-bc24300838bc-kube-api-access-wm84g\") pod \"node-resolver-lxkv7\" (UID: \"54b7e057-3679-484b-9c46-bc24300838bc\") " pod="openshift-dns/node-resolver-lxkv7" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921330 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-socket-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921341 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21f87214-39e8-49ef-a8d8-43f3ea75d506-ovn-node-metrics-cert\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921377 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27812599-fe48-41e6-a6d9-8cd80efcd338-konnectivity-ca\") pod \"konnectivity-agent-srxz8\" (UID: \"27812599-fe48-41e6-a6d9-8cd80efcd338\") " pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921385 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-var-lib-cni-multus\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921386 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-run-k8s-cni-cncf-io\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921397 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2595b6db-b6d2-40ad-8701-041b3b49ec7b-registration-dir\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921429 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8567bd74-d5e4-4805-a217-c574405abec9-var-lib-kubelet\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921433 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-etc-openvswitch\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-hostroot\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-etc-kubernetes\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17725e76-3291-42e1-9ae8-e83422d325b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-systemd-units\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921631 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-hostroot\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921636 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-etc-kubernetes\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hzn6\" (UniqueName: \"kubernetes.io/projected/8567bd74-d5e4-4805-a217-c574405abec9-kube-api-access-9hzn6\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.924437 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921699 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-multus-daemon-config\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921691 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-systemd-units\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.921738 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.921790 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs podName:ffc9a8d8-2cfa-4231-8377-9114e16df4e7 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:30.421774262 +0000 UTC m=+2.128390850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs") pod "network-metrics-daemon-jxf2x" (UID: "ffc9a8d8-2cfa-4231-8377-9114e16df4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17725e76-3291-42e1-9ae8-e83422d325b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-run-ovn\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921851 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17725e76-3291-42e1-9ae8-e83422d325b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921886 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-run-ovn\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21f87214-39e8-49ef-a8d8-43f3ea75d506-ovnkube-config\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-run-netns\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921972 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqg25\" (UniqueName: \"kubernetes.io/projected/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-kube-api-access-zqg25\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.921995 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8567bd74-d5e4-4805-a217-c574405abec9-tmp\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.922019 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-kubelet\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.922025 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-host-run-netns\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.922267 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21f87214-39e8-49ef-a8d8-43f3ea75d506-host-kubelet\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.922420 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21f87214-39e8-49ef-a8d8-43f3ea75d506-ovnkube-config\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.924956 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.922877 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17725e76-3291-42e1-9ae8-e83422d325b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.925419 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.922967 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17725e76-3291-42e1-9ae8-e83422d325b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.925419 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.923381 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27812599-fe48-41e6-a6d9-8cd80efcd338-agent-certs\") pod \"konnectivity-agent-srxz8\" (UID: \"27812599-fe48-41e6-a6d9-8cd80efcd338\") " pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:29.925419 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.923663 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8567bd74-d5e4-4805-a217-c574405abec9-etc-tuned\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.925419 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.923900 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21f87214-39e8-49ef-a8d8-43f3ea75d506-ovn-node-metrics-cert\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:29.925419 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.924080 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8567bd74-d5e4-4805-a217-c574405abec9-tmp\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.935461 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.935435 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwbtt\" (UniqueName: \"kubernetes.io/projected/1707dc8a-6bac-482e-9067-0e6def87b221-kube-api-access-qwbtt\") pod \"iptables-alerter-hf2sd\" (UID: \"1707dc8a-6bac-482e-9067-0e6def87b221\") " pod="openshift-network-operator/iptables-alerter-hf2sd" Jun 10 13:03:29.935695 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.935678 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:03:29.935770 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.935701 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:03:29.935770 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.935714 2580 projected.go:196] Error preparing data for projected volume kube-api-access-69thz for pod openshift-network-diagnostics/network-check-target-jr8mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:29.935770 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:29.935766 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz podName:0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd nodeName:}" failed. No retries permitted until 2026-06-10 13:03:30.43575072 +0000 UTC m=+2.142367307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-69thz" (UniqueName: "kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz") pod "network-check-target-jr8mb" (UID: "0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:29.935993 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.935969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l98f8\" (UniqueName: \"kubernetes.io/projected/2595b6db-b6d2-40ad-8701-041b3b49ec7b-kube-api-access-l98f8\") pod \"aws-ebs-csi-driver-node-7nx78\" (UID: \"2595b6db-b6d2-40ad-8701-041b3b49ec7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:29.936063 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.936003 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75kx6\" (UniqueName: \"kubernetes.io/projected/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-kube-api-access-75kx6\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:29.936179 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.936162 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z27tb\" (UniqueName: \"kubernetes.io/projected/17725e76-3291-42e1-9ae8-e83422d325b4-kube-api-access-z27tb\") pod \"multus-additional-cni-plugins-ggr9j\" (UID: \"17725e76-3291-42e1-9ae8-e83422d325b4\") " pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:29.936747 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.936722 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqg25\" (UniqueName: \"kubernetes.io/projected/f586342c-a5b7-4dcc-a182-8acf1e8ef8b9-kube-api-access-zqg25\") pod \"multus-647k5\" (UID: \"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9\") " pod="openshift-multus/multus-647k5" Jun 10 13:03:29.936966 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.936950 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm84g\" (UniqueName: \"kubernetes.io/projected/54b7e057-3679-484b-9c46-bc24300838bc-kube-api-access-wm84g\") pod \"node-resolver-lxkv7\" (UID: \"54b7e057-3679-484b-9c46-bc24300838bc\") " pod="openshift-dns/node-resolver-lxkv7" Jun 10 13:03:29.937305 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.937291 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hzn6\" (UniqueName: \"kubernetes.io/projected/8567bd74-d5e4-4805-a217-c574405abec9-kube-api-access-9hzn6\") pod \"tuned-2bb2k\" (UID: \"8567bd74-d5e4-4805-a217-c574405abec9\") " pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:29.938282 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:29.938263 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ck66\" (UniqueName: \"kubernetes.io/projected/21f87214-39e8-49ef-a8d8-43f3ea75d506-kube-api-access-2ck66\") pod \"ovnkube-node-sp54d\" (UID: \"21f87214-39e8-49ef-a8d8-43f3ea75d506\") " pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:30.042480 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.042406 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6s7xc" Jun 10 13:03:30.052093 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:30.052071 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc2d181_6aa1_4530_9c15_74d967622530.slice/crio-e7b84b5aa21371d14433b41f30c26d61aec331656eb22c2ca85786e2c66925c7 WatchSource:0}: Error finding container e7b84b5aa21371d14433b41f30c26d61aec331656eb22c2ca85786e2c66925c7: Status 404 returned error can't find the container with id e7b84b5aa21371d14433b41f30c26d61aec331656eb22c2ca85786e2c66925c7 Jun 10 13:03:30.056185 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.056166 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:30.064025 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:30.063996 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27812599_fe48_41e6_a6d9_8cd80efcd338.slice/crio-ac6c18e45513bbee2df2667d9e13668d8a73280f3134b58e5769242747bef0fc WatchSource:0}: Error finding container ac6c18e45513bbee2df2667d9e13668d8a73280f3134b58e5769242747bef0fc: Status 404 returned error can't find the container with id ac6c18e45513bbee2df2667d9e13668d8a73280f3134b58e5769242747bef0fc Jun 10 13:03:30.069230 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.069210 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-647k5" Jun 10 13:03:30.077022 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:30.076998 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf586342c_a5b7_4dcc_a182_8acf1e8ef8b9.slice/crio-a8488df10cf36febee177f187f0607acab77ee32ccd0fb8cc96632a3d9c416c7 WatchSource:0}: Error finding container a8488df10cf36febee177f187f0607acab77ee32ccd0fb8cc96632a3d9c416c7: Status 404 returned error can't find the container with id a8488df10cf36febee177f187f0607acab77ee32ccd0fb8cc96632a3d9c416c7 Jun 10 13:03:30.083075 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.083058 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" Jun 10 13:03:30.090640 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:30.090616 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8567bd74_d5e4_4805_a217_c574405abec9.slice/crio-9b6ba532b77c8550be2953db5262760b90b3a3d21264e8b355c53ce8fb4a0e15 WatchSource:0}: Error finding container 9b6ba532b77c8550be2953db5262760b90b3a3d21264e8b355c53ce8fb4a0e15: Status 404 returned error can't find the container with id 9b6ba532b77c8550be2953db5262760b90b3a3d21264e8b355c53ce8fb4a0e15 Jun 10 13:03:30.097650 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.097631 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lxkv7" Jun 10 13:03:30.104937 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.104918 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:30.105456 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:30.105434 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b7e057_3679_484b_9c46_bc24300838bc.slice/crio-bc48062bb88368729911818ce8d3101c3638e218710143bd1d16dab1630b1aaa WatchSource:0}: Error finding container bc48062bb88368729911818ce8d3101c3638e218710143bd1d16dab1630b1aaa: Status 404 returned error can't find the container with id bc48062bb88368729911818ce8d3101c3638e218710143bd1d16dab1630b1aaa Jun 10 13:03:30.108038 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.108021 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:30.114489 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.114471 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hf2sd" Jun 10 13:03:30.122178 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:30.122158 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1707dc8a_6bac_482e_9067_0e6def87b221.slice/crio-049e26a32295243318a22b668d758eac85b09d79bf455613aefc9995dad3adb8 WatchSource:0}: Error finding container 049e26a32295243318a22b668d758eac85b09d79bf455613aefc9995dad3adb8: Status 404 returned error can't find the container with id 049e26a32295243318a22b668d758eac85b09d79bf455613aefc9995dad3adb8 Jun 10 13:03:30.129792 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.129773 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ggr9j" Jun 10 13:03:30.137374 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.137352 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:30.140618 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.140601 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" Jun 10 13:03:30.146265 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:30.146241 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f87214_39e8_49ef_a8d8_43f3ea75d506.slice/crio-9163c00c1aabe6226f2b97e57386982c2a274e351bd550f53616537ff7c9e6d7 WatchSource:0}: Error finding container 9163c00c1aabe6226f2b97e57386982c2a274e351bd550f53616537ff7c9e6d7: Status 404 returned error can't find the container with id 9163c00c1aabe6226f2b97e57386982c2a274e351bd550f53616537ff7c9e6d7 Jun 10 13:03:30.149220 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:03:30.149195 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2595b6db_b6d2_40ad_8701_041b3b49ec7b.slice/crio-474337d7509b7568403101fabe7c27d826e016ead4cf0a81449fdc9619f1c09e WatchSource:0}: Error finding container 474337d7509b7568403101fabe7c27d826e016ead4cf0a81449fdc9619f1c09e: Status 404 returned error can't find the container with id 474337d7509b7568403101fabe7c27d826e016ead4cf0a81449fdc9619f1c09e Jun 10 13:03:30.425341 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.425002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:30.425489 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.425371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:30.425489 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:30.425174 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:30.425489 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:30.425482 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret podName:c2da8555-0d96-4880-8092-a54510d11495 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:31.425456312 +0000 UTC m=+3.132072898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret") pod "global-pull-secret-syncer-97st9" (UID: "c2da8555-0d96-4880-8092-a54510d11495") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:30.425681 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:30.425597 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:30.425728 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:30.425698 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs podName:ffc9a8d8-2cfa-4231-8377-9114e16df4e7 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:31.425680124 +0000 UTC m=+3.132296710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs") pod "network-metrics-daemon-jxf2x" (UID: "ffc9a8d8-2cfa-4231-8377-9114e16df4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:30.526740 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.526702 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69thz\" (UniqueName: \"kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz\") pod \"network-check-target-jr8mb\" (UID: \"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd\") " pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:30.526922 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:30.526877 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:03:30.526922 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:30.526897 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:03:30.526922 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:30.526910 2580 projected.go:196] Error preparing data for projected volume kube-api-access-69thz for pod openshift-network-diagnostics/network-check-target-jr8mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:30.527084 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:30.526973 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz podName:0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd nodeName:}" failed. No retries permitted until 2026-06-10 13:03:31.526953703 +0000 UTC m=+3.233570299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-69thz" (UniqueName: "kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz") pod "network-check-target-jr8mb" (UID: "0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:30.755632 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.755519 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:58:29 +0000 UTC" deadline="2028-01-13 10:00:25.547290354 +0000 UTC" Jun 10 13:03:30.755632 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.755580 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13964h56m54.791715043s" Jun 10 13:03:30.815089 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.814891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" event={"ID":"2595b6db-b6d2-40ad-8701-041b3b49ec7b","Type":"ContainerStarted","Data":"474337d7509b7568403101fabe7c27d826e016ead4cf0a81449fdc9619f1c09e"} Jun 10 13:03:30.854292 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.854254 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" event={"ID":"21f87214-39e8-49ef-a8d8-43f3ea75d506","Type":"ContainerStarted","Data":"9163c00c1aabe6226f2b97e57386982c2a274e351bd550f53616537ff7c9e6d7"} Jun 10 13:03:30.872116 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.872037 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ggr9j" event={"ID":"17725e76-3291-42e1-9ae8-e83422d325b4","Type":"ContainerStarted","Data":"330b99c477397fb81ebdfb8f81d1917212bab7ae91455c277c97618436786293"} Jun 10 13:03:30.887612 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.887474 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hf2sd" event={"ID":"1707dc8a-6bac-482e-9067-0e6def87b221","Type":"ContainerStarted","Data":"049e26a32295243318a22b668d758eac85b09d79bf455613aefc9995dad3adb8"} Jun 10 13:03:30.917766 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.917413 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lxkv7" event={"ID":"54b7e057-3679-484b-9c46-bc24300838bc","Type":"ContainerStarted","Data":"bc48062bb88368729911818ce8d3101c3638e218710143bd1d16dab1630b1aaa"} Jun 10 13:03:30.932028 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.931990 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" event={"ID":"8567bd74-d5e4-4805-a217-c574405abec9","Type":"ContainerStarted","Data":"9b6ba532b77c8550be2953db5262760b90b3a3d21264e8b355c53ce8fb4a0e15"} Jun 10 13:03:30.957692 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.957614 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-647k5" event={"ID":"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9","Type":"ContainerStarted","Data":"a8488df10cf36febee177f187f0607acab77ee32ccd0fb8cc96632a3d9c416c7"} Jun 10 13:03:30.983525 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:30.983465 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-srxz8" event={"ID":"27812599-fe48-41e6-a6d9-8cd80efcd338","Type":"ContainerStarted","Data":"ac6c18e45513bbee2df2667d9e13668d8a73280f3134b58e5769242747bef0fc"} Jun 10 13:03:31.010982 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.010856 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6s7xc" event={"ID":"9fc2d181-6aa1-4530-9c15-74d967622530","Type":"ContainerStarted","Data":"e7b84b5aa21371d14433b41f30c26d61aec331656eb22c2ca85786e2c66925c7"} Jun 10 13:03:31.023837 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.023804 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" event={"ID":"c64566bf053807dcd0a8d3e6fc451169","Type":"ContainerStarted","Data":"f32685d10c1d2d62039d19cce9f53b0fe51e4ff2069fb4455935852a6c76e787"} Jun 10 13:03:31.041828 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.041800 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:31.047020 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.046893 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-143.ec2.internal" event={"ID":"8c36a00a7cd7fefc8dfa55ac1a7232f3","Type":"ContainerStarted","Data":"f2d920718648d70d6ca6f81134efb95a9322814bff13634cb8c4f377eebf9f86"} Jun 10 13:03:31.445974 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.445893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:31.445974 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.445967 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:31.446200 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:31.446112 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:31.446200 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:31.446172 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs podName:ffc9a8d8-2cfa-4231-8377-9114e16df4e7 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:33.446154367 +0000 UTC m=+5.152770944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs") pod "network-metrics-daemon-jxf2x" (UID: "ffc9a8d8-2cfa-4231-8377-9114e16df4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:31.446319 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:31.446237 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:31.446319 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:31.446283 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret podName:c2da8555-0d96-4880-8092-a54510d11495 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:33.446261761 +0000 UTC m=+5.152878339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret") pod "global-pull-secret-syncer-97st9" (UID: "c2da8555-0d96-4880-8092-a54510d11495") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:31.546966 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.546933 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69thz\" (UniqueName: \"kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz\") pod \"network-check-target-jr8mb\" (UID: \"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd\") " pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:31.547382 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:31.547140 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:03:31.547382 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:31.547162 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:03:31.547382 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:31.547175 2580 projected.go:196] Error preparing data for projected volume kube-api-access-69thz for pod openshift-network-diagnostics/network-check-target-jr8mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:31.547382 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:31.547230 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz podName:0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd nodeName:}" failed. No retries permitted until 2026-06-10 13:03:33.547213037 +0000 UTC m=+5.253829612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-69thz" (UniqueName: "kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz") pod "network-check-target-jr8mb" (UID: "0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:31.729119 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.728719 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:31.756733 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.756474 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:58:29 +0000 UTC" deadline="2028-03-11 20:00:33.461961438 +0000 UTC" Jun 10 13:03:31.756733 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.756518 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15366h57m1.705448411s" Jun 10 13:03:31.782047 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.782020 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:31.782213 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:31.782183 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:31.782677 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.782656 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:31.782775 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:31.782755 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:31.783004 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:31.782839 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:31.783004 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:31.782929 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:33.463974 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:33.463916 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:33.464440 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:33.464005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:33.464440 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:33.464132 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:33.464440 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:33.464141 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:33.464440 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:33.464203 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs podName:ffc9a8d8-2cfa-4231-8377-9114e16df4e7 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:37.464182358 +0000 UTC m=+9.170798949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs") pod "network-metrics-daemon-jxf2x" (UID: "ffc9a8d8-2cfa-4231-8377-9114e16df4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:33.464440 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:33.464222 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret podName:c2da8555-0d96-4880-8092-a54510d11495 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:37.464212937 +0000 UTC m=+9.170829514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret") pod "global-pull-secret-syncer-97st9" (UID: "c2da8555-0d96-4880-8092-a54510d11495") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:33.565143 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:33.565104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69thz\" (UniqueName: \"kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz\") pod \"network-check-target-jr8mb\" (UID: \"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd\") " pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:33.565339 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:33.565262 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:03:33.565339 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:33.565286 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:03:33.565339 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:33.565298 2580 projected.go:196] Error preparing data for projected volume kube-api-access-69thz for pod openshift-network-diagnostics/network-check-target-jr8mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:33.565496 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:33.565362 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz podName:0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd nodeName:}" failed. No retries permitted until 2026-06-10 13:03:37.565344569 +0000 UTC m=+9.271961144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-69thz" (UniqueName: "kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz") pod "network-check-target-jr8mb" (UID: "0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:33.781858 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:33.781829 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:33.782011 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:33.781859 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:33.782011 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:33.781977 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:33.782146 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:33.782113 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:33.782259 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:33.782229 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:33.782322 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:33.782282 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:35.781837 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:35.781803 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:35.782315 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:35.781800 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:35.782315 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:35.781939 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:35.782315 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:35.781803 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:35.782315 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:35.782013 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:35.782315 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:35.782063 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:37.498771 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:37.498733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:37.499253 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:37.498804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:37.499253 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:37.498910 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:37.499253 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:37.498945 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:37.499253 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:37.498990 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs podName:ffc9a8d8-2cfa-4231-8377-9114e16df4e7 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:45.498970245 +0000 UTC m=+17.205586822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs") pod "network-metrics-daemon-jxf2x" (UID: "ffc9a8d8-2cfa-4231-8377-9114e16df4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:37.499253 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:37.499008 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret podName:c2da8555-0d96-4880-8092-a54510d11495 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:45.498999683 +0000 UTC m=+17.205616254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret") pod "global-pull-secret-syncer-97st9" (UID: "c2da8555-0d96-4880-8092-a54510d11495") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:37.600175 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:37.600136 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69thz\" (UniqueName: \"kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz\") pod \"network-check-target-jr8mb\" (UID: \"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd\") " pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:37.600322 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:37.600292 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:03:37.600322 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:37.600314 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:03:37.600433 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:37.600328 2580 projected.go:196] Error preparing data for projected volume kube-api-access-69thz for pod openshift-network-diagnostics/network-check-target-jr8mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:37.600433 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:37.600393 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz podName:0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd nodeName:}" failed. No retries permitted until 2026-06-10 13:03:45.600374683 +0000 UTC m=+17.306991257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-69thz" (UniqueName: "kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz") pod "network-check-target-jr8mb" (UID: "0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:37.782318 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:37.782094 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:37.782318 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:37.782120 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:37.782318 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:37.782094 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:37.782318 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:37.782296 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:37.782649 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:37.782428 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:37.782649 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:37.782541 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:39.781308 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:39.781200 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:39.781308 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:39.781244 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:39.781807 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:39.781335 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:39.781807 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:39.781390 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:39.781807 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:39.781458 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:39.781807 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:39.781547 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:41.781647 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:41.781609 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:41.781647 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:41.781642 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:41.782124 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:41.781661 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:41.782124 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:41.781779 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:41.782124 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:41.781910 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:41.782124 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:41.781993 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:43.781166 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:43.781131 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:43.781648 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:43.781131 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:43.781648 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:43.781246 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:43.781648 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:43.781358 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:43.781648 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:43.781131 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:43.781648 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:43.781463 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:45.564815 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:45.564773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:45.565254 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:45.564862 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:45.565254 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:45.564945 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:45.565254 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:45.564975 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:45.565254 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:45.565037 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret podName:c2da8555-0d96-4880-8092-a54510d11495 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:01.565016549 +0000 UTC m=+33.271633150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret") pod "global-pull-secret-syncer-97st9" (UID: "c2da8555-0d96-4880-8092-a54510d11495") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:45.565254 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:45.565058 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs podName:ffc9a8d8-2cfa-4231-8377-9114e16df4e7 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:01.565047823 +0000 UTC m=+33.271664395 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs") pod "network-metrics-daemon-jxf2x" (UID: "ffc9a8d8-2cfa-4231-8377-9114e16df4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:45.665960 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:45.665854 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69thz\" (UniqueName: \"kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz\") pod \"network-check-target-jr8mb\" (UID: \"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd\") " pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:45.666146 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:45.666025 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:03:45.666146 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:45.666049 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:03:45.666146 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:45.666059 2580 projected.go:196] Error preparing data for projected volume kube-api-access-69thz for pod openshift-network-diagnostics/network-check-target-jr8mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:45.666146 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:45.666121 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz podName:0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd nodeName:}" failed. No retries permitted until 2026-06-10 13:04:01.666105042 +0000 UTC m=+33.372721635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-69thz" (UniqueName: "kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz") pod "network-check-target-jr8mb" (UID: "0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:45.781332 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:45.781293 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:45.781332 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:45.781339 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:45.781718 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:45.781472 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:45.781718 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:45.781478 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:45.781718 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:45.781588 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:45.781884 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:45.781719 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:47.781642 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:47.781602 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:47.781642 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:47.781626 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:47.782271 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:47.781720 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:47.782271 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:47.781734 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:47.782271 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:47.781781 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:47.782271 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:47.781851 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:49.781650 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:49.781624 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:49.782029 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:49.781657 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:49.782029 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:49.781720 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:49.782029 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:49.781735 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:49.782029 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:49.781796 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:49.782029 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:49.781843 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:50.095331 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:50.095297 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-143.ec2.internal" event={"ID":"8c36a00a7cd7fefc8dfa55ac1a7232f3","Type":"ContainerStarted","Data":"19a0e0a12a3109a954f727ddeef49cae6f515d07d1f7b178990ec7bfd268b878"} Jun 10 13:03:50.120545 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:50.120476 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-143.ec2.internal" podStartSLOduration=21.120459966 podStartE2EDuration="21.120459966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:50.119984958 +0000 UTC m=+21.826601553" watchObservedRunningTime="2026-06-10 13:03:50.120459966 +0000 UTC m=+21.827076559" Jun 10 13:03:51.107231 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.107042 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-647k5" event={"ID":"f586342c-a5b7-4dcc-a182-8acf1e8ef8b9","Type":"ContainerStarted","Data":"fce2ca8c3002bea9b7718d025879cb69c4b1fbd53ac8f9490afbfefdd5e74043"} Jun 10 13:03:51.109220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.109120 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:03:51.109513 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.109477 2580 generic.go:356] "Generic (PLEG): container finished" podID="21f87214-39e8-49ef-a8d8-43f3ea75d506" containerID="29530e4982a4d1a9fac276187acc6931fa8b4a946490a5ebdeed1e3d3593d52a" exitCode=1 Jun 10 13:03:51.109599 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.109529 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" event={"ID":"21f87214-39e8-49ef-a8d8-43f3ea75d506","Type":"ContainerStarted","Data":"06ef6b93c72fddf930b177b9aafe883c4bcb69f1bdc8032153983ea1a30d7cbe"} Jun 10 13:03:51.109644 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.109613 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" event={"ID":"21f87214-39e8-49ef-a8d8-43f3ea75d506","Type":"ContainerDied","Data":"29530e4982a4d1a9fac276187acc6931fa8b4a946490a5ebdeed1e3d3593d52a"} Jun 10 13:03:51.109685 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.109664 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" event={"ID":"21f87214-39e8-49ef-a8d8-43f3ea75d506","Type":"ContainerStarted","Data":"1de518b48a439d0c8efcbe77e1118869d7c95f2ae66f1e3a4d3d8e5a93d0dbdf"} Jun 10 13:03:51.111114 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.111089 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" event={"ID":"8567bd74-d5e4-4805-a217-c574405abec9","Type":"ContainerStarted","Data":"537d0479f8506ed1f40aa6c33b70fad6de1bc545199af3ff8256abf55ca0d318"} Jun 10 13:03:51.136108 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.136032 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-647k5" podStartSLOduration=3.40821471 podStartE2EDuration="23.13601223s" totalImagesPullingTime="19.72779752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:51.135655257 +0000 UTC m=+22.842271851" watchObservedRunningTime="2026-06-10 13:03:51.13601223 +0000 UTC m=+22.842628826" Jun 10 13:03:51.154851 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.154795 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2bb2k" podStartSLOduration=2.4737534979999998 podStartE2EDuration="22.154773372s" totalImagesPullingTime="19.681019874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:51.154070416 +0000 UTC m=+22.860687011" watchObservedRunningTime="2026-06-10 13:03:51.154773372 +0000 UTC m=+22.861389968" Jun 10 13:03:51.782445 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.782240 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:51.782735 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.782240 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:51.782735 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:51.782569 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:51.782735 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:51.782242 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:51.782735 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:51.782620 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:51.782735 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:51.782696 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:52.115173 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.115087 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6s7xc" event={"ID":"9fc2d181-6aa1-4530-9c15-74d967622530","Type":"ContainerStarted","Data":"3ebc769dcbb97398c77c22059a12132971eac79fd2f9f9caf4304432fdfcba3b"} Jun 10 13:03:52.116636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.116607 2580 generic.go:356] "Generic (PLEG): container finished" podID="c64566bf053807dcd0a8d3e6fc451169" containerID="6990e5c788329f0c616204c12c8b2d9e53d245d4b5b8e6d4342a50859536fa08" exitCode=0 Jun 10 13:03:52.116756 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.116684 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" event={"ID":"c64566bf053807dcd0a8d3e6fc451169","Type":"ContainerDied","Data":"6990e5c788329f0c616204c12c8b2d9e53d245d4b5b8e6d4342a50859536fa08"} Jun 10 13:03:52.118133 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.118113 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" event={"ID":"2595b6db-b6d2-40ad-8701-041b3b49ec7b","Type":"ContainerStarted","Data":"0c307c3ab5caeab4a1fda017ca5508011838991e7cb08ad75e252e95ca975b01"} Jun 10 13:03:52.120995 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.120975 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:03:52.121330 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.121307 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" event={"ID":"21f87214-39e8-49ef-a8d8-43f3ea75d506","Type":"ContainerStarted","Data":"005861b9cb9c1e7d62f56c90530e46d37da4e4cbd165256ba1260d80ec606faa"} Jun 10 13:03:52.121420 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.121383 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" event={"ID":"21f87214-39e8-49ef-a8d8-43f3ea75d506","Type":"ContainerStarted","Data":"0cddbb6c53460d59de02e817c963aca98da387785d5ce6637f0aa6b88e3ca78d"} Jun 10 13:03:52.121475 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.121438 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" event={"ID":"21f87214-39e8-49ef-a8d8-43f3ea75d506","Type":"ContainerStarted","Data":"76786ae80a8f50e9a5559031bf914f31b836522fb7f92d178148f9b27353ae0a"} Jun 10 13:03:52.122636 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.122611 2580 generic.go:356] "Generic (PLEG): container finished" podID="17725e76-3291-42e1-9ae8-e83422d325b4" containerID="7afe8b03c287462589bbbc9ccfa19927fcac0f2152b14213c052040dd4168438" exitCode=0 Jun 10 13:03:52.122726 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.122673 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ggr9j" event={"ID":"17725e76-3291-42e1-9ae8-e83422d325b4","Type":"ContainerDied","Data":"7afe8b03c287462589bbbc9ccfa19927fcac0f2152b14213c052040dd4168438"} Jun 10 13:03:52.124156 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.124018 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hf2sd" event={"ID":"1707dc8a-6bac-482e-9067-0e6def87b221","Type":"ContainerStarted","Data":"38c7bf741dc22b817b21624110b6ba98e39a8af870cc53e69f820c63add662fc"} Jun 10 13:03:52.125572 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.125534 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lxkv7" event={"ID":"54b7e057-3679-484b-9c46-bc24300838bc","Type":"ContainerStarted","Data":"6be8e777090087a78aca6dd6955f4a1929cc20606f17654079af152e7f19acd1"} Jun 10 13:03:52.126979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.126956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-srxz8" event={"ID":"27812599-fe48-41e6-a6d9-8cd80efcd338","Type":"ContainerStarted","Data":"dcd566c408e1d427f64a90ac8b305129000b2f0b1a7318fce30b4e03360adaad"} Jun 10 13:03:52.154281 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.154229 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6s7xc" podStartSLOduration=4.436128024 podStartE2EDuration="24.154210034s" totalImagesPullingTime="19.71808201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:52.131060093 +0000 UTC m=+23.837676688" watchObservedRunningTime="2026-06-10 13:03:52.154210034 +0000 UTC m=+23.860826629" Jun 10 13:03:52.187227 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.187186 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-srxz8" podStartSLOduration=12.582984204 podStartE2EDuration="24.187170209s" totalImagesPullingTime="11.604186005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:52.187064692 +0000 UTC m=+23.893681285" watchObservedRunningTime="2026-06-10 13:03:52.187170209 +0000 UTC m=+23.893786802" Jun 10 13:03:52.202607 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.202570 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lxkv7" podStartSLOduration=3.537946238 podStartE2EDuration="23.202556226s" totalImagesPullingTime="19.664609988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:52.202214807 +0000 UTC m=+23.908831401" watchObservedRunningTime="2026-06-10 13:03:52.202556226 +0000 UTC m=+23.909172819" Jun 10 13:03:52.218209 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.218167 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hf2sd" podStartSLOduration=3.570987466 podStartE2EDuration="23.218153575s" totalImagesPullingTime="19.647166109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:52.217802362 +0000 UTC m=+23.924418956" watchObservedRunningTime="2026-06-10 13:03:52.218153575 +0000 UTC m=+23.924770171" Jun 10 13:03:52.425303 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.425276 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 13:03:52.787373 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.787215 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T13:03:52.425297447Z","UUID":"fb652eb4-5b3d-4697-b22c-a4d09d0e1cab","Handler":null,"Name":"","Endpoint":""} Jun 10 13:03:52.789360 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.789335 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 13:03:52.789360 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:52.789382 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 13:03:53.132494 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:53.132415 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" event={"ID":"c64566bf053807dcd0a8d3e6fc451169","Type":"ContainerStarted","Data":"0701289ce827917462c162683f7aebe8aa94288fbc22698a86d93993ae366750"} Jun 10 13:03:53.135058 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:53.135024 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" event={"ID":"2595b6db-b6d2-40ad-8701-041b3b49ec7b","Type":"ContainerStarted","Data":"dafd4baa1bf221b9bad7d5f8a5fee50866d75e9cdf1f3b78f07614ce1b6e51c9"} Jun 10 13:03:53.151617 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:53.151559 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-143.ec2.internal" podStartSLOduration=24.151541301 podStartE2EDuration="24.151541301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:53.15117533 +0000 UTC m=+24.857791927" watchObservedRunningTime="2026-06-10 13:03:53.151541301 +0000 UTC m=+24.858157894" Jun 10 13:03:53.782498 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:53.782204 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:53.782498 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:53.782204 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:53.782742 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:53.782245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:53.782742 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:53.782578 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:53.782742 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:53.782637 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:53.782742 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:53.782681 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:53.816422 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:53.816388 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:53.817014 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:53.816992 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:54.139336 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:54.139254 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" event={"ID":"2595b6db-b6d2-40ad-8701-041b3b49ec7b","Type":"ContainerStarted","Data":"520a35249e82dbfa2c6ccfe7aa7f1360b6a1e7c6cc386a5b8886d9d858d61cdd"} Jun 10 13:03:54.142102 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:54.142082 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:03:54.142564 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:54.142536 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" event={"ID":"21f87214-39e8-49ef-a8d8-43f3ea75d506","Type":"ContainerStarted","Data":"9f927f38e226382d5db64b39c07734c990d8b4bbf9e6d5fa03caf2651076b237"} Jun 10 13:03:54.142821 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:54.142807 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:54.143235 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:54.143215 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-srxz8" Jun 10 13:03:54.159767 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:54.159725 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nx78" podStartSLOduration=3.437135644 podStartE2EDuration="25.159706353s" totalImagesPullingTime="21.722570709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:54.15964565 +0000 UTC m=+25.866262247" watchObservedRunningTime="2026-06-10 13:03:54.159706353 +0000 UTC m=+25.866322949" Jun 10 13:03:55.782168 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:55.782131 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:55.782764 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:55.782132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:55.782764 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:55.782256 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:55.782764 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:55.782275 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:55.782764 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:55.782375 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:55.782764 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:55.782455 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:57.152533 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:57.152361 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:03:57.153065 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:57.152852 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" event={"ID":"21f87214-39e8-49ef-a8d8-43f3ea75d506","Type":"ContainerStarted","Data":"fa7a4cd410c3c76515066ddab1374b1f9a5559cd09333416c272b0e071b3791e"} Jun 10 13:03:57.153163 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:57.153141 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:57.153220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:57.153211 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:57.153292 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:57.153274 2580 scope.go:117] "RemoveContainer" containerID="29530e4982a4d1a9fac276187acc6931fa8b4a946490a5ebdeed1e3d3593d52a" Jun 10 13:03:57.179799 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:57.179774 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:57.781479 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:57.781451 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:57.781691 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:57.781450 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:57.781691 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:57.781589 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:57.781691 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:57.781602 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:57.781691 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:57.781671 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:03:57.781898 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:57.781778 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:58.158901 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:58.158827 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:03:58.159350 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:58.159184 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" event={"ID":"21f87214-39e8-49ef-a8d8-43f3ea75d506","Type":"ContainerStarted","Data":"e6b69d1e3046d75eb849f7fe99ba22a7a240aa19726a43ea0b291a2a0e6e1d09"} Jun 10 13:03:58.159432 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:58.159413 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:58.161036 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:58.161009 2580 generic.go:356] "Generic (PLEG): container finished" podID="17725e76-3291-42e1-9ae8-e83422d325b4" containerID="ed4fd4025c2ed995b981b7cd9ab45dac39474d88e238de6e186b4fa9cf82a0a3" exitCode=0 Jun 10 13:03:58.161163 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:58.161053 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ggr9j" event={"ID":"17725e76-3291-42e1-9ae8-e83422d325b4","Type":"ContainerDied","Data":"ed4fd4025c2ed995b981b7cd9ab45dac39474d88e238de6e186b4fa9cf82a0a3"} Jun 10 13:03:58.175325 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:58.175305 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:03:58.192317 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:58.192276 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" podStartSLOduration=8.658707691 podStartE2EDuration="29.192263985s" totalImagesPullingTime="20.533556294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:58.19012086 +0000 UTC m=+29.896737454" watchObservedRunningTime="2026-06-10 13:03:58.192263985 +0000 UTC m=+29.898880582" Jun 10 13:03:59.165466 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:59.165432 2580 generic.go:356] "Generic (PLEG): container finished" podID="17725e76-3291-42e1-9ae8-e83422d325b4" containerID="4cd74bd9505d9769f09b401eb6acbabe063d09a18442561dd3179945dfebb034" exitCode=0 Jun 10 13:03:59.165864 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:59.165523 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ggr9j" event={"ID":"17725e76-3291-42e1-9ae8-e83422d325b4","Type":"ContainerDied","Data":"4cd74bd9505d9769f09b401eb6acbabe063d09a18442561dd3179945dfebb034"} Jun 10 13:03:59.212208 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:59.212143 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-97st9"] Jun 10 13:03:59.212317 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:59.212238 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:03:59.212355 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:59.212313 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:03:59.218482 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:59.218461 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jxf2x"] Jun 10 13:03:59.218597 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:59.218559 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:03:59.218639 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:59.218629 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:03:59.224696 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:59.224675 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jr8mb"] Jun 10 13:03:59.224785 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:03:59.224762 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:03:59.224843 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:03:59.224823 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:04:00.782241 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:00.782057 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:04:00.782792 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:00.782064 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:04:00.782792 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:00.782328 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:04:00.782792 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:00.782064 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:04:00.782792 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:00.782421 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:04:00.782792 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:00.782485 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:04:01.171616 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:01.171524 2580 generic.go:356] "Generic (PLEG): container finished" podID="17725e76-3291-42e1-9ae8-e83422d325b4" containerID="d0e2189d90365cc2e2daf5ca8bd7a1a998975c5847f3c9789834c1bb988e6fa2" exitCode=0 Jun 10 13:04:01.171616 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:01.171580 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ggr9j" event={"ID":"17725e76-3291-42e1-9ae8-e83422d325b4","Type":"ContainerDied","Data":"d0e2189d90365cc2e2daf5ca8bd7a1a998975c5847f3c9789834c1bb988e6fa2"} Jun 10 13:04:01.582066 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:01.582029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:04:01.582246 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:01.582111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:04:01.582246 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:01.582231 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:04:01.582351 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:01.582290 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs podName:ffc9a8d8-2cfa-4231-8377-9114e16df4e7 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:33.582272447 +0000 UTC m=+65.288889022 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs") pod "network-metrics-daemon-jxf2x" (UID: "ffc9a8d8-2cfa-4231-8377-9114e16df4e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:04:01.582468 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:01.582439 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:04:01.582605 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:01.582534 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret podName:c2da8555-0d96-4880-8092-a54510d11495 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:33.582496156 +0000 UTC m=+65.289112745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret") pod "global-pull-secret-syncer-97st9" (UID: "c2da8555-0d96-4880-8092-a54510d11495") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:04:01.683103 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:01.683070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69thz\" (UniqueName: \"kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz\") pod \"network-check-target-jr8mb\" (UID: \"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd\") " pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:04:01.683273 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:01.683226 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:04:01.683273 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:01.683246 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:04:01.683273 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:01.683254 2580 projected.go:196] Error preparing data for projected volume kube-api-access-69thz for pod openshift-network-diagnostics/network-check-target-jr8mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:04:01.683399 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:01.683306 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz podName:0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd nodeName:}" failed. No retries permitted until 2026-06-10 13:04:33.683293054 +0000 UTC m=+65.389909640 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-69thz" (UniqueName: "kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz") pod "network-check-target-jr8mb" (UID: "0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:04:02.781496 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:02.781467 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:04:02.781973 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:02.781619 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jxf2x" podUID="ffc9a8d8-2cfa-4231-8377-9114e16df4e7" Jun 10 13:04:02.782126 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:02.782057 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:04:02.782212 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:02.782167 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jr8mb" podUID="0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd" Jun 10 13:04:02.782267 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:02.782210 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:04:02.782351 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:02.782325 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97st9" podUID="c2da8555-0d96-4880-8092-a54510d11495" Jun 10 13:04:03.138895 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.138821 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-143.ec2.internal" event="NodeReady" Jun 10 13:04:03.139066 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.138977 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 13:04:03.176072 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.176037 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79d47757f-5nts7"] Jun 10 13:04:03.180745 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.180723 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mvpgc"] Jun 10 13:04:03.180890 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.180840 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.184631 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.184601 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 13:04:03.184749 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.184692 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 13:04:03.184749 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.184692 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b6twm\"" Jun 10 13:04:03.184749 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.184730 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 13:04:03.184982 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.184959 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh"] Jun 10 13:04:03.185575 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.185253 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.189055 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.188999 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" Jun 10 13:04:03.190567 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.190547 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 13:04:03.190656 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.190578 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vbhf5\"" Jun 10 13:04:03.190656 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.190608 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:04:03.190915 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.190899 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 13:04:03.191989 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.191946 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 13:04:03.192692 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.192670 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 13:04:03.196541 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.196487 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 13:04:03.197604 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.197581 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nkfr8\"" Jun 10 13:04:03.197864 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.197842 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 13:04:03.200385 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.198920 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:04:03.200385 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.198963 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 13:04:03.202809 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.202785 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw"] Jun 10 13:04:03.204359 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.204341 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 13:04:03.208132 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.208109 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj"] Jun 10 13:04:03.208622 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.208551 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:03.212165 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.211955 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79d47757f-5nts7"] Jun 10 13:04:03.212165 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.211993 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-57qkc"] Jun 10 13:04:03.213112 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.213094 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" Jun 10 13:04:03.215174 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.215115 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 13:04:03.215412 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.215347 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 13:04:03.215412 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.215378 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bp9hq\"" Jun 10 13:04:03.216646 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.216045 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 13:04:03.216646 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.216070 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mwjn2\"" Jun 10 13:04:03.216646 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.216249 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:04:03.216646 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.216283 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 13:04:03.216646 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.216492 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 13:04:03.217110 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.217078 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mvpgc"] Jun 10 13:04:03.217272 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.217246 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fxrlc"] Jun 10 13:04:03.218660 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.217346 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-57qkc" Jun 10 13:04:03.222070 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.222052 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xzqbn\"" Jun 10 13:04:03.222168 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.222145 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 13:04:03.222232 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.222173 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.222334 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.222106 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s99l7"] Jun 10 13:04:03.222419 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.222401 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 13:04:03.224846 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.224827 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 13:04:03.224846 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.224838 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 13:04:03.224989 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.224878 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-np4vc\"" Jun 10 13:04:03.225896 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.225877 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj"] Jun 10 13:04:03.225983 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.225913 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw"] Jun 10 13:04:03.225983 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.225940 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-57qkc"] Jun 10 13:04:03.225983 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.225968 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s99l7"] Jun 10 13:04:03.226135 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.225985 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh"] Jun 10 13:04:03.226135 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.226004 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fxrlc"] Jun 10 13:04:03.226135 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.226079 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s99l7" Jun 10 13:04:03.228940 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.228918 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 13:04:03.229038 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.229019 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 13:04:03.229095 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.229023 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 13:04:03.229127 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.229088 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rnvq5\"" Jun 10 13:04:03.296894 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.296864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-trusted-ca\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.297055 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.296904 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:03.297055 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.296945 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.297055 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.296972 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3e6d0894-a562-400b-b5ea-b861f5cf3e02-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:03.297055 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.296997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-certificates\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.297055 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297019 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-installation-pull-secrets\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.297055 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297041 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61ab2ffa-d668-4258-9699-5835aac889fc-serving-cert\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.297356 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-image-registry-private-configuration\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.297356 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqpr5\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-kube-api-access-xqpr5\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.297356 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-bound-sa-token\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.297356 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297180 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xpm6\" (UniqueName: \"kubernetes.io/projected/62b98720-ab2f-47b0-8671-75a1d8dc5c9d-kube-api-access-6xpm6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gcmhh\" (UID: \"62b98720-ab2f-47b0-8671-75a1d8dc5c9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" Jun 10 13:04:03.297356 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62b98720-ab2f-47b0-8671-75a1d8dc5c9d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gcmhh\" (UID: \"62b98720-ab2f-47b0-8671-75a1d8dc5c9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" Jun 10 13:04:03.297356 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297300 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ab2ffa-d668-4258-9699-5835aac889fc-trusted-ca\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.297356 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297347 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-ca-trust-extracted\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.297760 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvhfp\" (UniqueName: \"kubernetes.io/projected/61ab2ffa-d668-4258-9699-5835aac889fc-kube-api-access-wvhfp\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.297760 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61ab2ffa-d668-4258-9699-5835aac889fc-config\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.297760 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.297559 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62b98720-ab2f-47b0-8671-75a1d8dc5c9d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gcmhh\" (UID: \"62b98720-ab2f-47b0-8671-75a1d8dc5c9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" Jun 10 13:04:03.351558 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.351528 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-srxz8_27812599-fe48-41e6-a6d9-8cd80efcd338/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:03.398483 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.398402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62b98720-ab2f-47b0-8671-75a1d8dc5c9d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gcmhh\" (UID: \"62b98720-ab2f-47b0-8671-75a1d8dc5c9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" Jun 10 13:04:03.398483 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.398452 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:03.398718 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.398485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.398718 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.398610 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:04:03.398718 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.398621 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 13:04:03.398718 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.398645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac9b6b12-417f-41e8-9cea-c44b3f36ba7f-config\") pod \"service-ca-operator-6bc5ff68f5-wc8bj\" (UID: \"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" Jun 10 13:04:03.398718 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.398675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3e6d0894-a562-400b-b5ea-b861f5cf3e02-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:03.398718 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.398692 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert podName:3e6d0894-a562-400b-b5ea-b861f5cf3e02 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:03.898669612 +0000 UTC m=+35.605286199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bpxmw" (UID: "3e6d0894-a562-400b-b5ea-b861f5cf3e02") : secret "networking-console-plugin-cert" not found Jun 10 13:04:03.398981 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.398729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61ab2ffa-d668-4258-9699-5835aac889fc-serving-cert\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.398981 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.398766 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47n2n\" (UniqueName: \"kubernetes.io/projected/db3e6c41-d0f1-448a-bada-2ef33206b505-kube-api-access-47n2n\") pod \"ingress-canary-s99l7\" (UID: \"db3e6c41-d0f1-448a-bada-2ef33206b505\") " pod="openshift-ingress-canary/ingress-canary-s99l7" Jun 10 13:04:03.398981 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.398814 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ab2ffa-d668-4258-9699-5835aac889fc-trusted-ca\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.398981 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.398842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xpm6\" (UniqueName: \"kubernetes.io/projected/62b98720-ab2f-47b0-8671-75a1d8dc5c9d-kube-api-access-6xpm6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gcmhh\" (UID: \"62b98720-ab2f-47b0-8671-75a1d8dc5c9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" Jun 10 13:04:03.398981 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.398624 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d47757f-5nts7: secret "image-registry-tls" not found Jun 10 13:04:03.398981 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.398899 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls podName:d56e7a63-ce5b-4a79-8bcb-77bddd55946f nodeName:}" failed. No retries permitted until 2026-06-10 13:04:03.898886277 +0000 UTC m=+35.605502850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls") pod "image-registry-79d47757f-5nts7" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f") : secret "image-registry-tls" not found Jun 10 13:04:03.399204 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399066 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62b98720-ab2f-47b0-8671-75a1d8dc5c9d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gcmhh\" (UID: \"62b98720-ab2f-47b0-8671-75a1d8dc5c9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" Jun 10 13:04:03.399204 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc60ce3-c430-4df1-802f-026c38c787cc-tmp-dir\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.399286 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62b98720-ab2f-47b0-8671-75a1d8dc5c9d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gcmhh\" (UID: \"62b98720-ab2f-47b0-8671-75a1d8dc5c9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" Jun 10 13:04:03.399286 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-ca-trust-extracted\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.399286 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvhfp\" (UniqueName: \"kubernetes.io/projected/61ab2ffa-d668-4258-9699-5835aac889fc-kube-api-access-wvhfp\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.399429 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399304 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5l56\" (UniqueName: \"kubernetes.io/projected/ac9b6b12-417f-41e8-9cea-c44b3f36ba7f-kube-api-access-l5l56\") pod \"service-ca-operator-6bc5ff68f5-wc8bj\" (UID: \"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" Jun 10 13:04:03.399429 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac9b6b12-417f-41e8-9cea-c44b3f36ba7f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-wc8bj\" (UID: \"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" Jun 10 13:04:03.399429 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399377 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-trusted-ca\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.399429 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399386 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3e6d0894-a562-400b-b5ea-b861f5cf3e02-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:03.399429 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc60ce3-c430-4df1-802f-026c38c787cc-config-volume\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.399727 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db3e6c41-d0f1-448a-bada-2ef33206b505-cert\") pod \"ingress-canary-s99l7\" (UID: \"db3e6c41-d0f1-448a-bada-2ef33206b505\") " pod="openshift-ingress-canary/ingress-canary-s99l7" Jun 10 13:04:03.399727 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399539 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.399727 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399656 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-ca-trust-extracted\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.399727 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-certificates\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.399727 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-installation-pull-secrets\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.399972 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399763 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61ab2ffa-d668-4258-9699-5835aac889fc-trusted-ca\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.400234 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.400210 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-certificates\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.400320 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.399784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-image-registry-private-configuration\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.400320 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.400311 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-trusted-ca\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.400424 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.400338 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqwnf\" (UniqueName: \"kubernetes.io/projected/f3383e4b-9d0a-4b0f-a611-d1bd304aa804-kube-api-access-xqwnf\") pod \"network-check-source-dbd9cf844-57qkc\" (UID: \"f3383e4b-9d0a-4b0f-a611-d1bd304aa804\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-57qkc" Jun 10 13:04:03.400424 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.400369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqpr5\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-kube-api-access-xqpr5\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.400424 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.400392 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56bd7\" (UniqueName: \"kubernetes.io/projected/6dc60ce3-c430-4df1-802f-026c38c787cc-kube-api-access-56bd7\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.400424 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.400417 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-bound-sa-token\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.400602 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.400440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61ab2ffa-d668-4258-9699-5835aac889fc-config\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.401124 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.401079 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61ab2ffa-d668-4258-9699-5835aac889fc-config\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.403828 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.403801 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61ab2ffa-d668-4258-9699-5835aac889fc-serving-cert\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.403946 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.403890 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-image-registry-private-configuration\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.403946 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.403890 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-installation-pull-secrets\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.404113 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.404096 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62b98720-ab2f-47b0-8671-75a1d8dc5c9d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gcmhh\" (UID: \"62b98720-ab2f-47b0-8671-75a1d8dc5c9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" Jun 10 13:04:03.410688 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.410470 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqpr5\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-kube-api-access-xqpr5\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.410688 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.410492 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvhfp\" (UniqueName: \"kubernetes.io/projected/61ab2ffa-d668-4258-9699-5835aac889fc-kube-api-access-wvhfp\") pod \"console-operator-668fdbf85c-mvpgc\" (UID: \"61ab2ffa-d668-4258-9699-5835aac889fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.410984 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.410959 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-bound-sa-token\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.411416 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.411377 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xpm6\" (UniqueName: \"kubernetes.io/projected/62b98720-ab2f-47b0-8671-75a1d8dc5c9d-kube-api-access-6xpm6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gcmhh\" (UID: \"62b98720-ab2f-47b0-8671-75a1d8dc5c9d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" Jun 10 13:04:03.472159 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.472120 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-srxz8_27812599-fe48-41e6-a6d9-8cd80efcd338/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:03.501238 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.501201 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac9b6b12-417f-41e8-9cea-c44b3f36ba7f-config\") pod \"service-ca-operator-6bc5ff68f5-wc8bj\" (UID: \"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" Jun 10 13:04:03.501238 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.501246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47n2n\" (UniqueName: \"kubernetes.io/projected/db3e6c41-d0f1-448a-bada-2ef33206b505-kube-api-access-47n2n\") pod \"ingress-canary-s99l7\" (UID: \"db3e6c41-d0f1-448a-bada-2ef33206b505\") " pod="openshift-ingress-canary/ingress-canary-s99l7" Jun 10 13:04:03.501490 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.501284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc60ce3-c430-4df1-802f-026c38c787cc-tmp-dir\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.501490 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.501325 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5l56\" (UniqueName: \"kubernetes.io/projected/ac9b6b12-417f-41e8-9cea-c44b3f36ba7f-kube-api-access-l5l56\") pod \"service-ca-operator-6bc5ff68f5-wc8bj\" (UID: \"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" Jun 10 13:04:03.501490 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.501352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac9b6b12-417f-41e8-9cea-c44b3f36ba7f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-wc8bj\" (UID: \"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" Jun 10 13:04:03.501490 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.501387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc60ce3-c430-4df1-802f-026c38c787cc-config-volume\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.501490 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.501416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db3e6c41-d0f1-448a-bada-2ef33206b505-cert\") pod \"ingress-canary-s99l7\" (UID: \"db3e6c41-d0f1-448a-bada-2ef33206b505\") " pod="openshift-ingress-canary/ingress-canary-s99l7" Jun 10 13:04:03.501490 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.501437 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.501490 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.501464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqwnf\" (UniqueName: \"kubernetes.io/projected/f3383e4b-9d0a-4b0f-a611-d1bd304aa804-kube-api-access-xqwnf\") pod \"network-check-source-dbd9cf844-57qkc\" (UID: \"f3383e4b-9d0a-4b0f-a611-d1bd304aa804\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-57qkc" Jun 10 13:04:03.501490 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.501490 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56bd7\" (UniqueName: \"kubernetes.io/projected/6dc60ce3-c430-4df1-802f-026c38c787cc-kube-api-access-56bd7\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.502037 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.501971 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac9b6b12-417f-41e8-9cea-c44b3f36ba7f-config\") pod \"service-ca-operator-6bc5ff68f5-wc8bj\" (UID: \"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" Jun 10 13:04:03.502168 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.502142 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:04:03.502814 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.502785 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc60ce3-c430-4df1-802f-026c38c787cc-tmp-dir\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.503950 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.502563 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6dc60ce3-c430-4df1-802f-026c38c787cc-config-volume\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.503950 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.503333 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls podName:6dc60ce3-c430-4df1-802f-026c38c787cc nodeName:}" failed. No retries permitted until 2026-06-10 13:04:04.003307489 +0000 UTC m=+35.709924075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls") pod "dns-default-fxrlc" (UID: "6dc60ce3-c430-4df1-802f-026c38c787cc") : secret "dns-default-metrics-tls" not found Jun 10 13:04:03.505455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.504622 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db3e6c41-d0f1-448a-bada-2ef33206b505-cert\") pod \"ingress-canary-s99l7\" (UID: \"db3e6c41-d0f1-448a-bada-2ef33206b505\") " pod="openshift-ingress-canary/ingress-canary-s99l7" Jun 10 13:04:03.505455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.505147 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac9b6b12-417f-41e8-9cea-c44b3f36ba7f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-wc8bj\" (UID: \"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" Jun 10 13:04:03.505455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.505296 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:03.514915 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.514889 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5l56\" (UniqueName: \"kubernetes.io/projected/ac9b6b12-417f-41e8-9cea-c44b3f36ba7f-kube-api-access-l5l56\") pod \"service-ca-operator-6bc5ff68f5-wc8bj\" (UID: \"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" Jun 10 13:04:03.515183 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.515160 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56bd7\" (UniqueName: \"kubernetes.io/projected/6dc60ce3-c430-4df1-802f-026c38c787cc-kube-api-access-56bd7\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:03.515275 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.515253 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47n2n\" (UniqueName: \"kubernetes.io/projected/db3e6c41-d0f1-448a-bada-2ef33206b505-kube-api-access-47n2n\") pod \"ingress-canary-s99l7\" (UID: \"db3e6c41-d0f1-448a-bada-2ef33206b505\") " pod="openshift-ingress-canary/ingress-canary-s99l7" Jun 10 13:04:03.515333 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.515254 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqwnf\" (UniqueName: \"kubernetes.io/projected/f3383e4b-9d0a-4b0f-a611-d1bd304aa804-kube-api-access-xqwnf\") pod \"network-check-source-dbd9cf844-57qkc\" (UID: \"f3383e4b-9d0a-4b0f-a611-d1bd304aa804\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-57qkc" Jun 10 13:04:03.515921 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.515901 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" Jun 10 13:04:03.533958 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.533932 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" Jun 10 13:04:03.540992 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.540795 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-57qkc" Jun 10 13:04:03.554081 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.554056 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s99l7" Jun 10 13:04:03.691349 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.691105 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mvpgc"] Jun 10 13:04:03.697069 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.697000 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh"] Jun 10 13:04:03.715579 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.715556 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj"] Jun 10 13:04:03.720222 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.720193 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-57qkc"] Jun 10 13:04:03.905791 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.905749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:03.906438 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:03.905802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:03.906438 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.905934 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 13:04:03.906438 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.905978 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:04:03.906438 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.906000 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d47757f-5nts7: secret "image-registry-tls" not found Jun 10 13:04:03.906438 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.906017 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert podName:3e6d0894-a562-400b-b5ea-b861f5cf3e02 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:04.905995524 +0000 UTC m=+36.612612099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bpxmw" (UID: "3e6d0894-a562-400b-b5ea-b861f5cf3e02") : secret "networking-console-plugin-cert" not found Jun 10 13:04:03.906438 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:03.906054 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls podName:d56e7a63-ce5b-4a79-8bcb-77bddd55946f nodeName:}" failed. No retries permitted until 2026-06-10 13:04:04.906036062 +0000 UTC m=+36.612652659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls") pod "image-registry-79d47757f-5nts7" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f") : secret "image-registry-tls" not found Jun 10 13:04:04.006567 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:04.006466 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:04.006719 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:04.006638 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:04:04.006719 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:04.006705 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls podName:6dc60ce3-c430-4df1-802f-026c38c787cc nodeName:}" failed. No retries permitted until 2026-06-10 13:04:05.006687972 +0000 UTC m=+36.713304545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls") pod "dns-default-fxrlc" (UID: "6dc60ce3-c430-4df1-802f-026c38c787cc") : secret "dns-default-metrics-tls" not found Jun 10 13:04:04.781858 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:04.781823 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:04:04.781858 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:04.781843 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:04:04.782080 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:04.781927 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:04:04.784902 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:04.784848 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 13:04:04.784902 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:04.784867 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qf5p9\"" Jun 10 13:04:04.786253 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:04.786232 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cg2hs\"" Jun 10 13:04:04.786374 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:04.786265 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 13:04:04.915106 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:04.915064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:04.915106 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:04.915110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:04.915628 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:04.915225 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 13:04:04.915628 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:04.915237 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:04:04.915628 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:04.915254 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d47757f-5nts7: secret "image-registry-tls" not found Jun 10 13:04:04.915628 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:04.915298 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert podName:3e6d0894-a562-400b-b5ea-b861f5cf3e02 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:06.915281938 +0000 UTC m=+38.621898510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bpxmw" (UID: "3e6d0894-a562-400b-b5ea-b861f5cf3e02") : secret "networking-console-plugin-cert" not found Jun 10 13:04:04.915628 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:04.915315 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls podName:d56e7a63-ce5b-4a79-8bcb-77bddd55946f nodeName:}" failed. No retries permitted until 2026-06-10 13:04:06.915308774 +0000 UTC m=+38.621925347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls") pod "image-registry-79d47757f-5nts7" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f") : secret "image-registry-tls" not found Jun 10 13:04:05.015928 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:05.015892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:05.016087 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:05.016058 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:04:05.016145 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:05.016120 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls podName:6dc60ce3-c430-4df1-802f-026c38c787cc nodeName:}" failed. No retries permitted until 2026-06-10 13:04:07.016103605 +0000 UTC m=+38.722720196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls") pod "dns-default-fxrlc" (UID: "6dc60ce3-c430-4df1-802f-026c38c787cc") : secret "dns-default-metrics-tls" not found Jun 10 13:04:05.104717 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:05.104637 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b98720_ab2f_47b0_8671_75a1d8dc5c9d.slice/crio-20383fa92e61c70fc765afdc58c790602479ae4ccdf4e924751d5be99a1e2fc8 WatchSource:0}: Error finding container 20383fa92e61c70fc765afdc58c790602479ae4ccdf4e924751d5be99a1e2fc8: Status 404 returned error can't find the container with id 20383fa92e61c70fc765afdc58c790602479ae4ccdf4e924751d5be99a1e2fc8 Jun 10 13:04:05.105747 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:05.105711 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ab2ffa_d668_4258_9699_5835aac889fc.slice/crio-553340248b497df12f5dc49d667527181c5c8ba31913a0873397bb253aed5a5e WatchSource:0}: Error finding container 553340248b497df12f5dc49d667527181c5c8ba31913a0873397bb253aed5a5e: Status 404 returned error can't find the container with id 553340248b497df12f5dc49d667527181c5c8ba31913a0873397bb253aed5a5e Jun 10 13:04:05.183468 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:05.183443 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" event={"ID":"62b98720-ab2f-47b0-8671-75a1d8dc5c9d","Type":"ContainerStarted","Data":"20383fa92e61c70fc765afdc58c790602479ae4ccdf4e924751d5be99a1e2fc8"} Jun 10 13:04:05.184761 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:05.184731 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" event={"ID":"61ab2ffa-d668-4258-9699-5835aac889fc","Type":"ContainerStarted","Data":"553340248b497df12f5dc49d667527181c5c8ba31913a0873397bb253aed5a5e"} Jun 10 13:04:05.186598 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:05.186480 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-57qkc" event={"ID":"f3383e4b-9d0a-4b0f-a611-d1bd304aa804","Type":"ContainerStarted","Data":"af266e162d96f5c45da883a49384fc3ed28c3b3a0637a1dfc53c86214e29e669"} Jun 10 13:04:05.191096 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:05.188862 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" event={"ID":"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f","Type":"ContainerStarted","Data":"47d4475b2105d4b5978f4f6506c0db3eb0c88c8aed5204900503906d6495f26d"} Jun 10 13:04:05.240219 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:05.240190 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s99l7"] Jun 10 13:04:05.243479 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:05.243446 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3e6c41_d0f1_448a_bada_2ef33206b505.slice/crio-aec33aafd0d7d62b1838e7172fdc3ae149ed9b9eb7cc099a1c604afe527235c7 WatchSource:0}: Error finding container aec33aafd0d7d62b1838e7172fdc3ae149ed9b9eb7cc099a1c604afe527235c7: Status 404 returned error can't find the container with id aec33aafd0d7d62b1838e7172fdc3ae149ed9b9eb7cc099a1c604afe527235c7 Jun 10 13:04:06.193763 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:06.193731 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s99l7" event={"ID":"db3e6c41-d0f1-448a-bada-2ef33206b505","Type":"ContainerStarted","Data":"aec33aafd0d7d62b1838e7172fdc3ae149ed9b9eb7cc099a1c604afe527235c7"} Jun 10 13:04:06.200916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:06.199990 2580 generic.go:356] "Generic (PLEG): container finished" podID="17725e76-3291-42e1-9ae8-e83422d325b4" containerID="b1eda8121e30d88867dc4a28dbb5957becf9e7102c5c69b07e8ab6c68db33e3d" exitCode=0 Jun 10 13:04:06.200916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:06.200029 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ggr9j" event={"ID":"17725e76-3291-42e1-9ae8-e83422d325b4","Type":"ContainerDied","Data":"b1eda8121e30d88867dc4a28dbb5957becf9e7102c5c69b07e8ab6c68db33e3d"} Jun 10 13:04:06.936855 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:06.936639 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:06.937031 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:06.936873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:06.937031 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:06.936826 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 13:04:06.937031 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:06.937006 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert podName:3e6d0894-a562-400b-b5ea-b861f5cf3e02 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:10.936981239 +0000 UTC m=+42.643597817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bpxmw" (UID: "3e6d0894-a562-400b-b5ea-b861f5cf3e02") : secret "networking-console-plugin-cert" not found Jun 10 13:04:06.937192 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:06.937051 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:04:06.937192 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:06.937067 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d47757f-5nts7: secret "image-registry-tls" not found Jun 10 13:04:06.937192 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:06.937116 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls podName:d56e7a63-ce5b-4a79-8bcb-77bddd55946f nodeName:}" failed. No retries permitted until 2026-06-10 13:04:10.937099833 +0000 UTC m=+42.643716419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls") pod "image-registry-79d47757f-5nts7" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f") : secret "image-registry-tls" not found Jun 10 13:04:07.037433 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:07.037396 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:07.037615 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:07.037575 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:04:07.037702 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:07.037649 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls podName:6dc60ce3-c430-4df1-802f-026c38c787cc nodeName:}" failed. No retries permitted until 2026-06-10 13:04:11.037629327 +0000 UTC m=+42.744245922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls") pod "dns-default-fxrlc" (UID: "6dc60ce3-c430-4df1-802f-026c38c787cc") : secret "dns-default-metrics-tls" not found Jun 10 13:04:07.208559 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:07.208420 2580 generic.go:356] "Generic (PLEG): container finished" podID="17725e76-3291-42e1-9ae8-e83422d325b4" containerID="bb23e0a0e3d61871dc43ece2667366409087bd1695c30292b5b5b5793ffda113" exitCode=0 Jun 10 13:04:07.208559 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:07.208492 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ggr9j" event={"ID":"17725e76-3291-42e1-9ae8-e83422d325b4","Type":"ContainerDied","Data":"bb23e0a0e3d61871dc43ece2667366409087bd1695c30292b5b5b5793ffda113"} Jun 10 13:04:07.934046 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:07.933945 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-srxz8_27812599-fe48-41e6-a6d9-8cd80efcd338/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:08.034728 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:08.034693 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-srxz8_27812599-fe48-41e6-a6d9-8cd80efcd338/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:09.903427 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:09.903390 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-srxz8_27812599-fe48-41e6-a6d9-8cd80efcd338/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:10.006295 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:10.006257 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-srxz8_27812599-fe48-41e6-a6d9-8cd80efcd338/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:10.968480 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:10.968444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:10.968480 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:10.968484 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:10.968918 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:10.968598 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 13:04:10.968918 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:10.968601 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:04:10.968918 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:10.968666 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert podName:3e6d0894-a562-400b-b5ea-b861f5cf3e02 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:18.968651285 +0000 UTC m=+50.675267858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bpxmw" (UID: "3e6d0894-a562-400b-b5ea-b861f5cf3e02") : secret "networking-console-plugin-cert" not found Jun 10 13:04:10.968918 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:10.968670 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d47757f-5nts7: secret "image-registry-tls" not found Jun 10 13:04:10.968918 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:10.968710 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls podName:d56e7a63-ce5b-4a79-8bcb-77bddd55946f nodeName:}" failed. No retries permitted until 2026-06-10 13:04:18.968699255 +0000 UTC m=+50.675315826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls") pod "image-registry-79d47757f-5nts7" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f") : secret "image-registry-tls" not found Jun 10 13:04:11.069555 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:11.069529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:11.069655 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:11.069641 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:04:11.069700 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:11.069690 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls podName:6dc60ce3-c430-4df1-802f-026c38c787cc nodeName:}" failed. No retries permitted until 2026-06-10 13:04:19.069676503 +0000 UTC m=+50.776293075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls") pod "dns-default-fxrlc" (UID: "6dc60ce3-c430-4df1-802f-026c38c787cc") : secret "dns-default-metrics-tls" not found Jun 10 13:04:12.226470 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.226429 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ggr9j" event={"ID":"17725e76-3291-42e1-9ae8-e83422d325b4","Type":"ContainerStarted","Data":"c295cc996c06d3e8a2663c29f5394116465f8b442f5f98c67df7ab7b027b2134"} Jun 10 13:04:12.228172 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.228150 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/0.log" Jun 10 13:04:12.228284 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.228186 2580 generic.go:356] "Generic (PLEG): container finished" podID="61ab2ffa-d668-4258-9699-5835aac889fc" containerID="4d8b25db6032d511272cbcd40ba143fb57fe750cebc2dcaa37d724d5f5285f43" exitCode=255 Jun 10 13:04:12.228284 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.228219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" event={"ID":"61ab2ffa-d668-4258-9699-5835aac889fc","Type":"ContainerDied","Data":"4d8b25db6032d511272cbcd40ba143fb57fe750cebc2dcaa37d724d5f5285f43"} Jun 10 13:04:12.228472 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.228455 2580 scope.go:117] "RemoveContainer" containerID="4d8b25db6032d511272cbcd40ba143fb57fe750cebc2dcaa37d724d5f5285f43" Jun 10 13:04:12.229856 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.229820 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-57qkc" event={"ID":"f3383e4b-9d0a-4b0f-a611-d1bd304aa804","Type":"ContainerStarted","Data":"32891581980c7a4088f583710e7886a5d94e8346fb82f4e6e8247e4dc0ee8c5b"} Jun 10 13:04:12.231567 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.231540 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s99l7" event={"ID":"db3e6c41-d0f1-448a-bada-2ef33206b505","Type":"ContainerStarted","Data":"e75cb104964df5ed48da17dc5981a4f8d497a17d04648245b08aa2f30b1e3d10"} Jun 10 13:04:12.233027 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.232995 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" event={"ID":"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f","Type":"ContainerStarted","Data":"c40b4923f27c11cdebad46680ed57a134c2e27960cc0eff56ddf0aa191254ab8"} Jun 10 13:04:12.234438 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.234416 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" event={"ID":"62b98720-ab2f-47b0-8671-75a1d8dc5c9d","Type":"ContainerStarted","Data":"8ba926d54d8e33232005697f7c650b7dfe7258f089806bc2fa14d087d29d17ee"} Jun 10 13:04:12.275002 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.274953 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ggr9j" podStartSLOduration=12.871239443 podStartE2EDuration="43.274938054s" totalImagesPullingTime="30.403698611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:12.271860608 +0000 UTC m=+43.978477203" watchObservedRunningTime="2026-06-10 13:04:12.274938054 +0000 UTC m=+43.981554647" Jun 10 13:04:12.324258 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.324215 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" podStartSLOduration=33.130154797 podStartE2EDuration="39.324200651s" totalImagesPullingTime="6.194045854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:12.323980194 +0000 UTC m=+44.030596788" watchObservedRunningTime="2026-06-10 13:04:12.324200651 +0000 UTC m=+44.030817262" Jun 10 13:04:12.347914 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.347870 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" podStartSLOduration=31.153590673 podStartE2EDuration="37.347854525s" totalImagesPullingTime="6.194263852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:12.346986972 +0000 UTC m=+44.053603578" watchObservedRunningTime="2026-06-10 13:04:12.347854525 +0000 UTC m=+44.054471141" Jun 10 13:04:12.354861 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.351833 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d"] Jun 10 13:04:12.367571 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.366777 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-57qkc" podStartSLOduration=31.161787845 podStartE2EDuration="37.366757215s" totalImagesPullingTime="6.20496937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:12.365335051 +0000 UTC m=+44.071951645" watchObservedRunningTime="2026-06-10 13:04:12.366757215 +0000 UTC m=+44.073373811" Jun 10 13:04:12.370535 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.369344 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d"] Jun 10 13:04:12.370535 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.369472 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d" Jun 10 13:04:12.373170 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.372987 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 13:04:12.373498 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.373321 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hr742\"" Jun 10 13:04:12.373498 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.373429 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 13:04:12.381577 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.381550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2c2h\" (UniqueName: \"kubernetes.io/projected/b7aa19d2-82f1-493c-94e9-41373e555cec-kube-api-access-j2c2h\") pod \"migrator-955ffdf5f-k2g2d\" (UID: \"b7aa19d2-82f1-493c-94e9-41373e555cec\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d" Jun 10 13:04:12.387958 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.387917 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s99l7" podStartSLOduration=3.328335037 podStartE2EDuration="9.387899608s" totalImagesPullingTime="6.059564571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:12.387592318 +0000 UTC m=+44.094208912" watchObservedRunningTime="2026-06-10 13:04:12.387899608 +0000 UTC m=+44.094516203" Jun 10 13:04:12.482910 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.482838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2c2h\" (UniqueName: \"kubernetes.io/projected/b7aa19d2-82f1-493c-94e9-41373e555cec-kube-api-access-j2c2h\") pod \"migrator-955ffdf5f-k2g2d\" (UID: \"b7aa19d2-82f1-493c-94e9-41373e555cec\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d" Jun 10 13:04:12.495561 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.495537 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2c2h\" (UniqueName: \"kubernetes.io/projected/b7aa19d2-82f1-493c-94e9-41373e555cec-kube-api-access-j2c2h\") pod \"migrator-955ffdf5f-k2g2d\" (UID: \"b7aa19d2-82f1-493c-94e9-41373e555cec\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d" Jun 10 13:04:12.681998 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.681965 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d" Jun 10 13:04:12.830765 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:12.830732 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d"] Jun 10 13:04:12.834169 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:12.834139 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7aa19d2_82f1_493c_94e9_41373e555cec.slice/crio-26b858a426b3d8fadb5f1bae7e2cb0583382b0df4b30edcd8a72cd81ef558b2c WatchSource:0}: Error finding container 26b858a426b3d8fadb5f1bae7e2cb0583382b0df4b30edcd8a72cd81ef558b2c: Status 404 returned error can't find the container with id 26b858a426b3d8fadb5f1bae7e2cb0583382b0df4b30edcd8a72cd81ef558b2c Jun 10 13:04:13.239376 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:13.239348 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/1.log" Jun 10 13:04:13.239768 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:13.239747 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/0.log" Jun 10 13:04:13.239813 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:13.239779 2580 generic.go:356] "Generic (PLEG): container finished" podID="61ab2ffa-d668-4258-9699-5835aac889fc" containerID="7ddf4eb56591b00865e9a319fef9416c93d4e9afcccbb636dec406123da009f3" exitCode=255 Jun 10 13:04:13.239857 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:13.239846 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" event={"ID":"61ab2ffa-d668-4258-9699-5835aac889fc","Type":"ContainerDied","Data":"7ddf4eb56591b00865e9a319fef9416c93d4e9afcccbb636dec406123da009f3"} Jun 10 13:04:13.239907 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:13.239890 2580 scope.go:117] "RemoveContainer" containerID="4d8b25db6032d511272cbcd40ba143fb57fe750cebc2dcaa37d724d5f5285f43" Jun 10 13:04:13.240081 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:13.240056 2580 scope.go:117] "RemoveContainer" containerID="7ddf4eb56591b00865e9a319fef9416c93d4e9afcccbb636dec406123da009f3" Jun 10 13:04:13.240274 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:13.240249 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mvpgc_openshift-console-operator(61ab2ffa-d668-4258-9699-5835aac889fc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" podUID="61ab2ffa-d668-4258-9699-5835aac889fc" Jun 10 13:04:13.241175 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:13.241072 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d" event={"ID":"b7aa19d2-82f1-493c-94e9-41373e555cec","Type":"ContainerStarted","Data":"26b858a426b3d8fadb5f1bae7e2cb0583382b0df4b30edcd8a72cd81ef558b2c"} Jun 10 13:04:13.506250 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:13.506166 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:13.506394 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:13.506298 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:14.246301 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:14.246268 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/1.log" Jun 10 13:04:14.246695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:14.246613 2580 scope.go:117] "RemoveContainer" containerID="7ddf4eb56591b00865e9a319fef9416c93d4e9afcccbb636dec406123da009f3" Jun 10 13:04:14.246808 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:14.246787 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mvpgc_openshift-console-operator(61ab2ffa-d668-4258-9699-5835aac889fc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" podUID="61ab2ffa-d668-4258-9699-5835aac889fc" Jun 10 13:04:15.250454 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.250417 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d" event={"ID":"b7aa19d2-82f1-493c-94e9-41373e555cec","Type":"ContainerStarted","Data":"d3aff8bf167ff309f4d62723c838cf4b27e13d5eeba2891dfbac6d33b21aed51"} Jun 10 13:04:15.250831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.250475 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d" event={"ID":"b7aa19d2-82f1-493c-94e9-41373e555cec","Type":"ContainerStarted","Data":"5d4425843c591e3bdb17b1701bbac95225adbd607874bf90be83427e50b6ca87"} Jun 10 13:04:15.250831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.250719 2580 scope.go:117] "RemoveContainer" containerID="7ddf4eb56591b00865e9a319fef9416c93d4e9afcccbb636dec406123da009f3" Jun 10 13:04:15.250924 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:15.250853 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mvpgc_openshift-console-operator(61ab2ffa-d668-4258-9699-5835aac889fc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" podUID="61ab2ffa-d668-4258-9699-5835aac889fc" Jun 10 13:04:15.269752 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.269708 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-k2g2d" podStartSLOduration=1.508026221 podStartE2EDuration="3.269694286s" totalImagesPullingTime="1.761668065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:15.267736695 +0000 UTC m=+46.974353290" watchObservedRunningTime="2026-06-10 13:04:15.269694286 +0000 UTC m=+46.976311217" Jun 10 13:04:15.331100 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.331066 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-gm6w5"] Jun 10 13:04:15.340824 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.340803 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" Jun 10 13:04:15.341664 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.341637 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-gm6w5"] Jun 10 13:04:15.344065 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.344029 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 10 13:04:15.344217 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.344199 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 10 13:04:15.344334 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.344316 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4t5cn\"" Jun 10 13:04:15.344441 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.344419 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 10 13:04:15.344441 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.344248 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 10 13:04:15.410009 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.409980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6dcbaa88-5af3-4900-bd07-89325ba52677-signing-cabundle\") pod \"service-ca-7d74d578b8-gm6w5\" (UID: \"6dcbaa88-5af3-4900-bd07-89325ba52677\") " pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" Jun 10 13:04:15.410115 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.410067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjdpr\" (UniqueName: \"kubernetes.io/projected/6dcbaa88-5af3-4900-bd07-89325ba52677-kube-api-access-hjdpr\") pod \"service-ca-7d74d578b8-gm6w5\" (UID: \"6dcbaa88-5af3-4900-bd07-89325ba52677\") " pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" Jun 10 13:04:15.410115 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.410105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6dcbaa88-5af3-4900-bd07-89325ba52677-signing-key\") pod \"service-ca-7d74d578b8-gm6w5\" (UID: \"6dcbaa88-5af3-4900-bd07-89325ba52677\") " pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" Jun 10 13:04:15.510775 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.510719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6dcbaa88-5af3-4900-bd07-89325ba52677-signing-cabundle\") pod \"service-ca-7d74d578b8-gm6w5\" (UID: \"6dcbaa88-5af3-4900-bd07-89325ba52677\") " pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" Jun 10 13:04:15.510775 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.510773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjdpr\" (UniqueName: \"kubernetes.io/projected/6dcbaa88-5af3-4900-bd07-89325ba52677-kube-api-access-hjdpr\") pod \"service-ca-7d74d578b8-gm6w5\" (UID: \"6dcbaa88-5af3-4900-bd07-89325ba52677\") " pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" Jun 10 13:04:15.510967 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.510798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6dcbaa88-5af3-4900-bd07-89325ba52677-signing-key\") pod \"service-ca-7d74d578b8-gm6w5\" (UID: \"6dcbaa88-5af3-4900-bd07-89325ba52677\") " pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" Jun 10 13:04:15.511365 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.511344 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6dcbaa88-5af3-4900-bd07-89325ba52677-signing-cabundle\") pod \"service-ca-7d74d578b8-gm6w5\" (UID: \"6dcbaa88-5af3-4900-bd07-89325ba52677\") " pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" Jun 10 13:04:15.513074 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.513046 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6dcbaa88-5af3-4900-bd07-89325ba52677-signing-key\") pod \"service-ca-7d74d578b8-gm6w5\" (UID: \"6dcbaa88-5af3-4900-bd07-89325ba52677\") " pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" Jun 10 13:04:15.521696 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.521677 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjdpr\" (UniqueName: \"kubernetes.io/projected/6dcbaa88-5af3-4900-bd07-89325ba52677-kube-api-access-hjdpr\") pod \"service-ca-7d74d578b8-gm6w5\" (UID: \"6dcbaa88-5af3-4900-bd07-89325ba52677\") " pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" Jun 10 13:04:15.650539 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.650497 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" Jun 10 13:04:15.777112 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:15.776939 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-gm6w5"] Jun 10 13:04:15.779457 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:15.779434 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dcbaa88_5af3_4900_bd07_89325ba52677.slice/crio-77fc0826400f5411cb1c5bf334bb86603cc4a2c9dd62ed944c8f18b338e1e55e WatchSource:0}: Error finding container 77fc0826400f5411cb1c5bf334bb86603cc4a2c9dd62ed944c8f18b338e1e55e: Status 404 returned error can't find the container with id 77fc0826400f5411cb1c5bf334bb86603cc4a2c9dd62ed944c8f18b338e1e55e Jun 10 13:04:16.255481 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:16.255446 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" event={"ID":"6dcbaa88-5af3-4900-bd07-89325ba52677","Type":"ContainerStarted","Data":"ad4f315f4a71eefafe1bb6f6f8f62c4a88200d1180de95a978c5b80701cb2ed9"} Jun 10 13:04:16.255898 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:16.255532 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" event={"ID":"6dcbaa88-5af3-4900-bd07-89325ba52677","Type":"ContainerStarted","Data":"77fc0826400f5411cb1c5bf334bb86603cc4a2c9dd62ed944c8f18b338e1e55e"} Jun 10 13:04:16.277113 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:16.277065 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-gm6w5" podStartSLOduration=1.277050041 podStartE2EDuration="1.277050041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:16.275664888 +0000 UTC m=+47.982281481" watchObservedRunningTime="2026-06-10 13:04:16.277050041 +0000 UTC m=+47.983666635" Jun 10 13:04:19.037949 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:19.037911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:19.037949 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:19.037949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:19.038396 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:19.038058 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:04:19.038396 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:19.038069 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d47757f-5nts7: secret "image-registry-tls" not found Jun 10 13:04:19.038396 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:19.038074 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 13:04:19.038396 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:19.038113 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls podName:d56e7a63-ce5b-4a79-8bcb-77bddd55946f nodeName:}" failed. No retries permitted until 2026-06-10 13:04:35.038098681 +0000 UTC m=+66.744715266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls") pod "image-registry-79d47757f-5nts7" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f") : secret "image-registry-tls" not found Jun 10 13:04:19.038396 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:19.038141 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert podName:3e6d0894-a562-400b-b5ea-b861f5cf3e02 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:35.038124011 +0000 UTC m=+66.744740583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bpxmw" (UID: "3e6d0894-a562-400b-b5ea-b861f5cf3e02") : secret "networking-console-plugin-cert" not found Jun 10 13:04:19.139372 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:19.139345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:19.139542 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:19.139434 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:04:19.139542 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:19.139479 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls podName:6dc60ce3-c430-4df1-802f-026c38c787cc nodeName:}" failed. No retries permitted until 2026-06-10 13:04:35.139466586 +0000 UTC m=+66.846083162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls") pod "dns-default-fxrlc" (UID: "6dc60ce3-c430-4df1-802f-026c38c787cc") : secret "dns-default-metrics-tls" not found Jun 10 13:04:28.783053 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:28.783024 2580 scope.go:117] "RemoveContainer" containerID="7ddf4eb56591b00865e9a319fef9416c93d4e9afcccbb636dec406123da009f3" Jun 10 13:04:29.297443 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:29.297419 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:04:29.297806 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:29.297792 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/1.log" Jun 10 13:04:29.297857 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:29.297823 2580 generic.go:356] "Generic (PLEG): container finished" podID="61ab2ffa-d668-4258-9699-5835aac889fc" containerID="4ce9e07feebe050b93eea26e6b9928d15d2f92e890ecf9632166b317a40a4f82" exitCode=255 Jun 10 13:04:29.297892 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:29.297869 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" event={"ID":"61ab2ffa-d668-4258-9699-5835aac889fc","Type":"ContainerDied","Data":"4ce9e07feebe050b93eea26e6b9928d15d2f92e890ecf9632166b317a40a4f82"} Jun 10 13:04:29.297925 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:29.297915 2580 scope.go:117] "RemoveContainer" containerID="7ddf4eb56591b00865e9a319fef9416c93d4e9afcccbb636dec406123da009f3" Jun 10 13:04:29.298242 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:29.298218 2580 scope.go:117] "RemoveContainer" containerID="4ce9e07feebe050b93eea26e6b9928d15d2f92e890ecf9632166b317a40a4f82" Jun 10 13:04:29.298409 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:29.298383 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mvpgc_openshift-console-operator(61ab2ffa-d668-4258-9699-5835aac889fc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" podUID="61ab2ffa-d668-4258-9699-5835aac889fc" Jun 10 13:04:30.178147 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:30.178122 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sp54d" Jun 10 13:04:30.305182 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:30.305160 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:04:33.506485 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.506456 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:33.506883 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.506525 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:04:33.506883 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.506814 2580 scope.go:117] "RemoveContainer" containerID="4ce9e07feebe050b93eea26e6b9928d15d2f92e890ecf9632166b317a40a4f82" Jun 10 13:04:33.506990 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:33.506963 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mvpgc_openshift-console-operator(61ab2ffa-d668-4258-9699-5835aac889fc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" podUID="61ab2ffa-d668-4258-9699-5835aac889fc" Jun 10 13:04:33.650492 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.650449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:04:33.650800 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.650775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:04:33.653579 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.653561 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 13:04:33.653654 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.653608 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 13:04:33.663294 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.663258 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2da8555-0d96-4880-8092-a54510d11495-original-pull-secret\") pod \"global-pull-secret-syncer-97st9\" (UID: \"c2da8555-0d96-4880-8092-a54510d11495\") " pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:04:33.663382 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.663314 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc9a8d8-2cfa-4231-8377-9114e16df4e7-metrics-certs\") pod \"network-metrics-daemon-jxf2x\" (UID: \"ffc9a8d8-2cfa-4231-8377-9114e16df4e7\") " pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:04:33.751658 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.751634 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69thz\" (UniqueName: \"kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz\") pod \"network-check-target-jr8mb\" (UID: \"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd\") " pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:04:33.753795 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.753771 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69thz\" (UniqueName: \"kubernetes.io/projected/0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd-kube-api-access-69thz\") pod \"network-check-target-jr8mb\" (UID: \"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd\") " pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:04:33.897529 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.897452 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qf5p9\"" Jun 10 13:04:33.904365 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.904343 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:04:33.904593 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.904578 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cg2hs\"" Jun 10 13:04:33.906965 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.906950 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97st9" Jun 10 13:04:33.912077 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:33.912055 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jxf2x" Jun 10 13:04:34.042720 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:34.042686 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-97st9"] Jun 10 13:04:34.045151 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:34.045120 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2da8555_0d96_4880_8092_a54510d11495.slice/crio-90b0037f76a1b5e6785c3f647384a838cb06de49cbc4c632e7ae89f0505b9349 WatchSource:0}: Error finding container 90b0037f76a1b5e6785c3f647384a838cb06de49cbc4c632e7ae89f0505b9349: Status 404 returned error can't find the container with id 90b0037f76a1b5e6785c3f647384a838cb06de49cbc4c632e7ae89f0505b9349 Jun 10 13:04:34.062261 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:34.062232 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jr8mb"] Jun 10 13:04:34.064259 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:34.064237 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e78d8a4_36f2_43fa_a8e2_bcbb4e3c3afd.slice/crio-0abf2419310a081c85e24f056b08f10563cd6088704e7d6ebd0ba07804afe10a WatchSource:0}: Error finding container 0abf2419310a081c85e24f056b08f10563cd6088704e7d6ebd0ba07804afe10a: Status 404 returned error can't find the container with id 0abf2419310a081c85e24f056b08f10563cd6088704e7d6ebd0ba07804afe10a Jun 10 13:04:34.077317 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:34.077297 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jxf2x"] Jun 10 13:04:34.079955 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:34.079932 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc9a8d8_2cfa_4231_8377_9114e16df4e7.slice/crio-701056fd192c24f1fb14a597cac01946c5601942180a498f75a9c56dcacaf608 WatchSource:0}: Error finding container 701056fd192c24f1fb14a597cac01946c5601942180a498f75a9c56dcacaf608: Status 404 returned error can't find the container with id 701056fd192c24f1fb14a597cac01946c5601942180a498f75a9c56dcacaf608 Jun 10 13:04:34.318671 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:34.318631 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jxf2x" event={"ID":"ffc9a8d8-2cfa-4231-8377-9114e16df4e7","Type":"ContainerStarted","Data":"701056fd192c24f1fb14a597cac01946c5601942180a498f75a9c56dcacaf608"} Jun 10 13:04:34.319649 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:34.319624 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-97st9" event={"ID":"c2da8555-0d96-4880-8092-a54510d11495","Type":"ContainerStarted","Data":"90b0037f76a1b5e6785c3f647384a838cb06de49cbc4c632e7ae89f0505b9349"} Jun 10 13:04:34.320872 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:34.320853 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jr8mb" event={"ID":"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd","Type":"ContainerStarted","Data":"94e8e149a21589347bf0c96f8237add06668755684e9031b805ad92887f8f11b"} Jun 10 13:04:34.320943 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:34.320883 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jr8mb" event={"ID":"0e78d8a4-36f2-43fa-a8e2-bcbb4e3c3afd","Type":"ContainerStarted","Data":"0abf2419310a081c85e24f056b08f10563cd6088704e7d6ebd0ba07804afe10a"} Jun 10 13:04:34.321006 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:34.320982 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:04:34.343641 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:34.343597 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jr8mb" podStartSLOduration=66.343585122 podStartE2EDuration="1m6.343585122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:34.342362697 +0000 UTC m=+66.048979293" watchObservedRunningTime="2026-06-10 13:04:34.343585122 +0000 UTC m=+66.050201716" Jun 10 13:04:35.063294 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.063264 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:35.063676 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.063299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:35.066226 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.066202 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls\") pod \"image-registry-79d47757f-5nts7\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:35.066702 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.066673 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e6d0894-a562-400b-b5ea-b861f5cf3e02-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bpxmw\" (UID: \"3e6d0894-a562-400b-b5ea-b861f5cf3e02\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:35.164174 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.164151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:35.166400 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.166376 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dc60ce3-c430-4df1-802f-026c38c787cc-metrics-tls\") pod \"dns-default-fxrlc\" (UID: \"6dc60ce3-c430-4df1-802f-026c38c787cc\") " pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:35.297642 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.297573 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b6twm\"" Jun 10 13:04:35.304957 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.304933 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:35.325989 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.325956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jxf2x" event={"ID":"ffc9a8d8-2cfa-4231-8377-9114e16df4e7","Type":"ContainerStarted","Data":"e06bb6b36f53aa9af4cf3d9e2949ce4be6e3835a46b665368c8a9a195deca29a"} Jun 10 13:04:35.326097 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.326032 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jxf2x" event={"ID":"ffc9a8d8-2cfa-4231-8377-9114e16df4e7","Type":"ContainerStarted","Data":"474a89e2c34e626229c7d1e7531f779e0a7a778f43d20b47dc9b83b15f37a05b"} Jun 10 13:04:35.328153 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.328138 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bp9hq\"" Jun 10 13:04:35.336124 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.336102 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" Jun 10 13:04:35.344288 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.344245 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jxf2x" podStartSLOduration=65.438331578 podStartE2EDuration="1m6.344226916s" totalImagesPullingTime="905.895338ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:35.343736844 +0000 UTC m=+67.050353438" watchObservedRunningTime="2026-06-10 13:04:35.344226916 +0000 UTC m=+67.050843514" Jun 10 13:04:35.350693 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.350672 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-np4vc\"" Jun 10 13:04:35.358539 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.358351 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:35.459400 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.459374 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79d47757f-5nts7"] Jun 10 13:04:35.490583 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.490434 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw"] Jun 10 13:04:35.501812 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:35.501786 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6d0894_a562_400b_b5ea_b861f5cf3e02.slice/crio-cd77963557e7b7aa0de5c069875c4e84fdc36875a2e5b960bdead4735be0d840 WatchSource:0}: Error finding container cd77963557e7b7aa0de5c069875c4e84fdc36875a2e5b960bdead4735be0d840: Status 404 returned error can't find the container with id cd77963557e7b7aa0de5c069875c4e84fdc36875a2e5b960bdead4735be0d840 Jun 10 13:04:35.515725 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:35.515699 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fxrlc"] Jun 10 13:04:35.521157 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:35.521132 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc60ce3_c430_4df1_802f_026c38c787cc.slice/crio-e1ed7a32201722b330bc1333c5df9218eb6dd614c61423a7ba0729c32af6d0d5 WatchSource:0}: Error finding container e1ed7a32201722b330bc1333c5df9218eb6dd614c61423a7ba0729c32af6d0d5: Status 404 returned error can't find the container with id e1ed7a32201722b330bc1333c5df9218eb6dd614c61423a7ba0729c32af6d0d5 Jun 10 13:04:36.333679 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:36.333053 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d47757f-5nts7" event={"ID":"d56e7a63-ce5b-4a79-8bcb-77bddd55946f","Type":"ContainerStarted","Data":"8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6"} Jun 10 13:04:36.333679 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:36.333116 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d47757f-5nts7" event={"ID":"d56e7a63-ce5b-4a79-8bcb-77bddd55946f","Type":"ContainerStarted","Data":"1b9647b10e0f3ec27a25419f1381ab702f7a843da76d3d27272c7b77784a64c6"} Jun 10 13:04:36.333679 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:36.333295 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:36.335108 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:36.335079 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fxrlc" event={"ID":"6dc60ce3-c430-4df1-802f-026c38c787cc","Type":"ContainerStarted","Data":"e1ed7a32201722b330bc1333c5df9218eb6dd614c61423a7ba0729c32af6d0d5"} Jun 10 13:04:36.336698 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:36.336672 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" event={"ID":"3e6d0894-a562-400b-b5ea-b861f5cf3e02","Type":"ContainerStarted","Data":"cd77963557e7b7aa0de5c069875c4e84fdc36875a2e5b960bdead4735be0d840"} Jun 10 13:04:38.345686 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.345641 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" event={"ID":"3e6d0894-a562-400b-b5ea-b861f5cf3e02","Type":"ContainerStarted","Data":"9c01d79b27f91f713e86c0ee8c32af5261271c755c343549e299ef5dd38415cb"} Jun 10 13:04:38.347447 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.347422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fxrlc" event={"ID":"6dc60ce3-c430-4df1-802f-026c38c787cc","Type":"ContainerStarted","Data":"fa1ec7b2e53f075a39bce890c027544b2bfc303178212257ba228fca8cf79c6d"} Jun 10 13:04:38.365087 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.365040 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bpxmw" podStartSLOduration=35.949852109 podStartE2EDuration="38.365026895s" totalImagesPullingTime="2.415174786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:38.364407098 +0000 UTC m=+70.071023693" watchObservedRunningTime="2026-06-10 13:04:38.365026895 +0000 UTC m=+70.071643488" Jun 10 13:04:38.365589 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.365550 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79d47757f-5nts7" podStartSLOduration=69.365539446 podStartE2EDuration="1m9.365539446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:36.359085746 +0000 UTC m=+68.065702341" watchObservedRunningTime="2026-06-10 13:04:38.365539446 +0000 UTC m=+70.072156040" Jun 10 13:04:38.596695 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.595559 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh"] Jun 10 13:04:38.611299 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.611272 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8"] Jun 10 13:04:38.611473 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.611400 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:38.615547 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.615432 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 13:04:38.615696 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.615440 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 13:04:38.616981 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.616791 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 10 13:04:38.616981 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.616851 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 13:04:38.626980 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.625645 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m"] Jun 10 13:04:38.626980 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.626185 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8" Jun 10 13:04:38.629391 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.629372 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 10 13:04:38.629689 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.629670 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rfh96\"" Jun 10 13:04:38.647444 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.647421 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh"] Jun 10 13:04:38.647677 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.647472 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8"] Jun 10 13:04:38.647677 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.647490 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m"] Jun 10 13:04:38.647677 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.647628 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.650987 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.650958 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 10 13:04:38.651106 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.651036 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 10 13:04:38.651517 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.651295 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 10 13:04:38.651517 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.651335 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 10 13:04:38.695922 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.695895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df4d1f56-d7f9-47ac-b760-9c608a056c18-tmp\") pod \"klusterlet-addon-workmgr-69bfd7fc4-4r9bh\" (UID: \"df4d1f56-d7f9-47ac-b760-9c608a056c18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:38.696106 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.695931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxtrt\" (UniqueName: \"kubernetes.io/projected/df4d1f56-d7f9-47ac-b760-9c608a056c18-kube-api-access-hxtrt\") pod \"klusterlet-addon-workmgr-69bfd7fc4-4r9bh\" (UID: \"df4d1f56-d7f9-47ac-b760-9c608a056c18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:38.696106 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.695981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a21d6c1b-d570-4abf-90de-37cde455287e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8\" (UID: \"a21d6c1b-d570-4abf-90de-37cde455287e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8" Jun 10 13:04:38.696230 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.696080 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2dgj\" (UniqueName: \"kubernetes.io/projected/a21d6c1b-d570-4abf-90de-37cde455287e-kube-api-access-m2dgj\") pod \"managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8\" (UID: \"a21d6c1b-d570-4abf-90de-37cde455287e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8" Jun 10 13:04:38.696230 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.696199 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/df4d1f56-d7f9-47ac-b760-9c608a056c18-klusterlet-config\") pod \"klusterlet-addon-workmgr-69bfd7fc4-4r9bh\" (UID: \"df4d1f56-d7f9-47ac-b760-9c608a056c18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:38.718727 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.718690 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t"] Jun 10 13:04:38.736220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.736190 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55f6d9476c-gjp6b"] Jun 10 13:04:38.736371 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.736349 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" Jun 10 13:04:38.742157 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.741980 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 13:04:38.742157 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.742061 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v4jj4\"" Jun 10 13:04:38.742932 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.742909 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 13:04:38.750774 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.750747 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 13:04:38.750878 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.750757 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 13:04:38.753147 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.753127 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-8kj9w"] Jun 10 13:04:38.753240 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.753222 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:38.759574 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.759541 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 13:04:38.759766 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.759739 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 13:04:38.759847 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.759795 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-585ln\"" Jun 10 13:04:38.759847 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.759817 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 13:04:38.760581 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.760561 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 13:04:38.764858 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.764696 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 13:04:38.766028 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.765972 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 13:04:38.772491 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.771079 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn"] Jun 10 13:04:38.772491 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.771333 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:38.784569 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.784550 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-w6sxr\"" Jun 10 13:04:38.784691 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.784674 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 13:04:38.785891 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.785876 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 13:04:38.786062 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.786049 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 13:04:38.786170 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.786156 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 13:04:38.796419 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796382 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wlh9s"] Jun 10 13:04:38.796542 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796474 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" Jun 10 13:04:38.796611 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df4d1f56-d7f9-47ac-b760-9c608a056c18-tmp\") pod \"klusterlet-addon-workmgr-69bfd7fc4-4r9bh\" (UID: \"df4d1f56-d7f9-47ac-b760-9c608a056c18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:38.796611 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtrt\" (UniqueName: \"kubernetes.io/projected/df4d1f56-d7f9-47ac-b760-9c608a056c18-kube-api-access-hxtrt\") pod \"klusterlet-addon-workmgr-69bfd7fc4-4r9bh\" (UID: \"df4d1f56-d7f9-47ac-b760-9c608a056c18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:38.796715 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796607 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.796715 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-hub\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.796715 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a21d6c1b-d570-4abf-90de-37cde455287e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8\" (UID: \"a21d6c1b-d570-4abf-90de-37cde455287e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8" Jun 10 13:04:38.796715 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnhgl\" (UniqueName: \"kubernetes.io/projected/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-kube-api-access-qnhgl\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.796916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796741 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2dgj\" (UniqueName: \"kubernetes.io/projected/a21d6c1b-d570-4abf-90de-37cde455287e-kube-api-access-m2dgj\") pod \"managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8\" (UID: \"a21d6c1b-d570-4abf-90de-37cde455287e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8" Jun 10 13:04:38.796916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796765 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.796916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-ca\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.796916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.796845 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/df4d1f56-d7f9-47ac-b760-9c608a056c18-klusterlet-config\") pod \"klusterlet-addon-workmgr-69bfd7fc4-4r9bh\" (UID: \"df4d1f56-d7f9-47ac-b760-9c608a056c18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:38.797445 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.797424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.797781 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.797752 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df4d1f56-d7f9-47ac-b760-9c608a056c18-tmp\") pod \"klusterlet-addon-workmgr-69bfd7fc4-4r9bh\" (UID: \"df4d1f56-d7f9-47ac-b760-9c608a056c18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:38.800216 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.800197 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a21d6c1b-d570-4abf-90de-37cde455287e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8\" (UID: \"a21d6c1b-d570-4abf-90de-37cde455287e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8" Jun 10 13:04:38.800399 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.800376 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/df4d1f56-d7f9-47ac-b760-9c608a056c18-klusterlet-config\") pod \"klusterlet-addon-workmgr-69bfd7fc4-4r9bh\" (UID: \"df4d1f56-d7f9-47ac-b760-9c608a056c18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:38.811688 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.811658 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:04:38.811688 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.811672 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wwsj7\"" Jun 10 13:04:38.811860 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.811674 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 13:04:38.812096 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.812020 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 13:04:38.816625 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.816604 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t"] Jun 10 13:04:38.816802 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.816786 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wlh9s" Jun 10 13:04:38.820291 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.820268 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 13:04:38.822177 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.822157 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-8kj9w"] Jun 10 13:04:38.822258 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.822193 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55f6d9476c-gjp6b"] Jun 10 13:04:38.822258 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.822211 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wlh9s"] Jun 10 13:04:38.822258 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.822223 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn"] Jun 10 13:04:38.845873 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.844949 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 13:04:38.845873 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.845182 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:04:38.845873 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.845356 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h6f8g\"" Jun 10 13:04:38.850973 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.850910 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2dgj\" (UniqueName: \"kubernetes.io/projected/a21d6c1b-d570-4abf-90de-37cde455287e-kube-api-access-m2dgj\") pod \"managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8\" (UID: \"a21d6c1b-d570-4abf-90de-37cde455287e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8" Jun 10 13:04:38.852173 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.852152 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxtrt\" (UniqueName: \"kubernetes.io/projected/df4d1f56-d7f9-47ac-b760-9c608a056c18-kube-api-access-hxtrt\") pod \"klusterlet-addon-workmgr-69bfd7fc4-4r9bh\" (UID: \"df4d1f56-d7f9-47ac-b760-9c608a056c18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:38.897998 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.897969 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb6c60d-a781-43fd-9ceb-2a739a930543-service-ca-bundle\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:38.898162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.898162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8eb6c60d-a781-43fd-9ceb-2a739a930543-default-certificate\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:38.898162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898072 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebc3cb39-0f15-4395-aa67-5661d95d3434-tmp\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:38.898162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-ca\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.898162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898124 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebc3cb39-0f15-4395-aa67-5661d95d3434-serving-cert\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:38.898428 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/832454fb-ae01-48db-b4c8-10210b92fe44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mkm4t\" (UID: \"832454fb-ae01-48db-b4c8-10210b92fe44\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" Jun 10 13:04:38.898428 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898203 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8efef223-6e7b-4475-b65d-bca1891e9335-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wjqgn\" (UID: \"8efef223-6e7b-4475-b65d-bca1891e9335\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" Jun 10 13:04:38.898428 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898224 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8eb6c60d-a781-43fd-9ceb-2a739a930543-stats-auth\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:38.898428 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.898428 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898358 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n8xf\" (UniqueName: \"kubernetes.io/projected/ebc3cb39-0f15-4395-aa67-5661d95d3434-kube-api-access-8n8xf\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:38.898428 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.898428 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898411 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3cb39-0f15-4395-aa67-5661d95d3434-trusted-ca-bundle\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:38.898816 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-hub\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.898816 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5swk\" (UniqueName: \"kubernetes.io/projected/832454fb-ae01-48db-b4c8-10210b92fe44-kube-api-access-l5swk\") pod \"cluster-monitoring-operator-74bbf69bbb-mkm4t\" (UID: \"832454fb-ae01-48db-b4c8-10210b92fe44\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" Jun 10 13:04:38.898816 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3cb39-0f15-4395-aa67-5661d95d3434-service-ca-bundle\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:38.898816 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk7k7\" (UniqueName: \"kubernetes.io/projected/8efef223-6e7b-4475-b65d-bca1891e9335-kube-api-access-tk7k7\") pod \"cluster-samples-operator-854f8b96b6-wjqgn\" (UID: \"8efef223-6e7b-4475-b65d-bca1891e9335\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" Jun 10 13:04:38.898816 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb6c60d-a781-43fd-9ceb-2a739a930543-metrics-certs\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:38.898816 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h9pl\" (UniqueName: \"kubernetes.io/projected/8eb6c60d-a781-43fd-9ceb-2a739a930543-kube-api-access-4h9pl\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:38.898816 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898670 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrlc6\" (UniqueName: \"kubernetes.io/projected/6cfdebac-6130-4405-971e-2a7556b84dbb-kube-api-access-hrlc6\") pod \"volume-data-source-validator-78dd696465-wlh9s\" (UID: \"6cfdebac-6130-4405-971e-2a7556b84dbb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wlh9s" Jun 10 13:04:38.898816 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnhgl\" (UniqueName: \"kubernetes.io/projected/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-kube-api-access-qnhgl\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.898816 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898733 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ebc3cb39-0f15-4395-aa67-5661d95d3434-snapshots\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:38.898816 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.898762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/832454fb-ae01-48db-b4c8-10210b92fe44-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-mkm4t\" (UID: \"832454fb-ae01-48db-b4c8-10210b92fe44\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" Jun 10 13:04:38.899960 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.899937 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.901159 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.901136 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.901275 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.901157 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.901359 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.901339 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-ca\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.902282 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.902262 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-hub\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.920389 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.920364 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnhgl\" (UniqueName: \"kubernetes.io/projected/b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a-kube-api-access-qnhgl\") pod \"cluster-proxy-proxy-agent-6485bccf4c-cp59m\" (UID: \"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.927214 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.927191 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:38.947896 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.947864 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8" Jun 10 13:04:38.958056 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.958032 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" Jun 10 13:04:38.999879 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.999851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3cb39-0f15-4395-aa67-5661d95d3434-trusted-ca-bundle\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.000017 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.999902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5swk\" (UniqueName: \"kubernetes.io/projected/832454fb-ae01-48db-b4c8-10210b92fe44-kube-api-access-l5swk\") pod \"cluster-monitoring-operator-74bbf69bbb-mkm4t\" (UID: \"832454fb-ae01-48db-b4c8-10210b92fe44\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" Jun 10 13:04:39.000017 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.999928 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3cb39-0f15-4395-aa67-5661d95d3434-service-ca-bundle\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.000017 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.999954 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7k7\" (UniqueName: \"kubernetes.io/projected/8efef223-6e7b-4475-b65d-bca1891e9335-kube-api-access-tk7k7\") pod \"cluster-samples-operator-854f8b96b6-wjqgn\" (UID: \"8efef223-6e7b-4475-b65d-bca1891e9335\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" Jun 10 13:04:39.000017 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:38.999982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb6c60d-a781-43fd-9ceb-2a739a930543-metrics-certs\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:39.000226 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000059 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h9pl\" (UniqueName: \"kubernetes.io/projected/8eb6c60d-a781-43fd-9ceb-2a739a930543-kube-api-access-4h9pl\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:39.000226 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrlc6\" (UniqueName: \"kubernetes.io/projected/6cfdebac-6130-4405-971e-2a7556b84dbb-kube-api-access-hrlc6\") pod \"volume-data-source-validator-78dd696465-wlh9s\" (UID: \"6cfdebac-6130-4405-971e-2a7556b84dbb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wlh9s" Jun 10 13:04:39.000226 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000137 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ebc3cb39-0f15-4395-aa67-5661d95d3434-snapshots\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.000226 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/832454fb-ae01-48db-b4c8-10210b92fe44-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-mkm4t\" (UID: \"832454fb-ae01-48db-b4c8-10210b92fe44\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" Jun 10 13:04:39.000226 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb6c60d-a781-43fd-9ceb-2a739a930543-service-ca-bundle\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:39.000520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8eb6c60d-a781-43fd-9ceb-2a739a930543-default-certificate\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:39.000520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000253 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebc3cb39-0f15-4395-aa67-5661d95d3434-tmp\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.000520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebc3cb39-0f15-4395-aa67-5661d95d3434-serving-cert\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.000520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/832454fb-ae01-48db-b4c8-10210b92fe44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mkm4t\" (UID: \"832454fb-ae01-48db-b4c8-10210b92fe44\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" Jun 10 13:04:39.000520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8efef223-6e7b-4475-b65d-bca1891e9335-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wjqgn\" (UID: \"8efef223-6e7b-4475-b65d-bca1891e9335\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" Jun 10 13:04:39.000520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8eb6c60d-a781-43fd-9ceb-2a739a930543-stats-auth\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:39.000520 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n8xf\" (UniqueName: \"kubernetes.io/projected/ebc3cb39-0f15-4395-aa67-5661d95d3434-kube-api-access-8n8xf\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.000881 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3cb39-0f15-4395-aa67-5661d95d3434-service-ca-bundle\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.000940 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000876 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3cb39-0f15-4395-aa67-5661d95d3434-trusted-ca-bundle\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.000940 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.000911 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ebc3cb39-0f15-4395-aa67-5661d95d3434-snapshots\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.001821 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.001134 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebc3cb39-0f15-4395-aa67-5661d95d3434-tmp\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.001821 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.001497 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb6c60d-a781-43fd-9ceb-2a739a930543-service-ca-bundle\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:39.001821 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.001777 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/832454fb-ae01-48db-b4c8-10210b92fe44-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-mkm4t\" (UID: \"832454fb-ae01-48db-b4c8-10210b92fe44\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" Jun 10 13:04:39.003619 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.003593 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb6c60d-a781-43fd-9ceb-2a739a930543-metrics-certs\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:39.003717 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.003697 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8eb6c60d-a781-43fd-9ceb-2a739a930543-stats-auth\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:39.003791 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.003765 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/832454fb-ae01-48db-b4c8-10210b92fe44-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mkm4t\" (UID: \"832454fb-ae01-48db-b4c8-10210b92fe44\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" Jun 10 13:04:39.004318 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.004297 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8efef223-6e7b-4475-b65d-bca1891e9335-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wjqgn\" (UID: \"8efef223-6e7b-4475-b65d-bca1891e9335\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" Jun 10 13:04:39.004875 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.004851 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebc3cb39-0f15-4395-aa67-5661d95d3434-serving-cert\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.005059 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.005038 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8eb6c60d-a781-43fd-9ceb-2a739a930543-default-certificate\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:39.012448 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.012420 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5swk\" (UniqueName: \"kubernetes.io/projected/832454fb-ae01-48db-b4c8-10210b92fe44-kube-api-access-l5swk\") pod \"cluster-monitoring-operator-74bbf69bbb-mkm4t\" (UID: \"832454fb-ae01-48db-b4c8-10210b92fe44\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" Jun 10 13:04:39.012988 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.012965 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrlc6\" (UniqueName: \"kubernetes.io/projected/6cfdebac-6130-4405-971e-2a7556b84dbb-kube-api-access-hrlc6\") pod \"volume-data-source-validator-78dd696465-wlh9s\" (UID: \"6cfdebac-6130-4405-971e-2a7556b84dbb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wlh9s" Jun 10 13:04:39.014169 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.014114 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h9pl\" (UniqueName: \"kubernetes.io/projected/8eb6c60d-a781-43fd-9ceb-2a739a930543-kube-api-access-4h9pl\") pod \"router-default-55f6d9476c-gjp6b\" (UID: \"8eb6c60d-a781-43fd-9ceb-2a739a930543\") " pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:39.014372 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.014350 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n8xf\" (UniqueName: \"kubernetes.io/projected/ebc3cb39-0f15-4395-aa67-5661d95d3434-kube-api-access-8n8xf\") pod \"insights-operator-896549976-8kj9w\" (UID: \"ebc3cb39-0f15-4395-aa67-5661d95d3434\") " pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.014614 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.014573 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk7k7\" (UniqueName: \"kubernetes.io/projected/8efef223-6e7b-4475-b65d-bca1891e9335-kube-api-access-tk7k7\") pod \"cluster-samples-operator-854f8b96b6-wjqgn\" (UID: \"8efef223-6e7b-4475-b65d-bca1891e9335\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" Jun 10 13:04:39.057267 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.057239 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" Jun 10 13:04:39.066364 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.066340 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:39.084174 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.084147 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-8kj9w" Jun 10 13:04:39.115153 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.115129 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" Jun 10 13:04:39.147894 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:39.147873 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wlh9s" Jun 10 13:04:40.186007 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.185971 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t"] Jun 10 13:04:40.187411 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.187341 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh"] Jun 10 13:04:40.189386 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:40.189359 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf4d1f56_d7f9_47ac_b760_9c608a056c18.slice/crio-32d56611685401da03590d8a648d45e2352b7ef31ff4480aee07649bee50aa26 WatchSource:0}: Error finding container 32d56611685401da03590d8a648d45e2352b7ef31ff4480aee07649bee50aa26: Status 404 returned error can't find the container with id 32d56611685401da03590d8a648d45e2352b7ef31ff4480aee07649bee50aa26 Jun 10 13:04:40.190179 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:40.190144 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832454fb_ae01_48db_b4c8_10210b92fe44.slice/crio-6d9077799286a8045a84d7814aba9867af7287d911ce1e6123bf2b88fd1916d9 WatchSource:0}: Error finding container 6d9077799286a8045a84d7814aba9867af7287d911ce1e6123bf2b88fd1916d9: Status 404 returned error can't find the container with id 6d9077799286a8045a84d7814aba9867af7287d911ce1e6123bf2b88fd1916d9 Jun 10 13:04:40.192685 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.192637 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-8kj9w"] Jun 10 13:04:40.195082 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:40.195059 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc3cb39_0f15_4395_aa67_5661d95d3434.slice/crio-2424286853c4a7db9dba8f9e37e9ebfa111232638bad786e11a23e78a4950fe5 WatchSource:0}: Error finding container 2424286853c4a7db9dba8f9e37e9ebfa111232638bad786e11a23e78a4950fe5: Status 404 returned error can't find the container with id 2424286853c4a7db9dba8f9e37e9ebfa111232638bad786e11a23e78a4950fe5 Jun 10 13:04:40.235274 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.235245 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8"] Jun 10 13:04:40.236994 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.236975 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55f6d9476c-gjp6b"] Jun 10 13:04:40.239068 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.239044 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wlh9s"] Jun 10 13:04:40.240107 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.240091 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn"] Jun 10 13:04:40.240668 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:40.240633 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda21d6c1b_d570_4abf_90de_37cde455287e.slice/crio-3d7184e4f2835076b18cff4cf4e0f9d00082df0777b8cdddd28d33ae39349d3c WatchSource:0}: Error finding container 3d7184e4f2835076b18cff4cf4e0f9d00082df0777b8cdddd28d33ae39349d3c: Status 404 returned error can't find the container with id 3d7184e4f2835076b18cff4cf4e0f9d00082df0777b8cdddd28d33ae39349d3c Jun 10 13:04:40.241217 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.241197 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m"] Jun 10 13:04:40.241345 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:40.241327 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb6c60d_a781_43fd_9ceb_2a739a930543.slice/crio-86ca1254d2df1be7071be679b55e31dd4f73780d90c6fea734de44af4f8ac85a WatchSource:0}: Error finding container 86ca1254d2df1be7071be679b55e31dd4f73780d90c6fea734de44af4f8ac85a: Status 404 returned error can't find the container with id 86ca1254d2df1be7071be679b55e31dd4f73780d90c6fea734de44af4f8ac85a Jun 10 13:04:40.243179 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:40.243157 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfdebac_6130_4405_971e_2a7556b84dbb.slice/crio-92e54c224e05de62ed1ae9dec52c0b0a29ac160c8f2cc449d8f4c711f900362d WatchSource:0}: Error finding container 92e54c224e05de62ed1ae9dec52c0b0a29ac160c8f2cc449d8f4c711f900362d: Status 404 returned error can't find the container with id 92e54c224e05de62ed1ae9dec52c0b0a29ac160c8f2cc449d8f4c711f900362d Jun 10 13:04:40.244554 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:40.244369 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9d9a492_03ee_4cb9_85c5_1bb4409fcc9a.slice/crio-531af1ccf8815ce002c13f3168fed701934214f2cfff832a5430a19a498e7db3 WatchSource:0}: Error finding container 531af1ccf8815ce002c13f3168fed701934214f2cfff832a5430a19a498e7db3: Status 404 returned error can't find the container with id 531af1ccf8815ce002c13f3168fed701934214f2cfff832a5430a19a498e7db3 Jun 10 13:04:40.357820 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.357794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55f6d9476c-gjp6b" event={"ID":"8eb6c60d-a781-43fd-9ceb-2a739a930543","Type":"ContainerStarted","Data":"86ca1254d2df1be7071be679b55e31dd4f73780d90c6fea734de44af4f8ac85a"} Jun 10 13:04:40.359656 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.359621 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-97st9" event={"ID":"c2da8555-0d96-4880-8092-a54510d11495","Type":"ContainerStarted","Data":"5361a2d3003f47113426032855cfd2311cf64cf783a4c18f9385a7e4eeb7d2d2"} Jun 10 13:04:40.361937 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.361743 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fxrlc" event={"ID":"6dc60ce3-c430-4df1-802f-026c38c787cc","Type":"ContainerStarted","Data":"0feaf3b4476ce1d4651f882a2d732d9f2f849410cad25c964f7e7058d8ac4c4e"} Jun 10 13:04:40.361937 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.361869 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:40.362948 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.362921 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wlh9s" event={"ID":"6cfdebac-6130-4405-971e-2a7556b84dbb","Type":"ContainerStarted","Data":"92e54c224e05de62ed1ae9dec52c0b0a29ac160c8f2cc449d8f4c711f900362d"} Jun 10 13:04:40.364210 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.364183 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8" event={"ID":"a21d6c1b-d570-4abf-90de-37cde455287e","Type":"ContainerStarted","Data":"3d7184e4f2835076b18cff4cf4e0f9d00082df0777b8cdddd28d33ae39349d3c"} Jun 10 13:04:40.365386 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.365360 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" event={"ID":"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a","Type":"ContainerStarted","Data":"531af1ccf8815ce002c13f3168fed701934214f2cfff832a5430a19a498e7db3"} Jun 10 13:04:40.366681 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.366654 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" event={"ID":"df4d1f56-d7f9-47ac-b760-9c608a056c18","Type":"ContainerStarted","Data":"32d56611685401da03590d8a648d45e2352b7ef31ff4480aee07649bee50aa26"} Jun 10 13:04:40.367846 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.367822 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8kj9w" event={"ID":"ebc3cb39-0f15-4395-aa67-5661d95d3434","Type":"ContainerStarted","Data":"2424286853c4a7db9dba8f9e37e9ebfa111232638bad786e11a23e78a4950fe5"} Jun 10 13:04:40.371449 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.371430 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" event={"ID":"832454fb-ae01-48db-b4c8-10210b92fe44","Type":"ContainerStarted","Data":"6d9077799286a8045a84d7814aba9867af7287d911ce1e6123bf2b88fd1916d9"} Jun 10 13:04:40.372663 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.372640 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" event={"ID":"8efef223-6e7b-4475-b65d-bca1891e9335","Type":"ContainerStarted","Data":"42d90d0983d3a8f3ae36537e51a20c3ace2dd123dabdfe22bc07a07b304c945b"} Jun 10 13:04:40.378141 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.378055 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-97st9" podStartSLOduration=65.299950019 podStartE2EDuration="1m11.3780388s" totalImagesPullingTime="6.078088781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:40.377171911 +0000 UTC m=+72.083788505" watchObservedRunningTime="2026-06-10 13:04:40.3780388 +0000 UTC m=+72.084655394" Jun 10 13:04:40.405187 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:40.405136 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fxrlc" podStartSLOduration=34.799622811 podStartE2EDuration="37.405119986s" totalImagesPullingTime="2.605497175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:40.402437553 +0000 UTC m=+72.109054148" watchObservedRunningTime="2026-06-10 13:04:40.405119986 +0000 UTC m=+72.111736579" Jun 10 13:04:41.384617 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:41.384557 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55f6d9476c-gjp6b" event={"ID":"8eb6c60d-a781-43fd-9ceb-2a739a930543","Type":"ContainerStarted","Data":"4f7c8158389a3c02cb59806cfaac111942f873e11c42a3a642c59cfb98677858"} Jun 10 13:04:41.410189 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:41.409759 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-55f6d9476c-gjp6b" podStartSLOduration=3.409738824 podStartE2EDuration="3.409738824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:41.408030283 +0000 UTC m=+73.114646881" watchObservedRunningTime="2026-06-10 13:04:41.409738824 +0000 UTC m=+73.116355426" Jun 10 13:04:42.068245 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:42.066950 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:42.070642 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:42.070393 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:42.403196 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:42.403067 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:42.405550 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:42.405298 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55f6d9476c-gjp6b" Jun 10 13:04:48.784220 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:48.784189 2580 scope.go:117] "RemoveContainer" containerID="4ce9e07feebe050b93eea26e6b9928d15d2f92e890ecf9632166b317a40a4f82" Jun 10 13:04:48.784683 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:48.784397 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mvpgc_openshift-console-operator(61ab2ffa-d668-4258-9699-5835aac889fc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" podUID="61ab2ffa-d668-4258-9699-5835aac889fc" Jun 10 13:04:49.434565 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.434470 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wlh9s" event={"ID":"6cfdebac-6130-4405-971e-2a7556b84dbb","Type":"ContainerStarted","Data":"ac82460400680be42f30f63e3c5bdb553cff6e42c88eaca1058ccf2354dc0201"} Jun 10 13:04:49.436166 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.436133 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8" event={"ID":"a21d6c1b-d570-4abf-90de-37cde455287e","Type":"ContainerStarted","Data":"2c6676087a5fc403fa206cb2ed6ca77fa9811798588ccb136b0edca5b1c2eb67"} Jun 10 13:04:49.438256 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.438232 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" event={"ID":"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a","Type":"ContainerStarted","Data":"318da910accc8c9f143f5202139876812a229beb486d9a080f6f937f3a467573"} Jun 10 13:04:49.438379 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.438267 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" event={"ID":"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a","Type":"ContainerStarted","Data":"edd6bd2900db1c03c85593aeae9e33f1ec5f6b41d613b1c9a25ec66e357dbe1f"} Jun 10 13:04:49.438379 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.438287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" event={"ID":"b9d9a492-03ee-4cb9-85c5-1bb4409fcc9a","Type":"ContainerStarted","Data":"6a20a93311a7cdbb3f1ced06a064f9c12e4f455b396c58438f93aec17988b626"} Jun 10 13:04:49.439818 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.439797 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" event={"ID":"df4d1f56-d7f9-47ac-b760-9c608a056c18","Type":"ContainerStarted","Data":"23fb1c4553c4c8aa5f44da7c9aa1e9baefbf37532dbd703a797e21bf2884e9d5"} Jun 10 13:04:49.440006 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.439956 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:49.441463 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.441441 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8kj9w" event={"ID":"ebc3cb39-0f15-4395-aa67-5661d95d3434","Type":"ContainerStarted","Data":"3c963b0438a92af02b1db5e2266b0de283b540f658d59ff5a13fb24dc8cf56b5"} Jun 10 13:04:49.441662 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.441641 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" Jun 10 13:04:49.443284 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.443261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" event={"ID":"832454fb-ae01-48db-b4c8-10210b92fe44","Type":"ContainerStarted","Data":"2daa01279db784a5dad79ba8e6aca9e3478b65dff8cde77f7425b58c135d9faf"} Jun 10 13:04:49.445078 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.445058 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" event={"ID":"8efef223-6e7b-4475-b65d-bca1891e9335","Type":"ContainerStarted","Data":"46175f2c54a3305cee0d34e00033ad13fda2063cefacb96df70d0879f37aad93"} Jun 10 13:04:49.445163 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.445102 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" event={"ID":"8efef223-6e7b-4475-b65d-bca1891e9335","Type":"ContainerStarted","Data":"cdc915d53d4b56299a28bdf10e7ca94b6a204baff3d683c9e2df2c6451785e9e"} Jun 10 13:04:49.458417 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.458369 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wlh9s" podStartSLOduration=2.851838203 podStartE2EDuration="11.458356878s" totalImagesPullingTime="8.606518675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:49.457177065 +0000 UTC m=+81.163793654" watchObservedRunningTime="2026-06-10 13:04:49.458356878 +0000 UTC m=+81.164973529" Jun 10 13:04:49.480322 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.480278 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wjqgn" podStartSLOduration=2.867509497 podStartE2EDuration="11.480265529s" totalImagesPullingTime="8.612756032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:49.479427333 +0000 UTC m=+81.186043930" watchObservedRunningTime="2026-06-10 13:04:49.480265529 +0000 UTC m=+81.186882114" Jun 10 13:04:49.522873 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.522821 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6485bccf4c-cp59m" podStartSLOduration=2.814594184 podStartE2EDuration="11.522802126s" totalImagesPullingTime="8.708207942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:49.503421075 +0000 UTC m=+81.210037670" watchObservedRunningTime="2026-06-10 13:04:49.522802126 +0000 UTC m=+81.229418715" Jun 10 13:04:49.523364 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.523337 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mkm4t" podStartSLOduration=2.792286708 podStartE2EDuration="11.52332778s" totalImagesPullingTime="8.731041072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:49.52190245 +0000 UTC m=+81.228519044" watchObservedRunningTime="2026-06-10 13:04:49.52332778 +0000 UTC m=+81.229944373" Jun 10 13:04:49.545606 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.545559 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-8kj9w" podStartSLOduration=2.80747312 podStartE2EDuration="11.545542578s" totalImagesPullingTime="8.738069458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:49.544453025 +0000 UTC m=+81.251069622" watchObservedRunningTime="2026-06-10 13:04:49.545542578 +0000 UTC m=+81.252159176" Jun 10 13:04:49.564787 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.564737 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fcbc8ccb-mw4s8" podStartSLOduration=2.85971341 podStartE2EDuration="11.564725223s" totalImagesPullingTime="8.705011813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:49.563651264 +0000 UTC m=+81.270267860" watchObservedRunningTime="2026-06-10 13:04:49.564725223 +0000 UTC m=+81.271341817" Jun 10 13:04:49.583677 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:49.581806 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69bfd7fc4-4r9bh" podStartSLOduration=2.824847475 podStartE2EDuration="11.581788757s" totalImagesPullingTime="8.756941282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:49.581021152 +0000 UTC m=+81.287637747" watchObservedRunningTime="2026-06-10 13:04:49.581788757 +0000 UTC m=+81.288405352" Jun 10 13:04:50.387362 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:50.387333 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fxrlc" Jun 10 13:04:51.390485 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:51.390455 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fxrlc_6dc60ce3-c430-4df1-802f-026c38c787cc/dns/0.log" Jun 10 13:04:51.589952 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:51.589922 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fxrlc_6dc60ce3-c430-4df1-802f-026c38c787cc/kube-rbac-proxy/0.log" Jun 10 13:04:51.880576 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:51.880545 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ckc85"] Jun 10 13:04:51.885429 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:51.885408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:51.888239 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:51.888197 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ncwrn\"" Jun 10 13:04:51.888379 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:51.888255 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 13:04:51.888439 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:51.888404 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 13:04:51.896217 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:51.896194 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ckc85"] Jun 10 13:04:51.990160 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:51.990131 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lxkv7_54b7e057-3679-484b-9c46-bc24300838bc/dns-node-resolver/0.log" Jun 10 13:04:52.016040 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.016009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.016174 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.016047 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-crio-socket\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.016174 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.016066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.016244 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.016182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-data-volume\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.016282 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.016239 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5898m\" (UniqueName: \"kubernetes.io/projected/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-kube-api-access-5898m\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.117703 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.117669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5898m\" (UniqueName: \"kubernetes.io/projected/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-kube-api-access-5898m\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.117850 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.117740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.117850 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.117778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-crio-socket\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.117850 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.117804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.118054 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.117857 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-data-volume\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.118054 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.117895 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-crio-socket\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.118054 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:52.118008 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 10 13:04:52.118192 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:52.118083 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-insights-runtime-extractor-tls podName:a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:52.618062936 +0000 UTC m=+84.324679511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckc85" (UID: "a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8") : secret "insights-runtime-extractor-tls" not found Jun 10 13:04:52.118259 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.118219 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-data-volume\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.118367 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.118348 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.127248 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.127225 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5898m\" (UniqueName: \"kubernetes.io/projected/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-kube-api-access-5898m\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.592042 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.592009 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79d47757f-5nts7_d56e7a63-ce5b-4a79-8bcb-77bddd55946f/registry/0.log" Jun 10 13:04:52.622049 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.622021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.624255 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.624224 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckc85\" (UID: \"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8\") " pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.790951 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.790927 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6s7xc_9fc2d181-6aa1-4530-9c15-74d967622530/node-ca/0.log" Jun 10 13:04:52.796212 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.796191 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ckc85" Jun 10 13:04:52.928032 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:52.928009 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ckc85"] Jun 10 13:04:52.930757 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:52.930735 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bcdb44_a0fd_41a8_92e9_fae2883f9ff8.slice/crio-5113c3037dba230f06e3efa6b9c6b43a8f18242a0f5cb0bf96c949a62511352b WatchSource:0}: Error finding container 5113c3037dba230f06e3efa6b9c6b43a8f18242a0f5cb0bf96c949a62511352b: Status 404 returned error can't find the container with id 5113c3037dba230f06e3efa6b9c6b43a8f18242a0f5cb0bf96c949a62511352b Jun 10 13:04:53.391582 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:53.391547 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55f6d9476c-gjp6b_8eb6c60d-a781-43fd-9ceb-2a739a930543/router/0.log" Jun 10 13:04:53.462907 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:53.462874 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckc85" event={"ID":"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8","Type":"ContainerStarted","Data":"abae5481f9943ae486770a5094d621246777f982453f7f3c6a8ac8b46fdbd871"} Jun 10 13:04:53.463063 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:53.462938 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckc85" event={"ID":"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8","Type":"ContainerStarted","Data":"5113c3037dba230f06e3efa6b9c6b43a8f18242a0f5cb0bf96c949a62511352b"} Jun 10 13:04:53.990161 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:53.990132 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s99l7_db3e6c41-d0f1-448a-bada-2ef33206b505/serve-healthcheck-canary/0.log" Jun 10 13:04:54.467905 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:54.467878 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckc85" event={"ID":"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8","Type":"ContainerStarted","Data":"a8e06331c912ca513be6075a3037d2d9d5359429f64f17ef2ea0a5c6bf4e0ccc"} Jun 10 13:04:55.310424 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:55.310384 2580 patch_prober.go:28] interesting pod/image-registry-79d47757f-5nts7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 13:04:55.310820 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:55.310445 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-79d47757f-5nts7" podUID="d56e7a63-ce5b-4a79-8bcb-77bddd55946f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:04:56.477011 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:56.476980 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckc85" event={"ID":"a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8","Type":"ContainerStarted","Data":"0be95b503536cd395efc8ddaddb972466365c9b76dda577d7e346da867f75db9"} Jun 10 13:04:56.500288 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:56.500242 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ckc85" podStartSLOduration=3.034030631 podStartE2EDuration="5.50022493s" totalImagesPullingTime="2.466194299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:04:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:56.497753472 +0000 UTC m=+88.204370066" watchObservedRunningTime="2026-06-10 13:04:56.50022493 +0000 UTC m=+88.206841523" Jun 10 13:04:57.105410 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.105371 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wn7qt"] Jun 10 13:04:57.109666 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.109639 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.114784 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.114521 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 13:04:57.114784 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.114569 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xp6nd\"" Jun 10 13:04:57.114784 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.114670 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 13:04:57.115811 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.115794 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 13:04:57.115977 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.115821 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 13:04:57.256771 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.256736 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-textfile\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.256949 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.256800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-root\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.256949 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.256833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.256949 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.256868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knhcl\" (UniqueName: \"kubernetes.io/projected/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-kube-api-access-knhcl\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.256949 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.256906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-tls\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.256949 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.256934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-accelerators-collector-config\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.257207 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.256999 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-sys\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.257207 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.257042 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-wtmp\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.257207 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.257069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-metrics-client-ca\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.344815 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.344788 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:04:57.357605 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.357532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-sys\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.357605 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.357581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-wtmp\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.357795 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.357623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-metrics-client-ca\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.357795 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.357644 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-sys\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.357795 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.357772 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-wtmp\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.357949 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.357826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-textfile\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.358177 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.358157 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-textfile\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.358260 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.358208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-root\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.358317 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.358279 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-root\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.358317 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.358307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.358416 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.358357 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-metrics-client-ca\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.358740 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.358346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knhcl\" (UniqueName: \"kubernetes.io/projected/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-kube-api-access-knhcl\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.358838 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.358771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-tls\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.358897 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:57.358889 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 13:04:57.358951 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:04:57.358946 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-tls podName:daa8c990-e8fb-4e41-a6ad-898f3ac51ef9 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:57.858927695 +0000 UTC m=+89.565544272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-tls") pod "node-exporter-wn7qt" (UID: "daa8c990-e8fb-4e41-a6ad-898f3ac51ef9") : secret "node-exporter-tls" not found Jun 10 13:04:57.359154 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.358802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-accelerators-collector-config\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.359770 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.359654 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-accelerators-collector-config\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.360732 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.360704 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.368596 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.368553 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knhcl\" (UniqueName: \"kubernetes.io/projected/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-kube-api-access-knhcl\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.866020 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.865983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-tls\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:57.868491 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:57.868458 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/daa8c990-e8fb-4e41-a6ad-898f3ac51ef9-node-exporter-tls\") pod \"node-exporter-wn7qt\" (UID: \"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9\") " pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:58.022426 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:58.022395 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wn7qt" Jun 10 13:04:58.037446 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:04:58.037360 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa8c990_e8fb_4e41_a6ad_898f3ac51ef9.slice/crio-be661f9fdbf58b2a2bebaff7b12859ef989ee98729044117903fbf360b4d8a88 WatchSource:0}: Error finding container be661f9fdbf58b2a2bebaff7b12859ef989ee98729044117903fbf360b4d8a88: Status 404 returned error can't find the container with id be661f9fdbf58b2a2bebaff7b12859ef989ee98729044117903fbf360b4d8a88 Jun 10 13:04:58.488269 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:58.488231 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wn7qt" event={"ID":"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9","Type":"ContainerStarted","Data":"be661f9fdbf58b2a2bebaff7b12859ef989ee98729044117903fbf360b4d8a88"} Jun 10 13:04:59.493768 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:59.493737 2580 generic.go:356] "Generic (PLEG): container finished" podID="daa8c990-e8fb-4e41-a6ad-898f3ac51ef9" containerID="ede153e4b542990385658406da3140f94ef835f1dad68dc54d3113c75a373876" exitCode=0 Jun 10 13:04:59.494214 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:04:59.493827 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wn7qt" event={"ID":"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9","Type":"ContainerDied","Data":"ede153e4b542990385658406da3140f94ef835f1dad68dc54d3113c75a373876"} Jun 10 13:05:00.499436 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:00.499391 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wn7qt" event={"ID":"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9","Type":"ContainerStarted","Data":"6d1748683ad15feb2b84cdc0820017ec5d994e6753f17230be98fc5cdcdf6325"} Jun 10 13:05:00.499823 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:00.499472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wn7qt" event={"ID":"daa8c990-e8fb-4e41-a6ad-898f3ac51ef9","Type":"ContainerStarted","Data":"830cdf4457c9afac5032150175680c1c945897c6ce4d1de1428445a81a447a3c"} Jun 10 13:05:00.544219 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:00.544159 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wn7qt" podStartSLOduration=2.6585065930000003 podStartE2EDuration="3.544140161s" totalImagesPullingTime="816.251021ms" totalInitContainerRuntime="69.382547ms" isStatefulPod=true podCreationTimestamp="2026-06-10 13:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:00.541302162 +0000 UTC m=+92.247918754" watchObservedRunningTime="2026-06-10 13:05:00.544140161 +0000 UTC m=+92.250756756" Jun 10 13:05:02.230454 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:02.230425 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79d47757f-5nts7"] Jun 10 13:05:02.785325 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:02.785299 2580 scope.go:117] "RemoveContainer" containerID="4ce9e07feebe050b93eea26e6b9928d15d2f92e890ecf9632166b317a40a4f82" Jun 10 13:05:03.520035 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:03.520007 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:05:03.520515 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:03.520131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" event={"ID":"61ab2ffa-d668-4258-9699-5835aac889fc","Type":"ContainerStarted","Data":"688dcab7de751b6d1590d11025f00cfd6fb22edd8dce837c7a1380569597b196"} Jun 10 13:05:03.520597 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:03.520494 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:05:03.525887 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:03.525867 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" Jun 10 13:05:03.564767 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:03.564714 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-mvpgc" podStartSLOduration=88.370589573 podStartE2EDuration="1m34.564697669s" totalImagesPullingTime="6.194108096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:03.541413851 +0000 UTC m=+95.248030446" watchObservedRunningTime="2026-06-10 13:05:03.564697669 +0000 UTC m=+95.271314263" Jun 10 13:05:05.328653 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:05.328624 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jr8mb" Jun 10 13:05:22.593750 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:22.593716 2580 generic.go:356] "Generic (PLEG): container finished" podID="ac9b6b12-417f-41e8-9cea-c44b3f36ba7f" containerID="c40b4923f27c11cdebad46680ed57a134c2e27960cc0eff56ddf0aa191254ab8" exitCode=0 Jun 10 13:05:22.594156 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:22.593795 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" event={"ID":"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f","Type":"ContainerDied","Data":"c40b4923f27c11cdebad46680ed57a134c2e27960cc0eff56ddf0aa191254ab8"} Jun 10 13:05:22.594156 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:22.594129 2580 scope.go:117] "RemoveContainer" containerID="c40b4923f27c11cdebad46680ed57a134c2e27960cc0eff56ddf0aa191254ab8" Jun 10 13:05:23.599267 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:23.599233 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wc8bj" event={"ID":"ac9b6b12-417f-41e8-9cea-c44b3f36ba7f","Type":"ContainerStarted","Data":"1733ceda32754378a65ca3de9e5bef65945f6bd0f0348f7b99d3a673901228c0"} Jun 10 13:05:27.253561 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.253469 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79d47757f-5nts7" podUID="d56e7a63-ce5b-4a79-8bcb-77bddd55946f" containerName="registry" containerID="cri-o://8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6" gracePeriod=30 Jun 10 13:05:27.340159 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.340126 2580 patch_prober.go:28] interesting pod/image-registry-79d47757f-5nts7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jun 10 13:05:27.340279 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.340201 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-79d47757f-5nts7" podUID="d56e7a63-ce5b-4a79-8bcb-77bddd55946f" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jun 10 13:05:27.490827 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.490804 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:05:27.608313 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.608225 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls\") pod \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " Jun 10 13:05:27.608313 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.608281 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-trusted-ca\") pod \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " Jun 10 13:05:27.608313 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.608307 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-ca-trust-extracted\") pod \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " Jun 10 13:05:27.608741 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.608329 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-certificates\") pod \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " Jun 10 13:05:27.608741 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.608354 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-bound-sa-token\") pod \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " Jun 10 13:05:27.608741 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.608374 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqpr5\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-kube-api-access-xqpr5\") pod \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " Jun 10 13:05:27.608741 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.608404 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-image-registry-private-configuration\") pod \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " Jun 10 13:05:27.608741 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.608440 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-installation-pull-secrets\") pod \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\" (UID: \"d56e7a63-ce5b-4a79-8bcb-77bddd55946f\") " Jun 10 13:05:27.608997 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.608838 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d56e7a63-ce5b-4a79-8bcb-77bddd55946f" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:05:27.608997 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.608912 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d56e7a63-ce5b-4a79-8bcb-77bddd55946f" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:05:27.611148 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.611093 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-kube-api-access-xqpr5" (OuterVolumeSpecName: "kube-api-access-xqpr5") pod "d56e7a63-ce5b-4a79-8bcb-77bddd55946f" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f"). InnerVolumeSpecName "kube-api-access-xqpr5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:05:27.611284 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.611169 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d56e7a63-ce5b-4a79-8bcb-77bddd55946f" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:05:27.611284 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.611244 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d56e7a63-ce5b-4a79-8bcb-77bddd55946f" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:05:27.611543 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.611490 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d56e7a63-ce5b-4a79-8bcb-77bddd55946f" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:05:27.611831 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.611737 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d56e7a63-ce5b-4a79-8bcb-77bddd55946f" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:05:27.615360 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.615330 2580 generic.go:356] "Generic (PLEG): container finished" podID="d56e7a63-ce5b-4a79-8bcb-77bddd55946f" containerID="8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6" exitCode=0 Jun 10 13:05:27.615466 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.615372 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d47757f-5nts7" Jun 10 13:05:27.615466 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.615373 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d47757f-5nts7" event={"ID":"d56e7a63-ce5b-4a79-8bcb-77bddd55946f","Type":"ContainerDied","Data":"8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6"} Jun 10 13:05:27.615466 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.615426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d47757f-5nts7" event={"ID":"d56e7a63-ce5b-4a79-8bcb-77bddd55946f","Type":"ContainerDied","Data":"1b9647b10e0f3ec27a25419f1381ab702f7a843da76d3d27272c7b77784a64c6"} Jun 10 13:05:27.615466 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.615454 2580 scope.go:117] "RemoveContainer" containerID="8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6" Jun 10 13:05:27.617974 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.617951 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d56e7a63-ce5b-4a79-8bcb-77bddd55946f" (UID: "d56e7a63-ce5b-4a79-8bcb-77bddd55946f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:05:27.627261 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.627244 2580 scope.go:117] "RemoveContainer" containerID="8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6" Jun 10 13:05:27.627553 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:05:27.627532 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6\": container with ID starting with 8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6 not found: ID does not exist" containerID="8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6" Jun 10 13:05:27.627604 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.627562 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6"} err="failed to get container status \"8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6\": rpc error: code = NotFound desc = could not find container \"8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6\": container with ID starting with 8a6d8e50942e60a301970af18d2c13dc6bcd9a2e225ba06f4b733225414b78d6 not found: ID does not exist" Jun 10 13:05:27.709577 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.709544 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-trusted-ca\") on node \"ip-10-0-135-143.ec2.internal\" DevicePath \"\"" Jun 10 13:05:27.709577 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.709572 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-ca-trust-extracted\") on node \"ip-10-0-135-143.ec2.internal\" DevicePath \"\"" Jun 10 13:05:27.709577 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.709582 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-certificates\") on node \"ip-10-0-135-143.ec2.internal\" DevicePath \"\"" Jun 10 13:05:27.709799 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.709592 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-bound-sa-token\") on node \"ip-10-0-135-143.ec2.internal\" DevicePath \"\"" Jun 10 13:05:27.709799 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.709602 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqpr5\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-kube-api-access-xqpr5\") on node \"ip-10-0-135-143.ec2.internal\" DevicePath \"\"" Jun 10 13:05:27.709799 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.709611 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-image-registry-private-configuration\") on node \"ip-10-0-135-143.ec2.internal\" DevicePath \"\"" Jun 10 13:05:27.709799 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.709620 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-installation-pull-secrets\") on node \"ip-10-0-135-143.ec2.internal\" DevicePath \"\"" Jun 10 13:05:27.709799 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.709630 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d56e7a63-ce5b-4a79-8bcb-77bddd55946f-registry-tls\") on node \"ip-10-0-135-143.ec2.internal\" DevicePath \"\"" Jun 10 13:05:27.940410 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.940383 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79d47757f-5nts7"] Jun 10 13:05:27.945310 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:27.945290 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79d47757f-5nts7"] Jun 10 13:05:28.787822 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:28.787786 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d56e7a63-ce5b-4a79-8bcb-77bddd55946f" path="/var/lib/kubelet/pods/d56e7a63-ce5b-4a79-8bcb-77bddd55946f/volumes" Jun 10 13:05:37.654170 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:37.654132 2580 generic.go:356] "Generic (PLEG): container finished" podID="62b98720-ab2f-47b0-8671-75a1d8dc5c9d" containerID="8ba926d54d8e33232005697f7c650b7dfe7258f089806bc2fa14d087d29d17ee" exitCode=0 Jun 10 13:05:37.654614 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:37.654204 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" event={"ID":"62b98720-ab2f-47b0-8671-75a1d8dc5c9d","Type":"ContainerDied","Data":"8ba926d54d8e33232005697f7c650b7dfe7258f089806bc2fa14d087d29d17ee"} Jun 10 13:05:37.654614 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:37.654552 2580 scope.go:117] "RemoveContainer" containerID="8ba926d54d8e33232005697f7c650b7dfe7258f089806bc2fa14d087d29d17ee" Jun 10 13:05:38.660301 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:05:38.660263 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gcmhh" event={"ID":"62b98720-ab2f-47b0-8671-75a1d8dc5c9d","Type":"ContainerStarted","Data":"50a60b856512c7983e7707e0de0002d6ab0c4d2935bbf8f146c1b8907e404c85"} Jun 10 13:08:15.888687 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:15.888654 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n"] Jun 10 13:08:15.889113 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:15.888959 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56e7a63-ce5b-4a79-8bcb-77bddd55946f" containerName="registry" Jun 10 13:08:15.889113 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:15.888970 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56e7a63-ce5b-4a79-8bcb-77bddd55946f" containerName="registry" Jun 10 13:08:15.889113 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:15.889022 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d56e7a63-ce5b-4a79-8bcb-77bddd55946f" containerName="registry" Jun 10 13:08:15.891952 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:15.891935 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:15.895904 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:15.895879 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6g9hm\"" Jun 10 13:08:15.896098 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:15.896084 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 13:08:15.896422 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:15.896409 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 13:08:15.897165 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:15.897151 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 13:08:15.897644 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:15.897628 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 13:08:15.934162 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:15.934135 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n"] Jun 10 13:08:16.047882 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.047848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5mxg\" (UniqueName: \"kubernetes.io/projected/358477f2-f610-47ed-9473-16192ac982ae-kube-api-access-j5mxg\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.047882 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.047885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/358477f2-f610-47ed-9473-16192ac982ae-tmp\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.048091 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.047907 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/358477f2-f610-47ed-9473-16192ac982ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.048091 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.047974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/358477f2-f610-47ed-9473-16192ac982ae-manifests\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.048091 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.048043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/358477f2-f610-47ed-9473-16192ac982ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.148951 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.148868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5mxg\" (UniqueName: \"kubernetes.io/projected/358477f2-f610-47ed-9473-16192ac982ae-kube-api-access-j5mxg\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.148951 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.148906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/358477f2-f610-47ed-9473-16192ac982ae-tmp\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.148951 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.148931 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/358477f2-f610-47ed-9473-16192ac982ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.149221 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.149070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/358477f2-f610-47ed-9473-16192ac982ae-manifests\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.149221 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.149167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/358477f2-f610-47ed-9473-16192ac982ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.149444 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.149422 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/358477f2-f610-47ed-9473-16192ac982ae-manifests\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.151270 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.151248 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/358477f2-f610-47ed-9473-16192ac982ae-tmp\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.151362 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.151351 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/358477f2-f610-47ed-9473-16192ac982ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.151419 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.151383 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/358477f2-f610-47ed-9473-16192ac982ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.160097 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.160070 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5mxg\" (UniqueName: \"kubernetes.io/projected/358477f2-f610-47ed-9473-16192ac982ae-kube-api-access-j5mxg\") pod \"opendatahub-operator-controller-manager-798cb5c965-5sl8n\" (UID: \"358477f2-f610-47ed-9473-16192ac982ae\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.201812 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.201785 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:16.337230 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:16.337199 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n"] Jun 10 13:08:16.340571 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:08:16.340542 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358477f2_f610_47ed_9473_16192ac982ae.slice/crio-7e6ee9e8d7f5b08b6ab8572182f4ddd5a22669c03269d24391ab923c682a2b40 WatchSource:0}: Error finding container 7e6ee9e8d7f5b08b6ab8572182f4ddd5a22669c03269d24391ab923c682a2b40: Status 404 returned error can't find the container with id 7e6ee9e8d7f5b08b6ab8572182f4ddd5a22669c03269d24391ab923c682a2b40 Jun 10 13:08:17.262071 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:17.262032 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" event={"ID":"358477f2-f610-47ed-9473-16192ac982ae","Type":"ContainerStarted","Data":"7e6ee9e8d7f5b08b6ab8572182f4ddd5a22669c03269d24391ab923c682a2b40"} Jun 10 13:08:19.275964 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:19.275931 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" event={"ID":"358477f2-f610-47ed-9473-16192ac982ae","Type":"ContainerStarted","Data":"69fa5ad37098596a2abf50d8a6ab455b8e2a8540699c90542e3e5bbd03b36022"} Jun 10 13:08:20.282269 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:20.282228 2580 generic.go:356] "Generic (PLEG): container finished" podID="358477f2-f610-47ed-9473-16192ac982ae" containerID="69fa5ad37098596a2abf50d8a6ab455b8e2a8540699c90542e3e5bbd03b36022" exitCode=0 Jun 10 13:08:20.282634 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:20.282304 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" event={"ID":"358477f2-f610-47ed-9473-16192ac982ae","Type":"ContainerDied","Data":"69fa5ad37098596a2abf50d8a6ab455b8e2a8540699c90542e3e5bbd03b36022"} Jun 10 13:08:21.288414 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:21.288373 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" event={"ID":"358477f2-f610-47ed-9473-16192ac982ae","Type":"ContainerStarted","Data":"d3ea2945b82ebc6d5b5d29326b91405252b7612590044a96d780bff29451f689"} Jun 10 13:08:21.288839 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:21.288530 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:21.333266 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:21.333215 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" podStartSLOduration=2.219391195 podStartE2EDuration="6.333199467s" totalImagesPullingTime="3.049293534s" totalInitContainerRuntime="1.064514738s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:21.330410017 +0000 UTC m=+293.037026610" watchObservedRunningTime="2026-06-10 13:08:21.333199467 +0000 UTC m=+293.039816064" Jun 10 13:08:28.724273 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:28.724245 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:08:28.727770 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:28.727739 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:08:28.729601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:28.729576 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:08:28.733160 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:28.733143 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:08:28.734972 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:28.734954 2580 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 13:08:32.294373 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:32.294337 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-5sl8n" Jun 10 13:08:35.342525 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.342471 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59df986db4-zd4gl"] Jun 10 13:08:35.347025 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.347002 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:35.350852 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.350613 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-k9mwk\"" Jun 10 13:08:35.350852 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.350656 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 13:08:35.354521 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.351547 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 13:08:35.368208 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.368183 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59df986db4-zd4gl"] Jun 10 13:08:35.411102 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.411063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh97s\" (UniqueName: \"kubernetes.io/projected/71bae032-b343-4f55-9ec2-8b3ca2f39d51-kube-api-access-lh97s\") pod \"kube-auth-proxy-59df986db4-zd4gl\" (UID: \"71bae032-b343-4f55-9ec2-8b3ca2f39d51\") " pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:35.411282 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.411136 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71bae032-b343-4f55-9ec2-8b3ca2f39d51-tmp\") pod \"kube-auth-proxy-59df986db4-zd4gl\" (UID: \"71bae032-b343-4f55-9ec2-8b3ca2f39d51\") " pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:35.411282 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.411165 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71bae032-b343-4f55-9ec2-8b3ca2f39d51-tls-certs\") pod \"kube-auth-proxy-59df986db4-zd4gl\" (UID: \"71bae032-b343-4f55-9ec2-8b3ca2f39d51\") " pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:35.434659 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.434621 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-llhsd"] Jun 10 13:08:35.438011 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.437989 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" Jun 10 13:08:35.441150 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.441122 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 13:08:35.441150 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.441132 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fzn5r\"" Jun 10 13:08:35.448281 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.448257 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-llhsd"] Jun 10 13:08:35.511694 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.511648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71bae032-b343-4f55-9ec2-8b3ca2f39d51-tmp\") pod \"kube-auth-proxy-59df986db4-zd4gl\" (UID: \"71bae032-b343-4f55-9ec2-8b3ca2f39d51\") " pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:35.511957 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.511937 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fe1c9f-470e-42a2-b599-fee73fc30c77-cert\") pod \"odh-model-controller-6dc94f689f-llhsd\" (UID: \"86fe1c9f-470e-42a2-b599-fee73fc30c77\") " pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" Jun 10 13:08:35.512096 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.512078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71bae032-b343-4f55-9ec2-8b3ca2f39d51-tls-certs\") pod \"kube-auth-proxy-59df986db4-zd4gl\" (UID: \"71bae032-b343-4f55-9ec2-8b3ca2f39d51\") " pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:35.512178 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.512155 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh97s\" (UniqueName: \"kubernetes.io/projected/71bae032-b343-4f55-9ec2-8b3ca2f39d51-kube-api-access-lh97s\") pod \"kube-auth-proxy-59df986db4-zd4gl\" (UID: \"71bae032-b343-4f55-9ec2-8b3ca2f39d51\") " pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:35.512237 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.512221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m27ph\" (UniqueName: \"kubernetes.io/projected/86fe1c9f-470e-42a2-b599-fee73fc30c77-kube-api-access-m27ph\") pod \"odh-model-controller-6dc94f689f-llhsd\" (UID: \"86fe1c9f-470e-42a2-b599-fee73fc30c77\") " pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" Jun 10 13:08:35.512289 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:08:35.512268 2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 10 13:08:35.512369 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:08:35.512353 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71bae032-b343-4f55-9ec2-8b3ca2f39d51-tls-certs podName:71bae032-b343-4f55-9ec2-8b3ca2f39d51 nodeName:}" failed. No retries permitted until 2026-06-10 13:08:36.012329358 +0000 UTC m=+307.718945944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/71bae032-b343-4f55-9ec2-8b3ca2f39d51-tls-certs") pod "kube-auth-proxy-59df986db4-zd4gl" (UID: "71bae032-b343-4f55-9ec2-8b3ca2f39d51") : secret "kube-auth-proxy-tls" not found Jun 10 13:08:35.514793 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.514768 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71bae032-b343-4f55-9ec2-8b3ca2f39d51-tmp\") pod \"kube-auth-proxy-59df986db4-zd4gl\" (UID: \"71bae032-b343-4f55-9ec2-8b3ca2f39d51\") " pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:35.529084 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.529055 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh97s\" (UniqueName: \"kubernetes.io/projected/71bae032-b343-4f55-9ec2-8b3ca2f39d51-kube-api-access-lh97s\") pod \"kube-auth-proxy-59df986db4-zd4gl\" (UID: \"71bae032-b343-4f55-9ec2-8b3ca2f39d51\") " pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:35.612921 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.612826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m27ph\" (UniqueName: \"kubernetes.io/projected/86fe1c9f-470e-42a2-b599-fee73fc30c77-kube-api-access-m27ph\") pod \"odh-model-controller-6dc94f689f-llhsd\" (UID: \"86fe1c9f-470e-42a2-b599-fee73fc30c77\") " pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" Jun 10 13:08:35.613091 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.612925 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fe1c9f-470e-42a2-b599-fee73fc30c77-cert\") pod \"odh-model-controller-6dc94f689f-llhsd\" (UID: \"86fe1c9f-470e-42a2-b599-fee73fc30c77\") " pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" Jun 10 13:08:35.613091 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:08:35.613059 2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 10 13:08:35.613207 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:08:35.613118 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fe1c9f-470e-42a2-b599-fee73fc30c77-cert podName:86fe1c9f-470e-42a2-b599-fee73fc30c77 nodeName:}" failed. No retries permitted until 2026-06-10 13:08:36.113099712 +0000 UTC m=+307.819716290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86fe1c9f-470e-42a2-b599-fee73fc30c77-cert") pod "odh-model-controller-6dc94f689f-llhsd" (UID: "86fe1c9f-470e-42a2-b599-fee73fc30c77") : secret "odh-model-controller-webhook-cert" not found Jun 10 13:08:35.632979 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:35.632943 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m27ph\" (UniqueName: \"kubernetes.io/projected/86fe1c9f-470e-42a2-b599-fee73fc30c77-kube-api-access-m27ph\") pod \"odh-model-controller-6dc94f689f-llhsd\" (UID: \"86fe1c9f-470e-42a2-b599-fee73fc30c77\") " pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" Jun 10 13:08:36.017249 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.017211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71bae032-b343-4f55-9ec2-8b3ca2f39d51-tls-certs\") pod \"kube-auth-proxy-59df986db4-zd4gl\" (UID: \"71bae032-b343-4f55-9ec2-8b3ca2f39d51\") " pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:36.019812 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.019777 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71bae032-b343-4f55-9ec2-8b3ca2f39d51-tls-certs\") pod \"kube-auth-proxy-59df986db4-zd4gl\" (UID: \"71bae032-b343-4f55-9ec2-8b3ca2f39d51\") " pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:36.117839 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.117799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fe1c9f-470e-42a2-b599-fee73fc30c77-cert\") pod \"odh-model-controller-6dc94f689f-llhsd\" (UID: \"86fe1c9f-470e-42a2-b599-fee73fc30c77\") " pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" Jun 10 13:08:36.120432 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.120402 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86fe1c9f-470e-42a2-b599-fee73fc30c77-cert\") pod \"odh-model-controller-6dc94f689f-llhsd\" (UID: \"86fe1c9f-470e-42a2-b599-fee73fc30c77\") " pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" Jun 10 13:08:36.265070 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.265038 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" Jun 10 13:08:36.277267 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.277240 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4lqbx"] Jun 10 13:08:36.280576 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.280512 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" Jun 10 13:08:36.285182 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.285157 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-dlbtp\"" Jun 10 13:08:36.285647 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.285627 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 13:08:36.305804 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.305774 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4lqbx"] Jun 10 13:08:36.319904 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.319868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87wd2\" (UniqueName: \"kubernetes.io/projected/21c20727-39a9-4996-9de3-bf435a58fc3e-kube-api-access-87wd2\") pod \"model-serving-api-5dd488fc48-4lqbx\" (UID: \"21c20727-39a9-4996-9de3-bf435a58fc3e\") " pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" Jun 10 13:08:36.320082 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.319936 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21c20727-39a9-4996-9de3-bf435a58fc3e-tls-certs\") pod \"model-serving-api-5dd488fc48-4lqbx\" (UID: \"21c20727-39a9-4996-9de3-bf435a58fc3e\") " pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" Jun 10 13:08:36.351089 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.350848 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" Jun 10 13:08:36.420534 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.420455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87wd2\" (UniqueName: \"kubernetes.io/projected/21c20727-39a9-4996-9de3-bf435a58fc3e-kube-api-access-87wd2\") pod \"model-serving-api-5dd488fc48-4lqbx\" (UID: \"21c20727-39a9-4996-9de3-bf435a58fc3e\") " pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" Jun 10 13:08:36.420534 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.420534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21c20727-39a9-4996-9de3-bf435a58fc3e-tls-certs\") pod \"model-serving-api-5dd488fc48-4lqbx\" (UID: \"21c20727-39a9-4996-9de3-bf435a58fc3e\") " pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" Jun 10 13:08:36.420736 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:08:36.420657 2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 10 13:08:36.420736 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:08:36.420714 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c20727-39a9-4996-9de3-bf435a58fc3e-tls-certs podName:21c20727-39a9-4996-9de3-bf435a58fc3e nodeName:}" failed. No retries permitted until 2026-06-10 13:08:36.920694764 +0000 UTC m=+308.627311336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/21c20727-39a9-4996-9de3-bf435a58fc3e-tls-certs") pod "model-serving-api-5dd488fc48-4lqbx" (UID: "21c20727-39a9-4996-9de3-bf435a58fc3e") : secret "model-serving-api-tls" not found Jun 10 13:08:36.440683 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.440655 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59df986db4-zd4gl"] Jun 10 13:08:36.442871 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:08:36.442828 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71bae032_b343_4f55_9ec2_8b3ca2f39d51.slice/crio-1cc549f799c20401494e3785cd60929c48c83141766efb116ae6f6607be1367b WatchSource:0}: Error finding container 1cc549f799c20401494e3785cd60929c48c83141766efb116ae6f6607be1367b: Status 404 returned error can't find the container with id 1cc549f799c20401494e3785cd60929c48c83141766efb116ae6f6607be1367b Jun 10 13:08:36.442985 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.442944 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87wd2\" (UniqueName: \"kubernetes.io/projected/21c20727-39a9-4996-9de3-bf435a58fc3e-kube-api-access-87wd2\") pod \"model-serving-api-5dd488fc48-4lqbx\" (UID: \"21c20727-39a9-4996-9de3-bf435a58fc3e\") " pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" Jun 10 13:08:36.444757 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.444743 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:08:36.501072 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.501047 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-llhsd"] Jun 10 13:08:36.503965 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:08:36.503926 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fe1c9f_470e_42a2_b599_fee73fc30c77.slice/crio-1344053541e737da03e02905df7a9465736788521b72fb8458312b513f6f5599 WatchSource:0}: Error finding container 1344053541e737da03e02905df7a9465736788521b72fb8458312b513f6f5599: Status 404 returned error can't find the container with id 1344053541e737da03e02905df7a9465736788521b72fb8458312b513f6f5599 Jun 10 13:08:36.924446 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.924409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21c20727-39a9-4996-9de3-bf435a58fc3e-tls-certs\") pod \"model-serving-api-5dd488fc48-4lqbx\" (UID: \"21c20727-39a9-4996-9de3-bf435a58fc3e\") " pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" Jun 10 13:08:36.926834 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:36.926804 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21c20727-39a9-4996-9de3-bf435a58fc3e-tls-certs\") pod \"model-serving-api-5dd488fc48-4lqbx\" (UID: \"21c20727-39a9-4996-9de3-bf435a58fc3e\") " pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" Jun 10 13:08:37.194261 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:37.194171 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" Jun 10 13:08:37.366780 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:37.365261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" event={"ID":"86fe1c9f-470e-42a2-b599-fee73fc30c77","Type":"ContainerStarted","Data":"1344053541e737da03e02905df7a9465736788521b72fb8458312b513f6f5599"} Jun 10 13:08:37.368810 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:37.367312 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" event={"ID":"71bae032-b343-4f55-9ec2-8b3ca2f39d51","Type":"ContainerStarted","Data":"1cc549f799c20401494e3785cd60929c48c83141766efb116ae6f6607be1367b"} Jun 10 13:08:37.396648 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:37.396612 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4lqbx"] Jun 10 13:08:37.403104 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:08:37.403045 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c20727_39a9_4996_9de3_bf435a58fc3e.slice/crio-eea3de102825421736f73960deff8cdd29fa2e497c3bc498a2e21cb341f53e00 WatchSource:0}: Error finding container eea3de102825421736f73960deff8cdd29fa2e497c3bc498a2e21cb341f53e00: Status 404 returned error can't find the container with id eea3de102825421736f73960deff8cdd29fa2e497c3bc498a2e21cb341f53e00 Jun 10 13:08:38.377966 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:38.377917 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" event={"ID":"21c20727-39a9-4996-9de3-bf435a58fc3e","Type":"ContainerStarted","Data":"eea3de102825421736f73960deff8cdd29fa2e497c3bc498a2e21cb341f53e00"} Jun 10 13:08:42.405024 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:42.404988 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" event={"ID":"21c20727-39a9-4996-9de3-bf435a58fc3e","Type":"ContainerStarted","Data":"57597b08e936580edf9ead84fe2a6200a8f28935923c4bc444dad1e7ae92d14e"} Jun 10 13:08:42.405584 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:42.405057 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" Jun 10 13:08:42.406599 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:42.406573 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" event={"ID":"86fe1c9f-470e-42a2-b599-fee73fc30c77","Type":"ContainerStarted","Data":"553fc2655fdf3663a1222be75d13a084384fa66e7d65426b8c7ed046ba444855"} Jun 10 13:08:42.406717 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:42.406628 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" Jun 10 13:08:42.407984 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:42.407964 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" event={"ID":"71bae032-b343-4f55-9ec2-8b3ca2f39d51","Type":"ContainerStarted","Data":"e673d14f7fc2d1aa2d712ef561b11ef705293577d76f6705f5527d5d12702e76"} Jun 10 13:08:42.435559 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:42.435496 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" podStartSLOduration=2.316455371 podStartE2EDuration="6.43548342s" totalImagesPullingTime="4.119028049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:42.433984109 +0000 UTC m=+314.140600705" watchObservedRunningTime="2026-06-10 13:08:42.43548342 +0000 UTC m=+314.142100005" Jun 10 13:08:42.459064 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:42.459008 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59df986db4-zd4gl" podStartSLOduration=2.3833209379999998 podStartE2EDuration="7.458991788s" totalImagesPullingTime="5.07567085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:42.457799156 +0000 UTC m=+314.164415750" watchObservedRunningTime="2026-06-10 13:08:42.458991788 +0000 UTC m=+314.165608381" Jun 10 13:08:42.482344 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:42.482295 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" podStartSLOduration=2.456369656 podStartE2EDuration="7.48228036s" totalImagesPullingTime="5.025910704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:42.481921497 +0000 UTC m=+314.188538107" watchObservedRunningTime="2026-06-10 13:08:42.48228036 +0000 UTC m=+314.188896953" Jun 10 13:08:46.605547 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:46.605494 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ftx5f"] Jun 10 13:08:46.609157 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:46.609136 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" Jun 10 13:08:46.611916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:46.611896 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 13:08:46.612032 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:46.611965 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9jzz9\"" Jun 10 13:08:46.619477 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:46.619455 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ftx5f"] Jun 10 13:08:46.712274 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:46.712238 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nhrl\" (UniqueName: \"kubernetes.io/projected/495b2bd0-f81d-437a-9726-4ecfc29cb3bb-kube-api-access-4nhrl\") pod \"kserve-controller-manager-69fc866d76-ftx5f\" (UID: \"495b2bd0-f81d-437a-9726-4ecfc29cb3bb\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" Jun 10 13:08:46.712454 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:46.712304 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/495b2bd0-f81d-437a-9726-4ecfc29cb3bb-cert\") pod \"kserve-controller-manager-69fc866d76-ftx5f\" (UID: \"495b2bd0-f81d-437a-9726-4ecfc29cb3bb\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" Jun 10 13:08:46.813830 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:46.813792 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/495b2bd0-f81d-437a-9726-4ecfc29cb3bb-cert\") pod \"kserve-controller-manager-69fc866d76-ftx5f\" (UID: \"495b2bd0-f81d-437a-9726-4ecfc29cb3bb\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" Jun 10 13:08:46.814018 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:46.813877 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nhrl\" (UniqueName: \"kubernetes.io/projected/495b2bd0-f81d-437a-9726-4ecfc29cb3bb-kube-api-access-4nhrl\") pod \"kserve-controller-manager-69fc866d76-ftx5f\" (UID: \"495b2bd0-f81d-437a-9726-4ecfc29cb3bb\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" Jun 10 13:08:46.814018 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:08:46.813964 2580 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 10 13:08:46.814100 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:08:46.814041 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/495b2bd0-f81d-437a-9726-4ecfc29cb3bb-cert podName:495b2bd0-f81d-437a-9726-4ecfc29cb3bb nodeName:}" failed. No retries permitted until 2026-06-10 13:08:47.314019021 +0000 UTC m=+319.020635596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/495b2bd0-f81d-437a-9726-4ecfc29cb3bb-cert") pod "kserve-controller-manager-69fc866d76-ftx5f" (UID: "495b2bd0-f81d-437a-9726-4ecfc29cb3bb") : secret "kserve-webhook-server-cert" not found Jun 10 13:08:46.840411 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:46.840372 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nhrl\" (UniqueName: \"kubernetes.io/projected/495b2bd0-f81d-437a-9726-4ecfc29cb3bb-kube-api-access-4nhrl\") pod \"kserve-controller-manager-69fc866d76-ftx5f\" (UID: \"495b2bd0-f81d-437a-9726-4ecfc29cb3bb\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" Jun 10 13:08:47.320593 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:47.320548 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/495b2bd0-f81d-437a-9726-4ecfc29cb3bb-cert\") pod \"kserve-controller-manager-69fc866d76-ftx5f\" (UID: \"495b2bd0-f81d-437a-9726-4ecfc29cb3bb\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" Jun 10 13:08:47.322942 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:47.322922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/495b2bd0-f81d-437a-9726-4ecfc29cb3bb-cert\") pod \"kserve-controller-manager-69fc866d76-ftx5f\" (UID: \"495b2bd0-f81d-437a-9726-4ecfc29cb3bb\") " pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" Jun 10 13:08:47.519897 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:47.519866 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" Jun 10 13:08:47.653614 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:47.653585 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-ftx5f"] Jun 10 13:08:47.655642 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:08:47.655617 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495b2bd0_f81d_437a_9726_4ecfc29cb3bb.slice/crio-ef2bd5f045208e791a5cc5638ee2ec101bd7bfc48baaa97341a89ccb35ffad04 WatchSource:0}: Error finding container ef2bd5f045208e791a5cc5638ee2ec101bd7bfc48baaa97341a89ccb35ffad04: Status 404 returned error can't find the container with id ef2bd5f045208e791a5cc5638ee2ec101bd7bfc48baaa97341a89ccb35ffad04 Jun 10 13:08:48.440616 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:48.440579 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" event={"ID":"495b2bd0-f81d-437a-9726-4ecfc29cb3bb","Type":"ContainerStarted","Data":"ef2bd5f045208e791a5cc5638ee2ec101bd7bfc48baaa97341a89ccb35ffad04"} Jun 10 13:08:50.452733 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:50.452695 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" event={"ID":"495b2bd0-f81d-437a-9726-4ecfc29cb3bb","Type":"ContainerStarted","Data":"4f29ae89bc94adfd3fade8d90931b5a79aaebca2cfae4eff94041ea604710ca3"} Jun 10 13:08:50.453139 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:50.452848 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" Jun 10 13:08:50.497898 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:50.497843 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" podStartSLOduration=2.334571407 podStartE2EDuration="4.497824763s" totalImagesPullingTime="2.163253356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:50.495875515 +0000 UTC m=+322.202492110" watchObservedRunningTime="2026-06-10 13:08:50.497824763 +0000 UTC m=+322.204441357" Jun 10 13:08:52.601109 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.601076 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-b7g84"] Jun 10 13:08:52.604451 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.604436 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" Jun 10 13:08:52.608355 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.608329 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 13:08:52.608498 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.608332 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 13:08:52.608498 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.608402 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-tglpj\"" Jun 10 13:08:52.633252 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.633229 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-b7g84"] Jun 10 13:08:52.668946 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.668915 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1d285e23-f031-4cf7-883f-1b392ef1092b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-b7g84\" (UID: \"1d285e23-f031-4cf7-883f-1b392ef1092b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" Jun 10 13:08:52.669122 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.668978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kct4k\" (UniqueName: \"kubernetes.io/projected/1d285e23-f031-4cf7-883f-1b392ef1092b-kube-api-access-kct4k\") pod \"servicemesh-operator3-57f65f65fb-b7g84\" (UID: \"1d285e23-f031-4cf7-883f-1b392ef1092b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" Jun 10 13:08:52.769773 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.769730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1d285e23-f031-4cf7-883f-1b392ef1092b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-b7g84\" (UID: \"1d285e23-f031-4cf7-883f-1b392ef1092b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" Jun 10 13:08:52.769981 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.769819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kct4k\" (UniqueName: \"kubernetes.io/projected/1d285e23-f031-4cf7-883f-1b392ef1092b-kube-api-access-kct4k\") pod \"servicemesh-operator3-57f65f65fb-b7g84\" (UID: \"1d285e23-f031-4cf7-883f-1b392ef1092b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" Jun 10 13:08:52.772393 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.772365 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1d285e23-f031-4cf7-883f-1b392ef1092b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-b7g84\" (UID: \"1d285e23-f031-4cf7-883f-1b392ef1092b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" Jun 10 13:08:52.782441 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.782411 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kct4k\" (UniqueName: \"kubernetes.io/projected/1d285e23-f031-4cf7-883f-1b392ef1092b-kube-api-access-kct4k\") pod \"servicemesh-operator3-57f65f65fb-b7g84\" (UID: \"1d285e23-f031-4cf7-883f-1b392ef1092b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" Jun 10 13:08:52.914052 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:52.913966 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" Jun 10 13:08:53.058916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:53.058887 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-b7g84"] Jun 10 13:08:53.060266 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:08:53.060239 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d285e23_f031_4cf7_883f_1b392ef1092b.slice/crio-d01c62429f49a5146e5a28f9792086d1783c385492cc717e8b5816a64c210520 WatchSource:0}: Error finding container d01c62429f49a5146e5a28f9792086d1783c385492cc717e8b5816a64c210520: Status 404 returned error can't find the container with id d01c62429f49a5146e5a28f9792086d1783c385492cc717e8b5816a64c210520 Jun 10 13:08:53.414717 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:53.414691 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-llhsd" Jun 10 13:08:53.416759 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:53.416738 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-4lqbx" Jun 10 13:08:53.468457 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:53.468421 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" event={"ID":"1d285e23-f031-4cf7-883f-1b392ef1092b","Type":"ContainerStarted","Data":"d01c62429f49a5146e5a28f9792086d1783c385492cc717e8b5816a64c210520"} Jun 10 13:08:56.490328 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:56.490290 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" event={"ID":"1d285e23-f031-4cf7-883f-1b392ef1092b","Type":"ContainerStarted","Data":"a5224dcc96cb2f6c881ae17ab556fbe9be462f989d3b81fac47ab50e514ad40f"} Jun 10 13:08:56.490745 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:56.490382 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" Jun 10 13:08:56.518794 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:08:56.518741 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" podStartSLOduration=2.1285046 podStartE2EDuration="4.518725168s" totalImagesPullingTime="2.390220568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:56.517895412 +0000 UTC m=+328.224512007" watchObservedRunningTime="2026-06-10 13:08:56.518725168 +0000 UTC m=+328.225341765" Jun 10 13:09:01.598514 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.598468 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd"] Jun 10 13:09:01.602029 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.602009 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.605492 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.605469 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 13:09:01.605629 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.605559 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 13:09:01.605629 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.605533 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 13:09:01.605629 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.605470 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 13:09:01.605788 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.605537 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jnxg2\"" Jun 10 13:09:01.617576 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.617548 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd"] Jun 10 13:09:01.748953 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.748917 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.749126 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.748980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.749126 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.749059 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqgfh\" (UniqueName: \"kubernetes.io/projected/ffacb045-d476-4b06-aeec-6991ef2418ef-kube-api-access-cqgfh\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.749126 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.749116 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffacb045-d476-4b06-aeec-6991ef2418ef-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.749305 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.749179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ffacb045-d476-4b06-aeec-6991ef2418ef-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.749305 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.749205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.749305 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.749243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.850719 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.850621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.850719 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.850661 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqgfh\" (UniqueName: \"kubernetes.io/projected/ffacb045-d476-4b06-aeec-6991ef2418ef-kube-api-access-cqgfh\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.850719 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.850686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffacb045-d476-4b06-aeec-6991ef2418ef-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.850980 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.850728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ffacb045-d476-4b06-aeec-6991ef2418ef-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.850980 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.850751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.850980 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.850787 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.850980 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.850834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.851875 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.851840 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.853141 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.853107 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffacb045-d476-4b06-aeec-6991ef2418ef-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.853358 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.853336 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.853562 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.853541 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.853868 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.853849 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ffacb045-d476-4b06-aeec-6991ef2418ef-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.861170 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.861140 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqgfh\" (UniqueName: \"kubernetes.io/projected/ffacb045-d476-4b06-aeec-6991ef2418ef-kube-api-access-cqgfh\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.861266 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.861213 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffacb045-d476-4b06-aeec-6991ef2418ef-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-jttmd\" (UID: \"ffacb045-d476-4b06-aeec-6991ef2418ef\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:01.912395 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:01.912354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:02.060296 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:02.060226 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd"] Jun 10 13:09:02.062454 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:09:02.062426 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffacb045_d476_4b06_aeec_6991ef2418ef.slice/crio-6d6b25e6b7847bff190590a2620540435290f0fafb469bfe0f9c2a36892da24c WatchSource:0}: Error finding container 6d6b25e6b7847bff190590a2620540435290f0fafb469bfe0f9c2a36892da24c: Status 404 returned error can't find the container with id 6d6b25e6b7847bff190590a2620540435290f0fafb469bfe0f9c2a36892da24c Jun 10 13:09:02.519333 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:02.519298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" event={"ID":"ffacb045-d476-4b06-aeec-6991ef2418ef","Type":"ContainerStarted","Data":"6d6b25e6b7847bff190590a2620540435290f0fafb469bfe0f9c2a36892da24c"} Jun 10 13:09:05.304740 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:05.304701 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 13:09:05.305043 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:05.304772 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 13:09:05.536325 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:05.536285 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" event={"ID":"ffacb045-d476-4b06-aeec-6991ef2418ef","Type":"ContainerStarted","Data":"137903f04b0884c9d952ec0d1be86b0b5d7e1b754b08832dc75a5dde49e512a1"} Jun 10 13:09:05.536539 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:05.536468 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:05.565628 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:05.565497 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" podStartSLOduration=1.325492752 podStartE2EDuration="4.565476183s" totalImagesPullingTime="3.239983431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:09:05.561970392 +0000 UTC m=+337.268586984" watchObservedRunningTime="2026-06-10 13:09:05.565476183 +0000 UTC m=+337.272092778" Jun 10 13:09:06.542364 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:06.542327 2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-jttmd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 10 13:09:06.542745 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:06.542389 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" podUID="ffacb045-d476-4b06-aeec-6991ef2418ef" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:09:07.498311 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:07.498275 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-b7g84" Jun 10 13:09:09.541431 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:09.541397 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jttmd" Jun 10 13:09:21.462442 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:09:21.462366 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-ftx5f" Jun 10 13:10:07.492450 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:07.492414 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q"] Jun 10 13:10:07.495817 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:07.495800 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q" Jun 10 13:10:07.499753 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:07.499732 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 13:10:07.499869 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:07.499767 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-kfltn\"" Jun 10 13:10:07.501058 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:07.501036 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 13:10:07.507830 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:07.507811 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q"] Jun 10 13:10:07.613077 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:07.613045 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk8v2\" (UniqueName: \"kubernetes.io/projected/86971a32-f14e-451e-8662-5b14ac2701a7-kube-api-access-dk8v2\") pod \"authorino-operator-75cc8d5cb7-rnh8q\" (UID: \"86971a32-f14e-451e-8662-5b14ac2701a7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q" Jun 10 13:10:07.713887 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:07.713857 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8v2\" (UniqueName: \"kubernetes.io/projected/86971a32-f14e-451e-8662-5b14ac2701a7-kube-api-access-dk8v2\") pod \"authorino-operator-75cc8d5cb7-rnh8q\" (UID: \"86971a32-f14e-451e-8662-5b14ac2701a7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q" Jun 10 13:10:07.734442 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:07.734408 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk8v2\" (UniqueName: \"kubernetes.io/projected/86971a32-f14e-451e-8662-5b14ac2701a7-kube-api-access-dk8v2\") pod \"authorino-operator-75cc8d5cb7-rnh8q\" (UID: \"86971a32-f14e-451e-8662-5b14ac2701a7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q" Jun 10 13:10:07.806798 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:07.806719 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q" Jun 10 13:10:07.940750 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:07.940720 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q"] Jun 10 13:10:07.942762 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:10:07.942726 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86971a32_f14e_451e_8662_5b14ac2701a7.slice/crio-cda0936cbf048cc0e067c415d438e33a05d6c4991313ea79f945a8dddf971883 WatchSource:0}: Error finding container cda0936cbf048cc0e067c415d438e33a05d6c4991313ea79f945a8dddf971883: Status 404 returned error can't find the container with id cda0936cbf048cc0e067c415d438e33a05d6c4991313ea79f945a8dddf971883 Jun 10 13:10:08.824216 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:08.824183 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q" event={"ID":"86971a32-f14e-451e-8662-5b14ac2701a7","Type":"ContainerStarted","Data":"cda0936cbf048cc0e067c415d438e33a05d6c4991313ea79f945a8dddf971883"} Jun 10 13:10:10.836096 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:10.836062 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q" event={"ID":"86971a32-f14e-451e-8662-5b14ac2701a7","Type":"ContainerStarted","Data":"a9603d07576709499a838621ef701266d2ebda0127eaefd24044260606789f54"} Jun 10 13:10:10.836600 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:10.836193 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q" Jun 10 13:10:10.856721 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:10.856675 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q" podStartSLOduration=1.44771376 podStartE2EDuration="3.856660772s" totalImagesPullingTime="2.408947012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:10:10.85456398 +0000 UTC m=+402.561180573" watchObservedRunningTime="2026-06-10 13:10:10.856660772 +0000 UTC m=+402.563277366" Jun 10 13:10:21.843241 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:21.843202 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rnh8q" Jun 10 13:10:58.432044 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.431956 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:10:58.435456 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.435428 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" Jun 10 13:10:58.438650 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.438626 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 13:10:58.439369 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.439353 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6np7p\"" Jun 10 13:10:58.447712 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.447690 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:10:58.491167 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.491142 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:10:58.555274 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.555249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/296b6bdd-0b7e-4ba0-8a84-6c117bebec0e-config-file\") pod \"limitador-limitador-54d6d988d5-q92kb\" (UID: \"296b6bdd-0b7e-4ba0-8a84-6c117bebec0e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" Jun 10 13:10:58.555387 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.555277 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69kmc\" (UniqueName: \"kubernetes.io/projected/296b6bdd-0b7e-4ba0-8a84-6c117bebec0e-kube-api-access-69kmc\") pod \"limitador-limitador-54d6d988d5-q92kb\" (UID: \"296b6bdd-0b7e-4ba0-8a84-6c117bebec0e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" Jun 10 13:10:58.655975 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.655940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/296b6bdd-0b7e-4ba0-8a84-6c117bebec0e-config-file\") pod \"limitador-limitador-54d6d988d5-q92kb\" (UID: \"296b6bdd-0b7e-4ba0-8a84-6c117bebec0e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" Jun 10 13:10:58.656164 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.655986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kmc\" (UniqueName: \"kubernetes.io/projected/296b6bdd-0b7e-4ba0-8a84-6c117bebec0e-kube-api-access-69kmc\") pod \"limitador-limitador-54d6d988d5-q92kb\" (UID: \"296b6bdd-0b7e-4ba0-8a84-6c117bebec0e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" Jun 10 13:10:58.656825 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.656799 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/296b6bdd-0b7e-4ba0-8a84-6c117bebec0e-config-file\") pod \"limitador-limitador-54d6d988d5-q92kb\" (UID: \"296b6bdd-0b7e-4ba0-8a84-6c117bebec0e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" Jun 10 13:10:58.667165 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.667141 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69kmc\" (UniqueName: \"kubernetes.io/projected/296b6bdd-0b7e-4ba0-8a84-6c117bebec0e-kube-api-access-69kmc\") pod \"limitador-limitador-54d6d988d5-q92kb\" (UID: \"296b6bdd-0b7e-4ba0-8a84-6c117bebec0e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" Jun 10 13:10:58.746009 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.745978 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" Jun 10 13:10:58.886445 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:58.886329 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:10:58.888941 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:10:58.888894 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod296b6bdd_0b7e_4ba0_8a84_6c117bebec0e.slice/crio-3702a9900fbe74816e58103167fe52fe93f25734d1ce08e9c62cf4b281451811 WatchSource:0}: Error finding container 3702a9900fbe74816e58103167fe52fe93f25734d1ce08e9c62cf4b281451811: Status 404 returned error can't find the container with id 3702a9900fbe74816e58103167fe52fe93f25734d1ce08e9c62cf4b281451811 Jun 10 13:10:59.054769 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:10:59.054679 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" event={"ID":"296b6bdd-0b7e-4ba0-8a84-6c117bebec0e","Type":"ContainerStarted","Data":"3702a9900fbe74816e58103167fe52fe93f25734d1ce08e9c62cf4b281451811"} Jun 10 13:11:02.072740 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:11:02.072703 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" event={"ID":"296b6bdd-0b7e-4ba0-8a84-6c117bebec0e","Type":"ContainerStarted","Data":"a630ba65ba81ef25eb475cca234f4921ba5c8351631c3af83c93503b3bb1db24"} Jun 10 13:11:02.073116 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:11:02.072799 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" Jun 10 13:11:02.107585 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:11:02.107535 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" podStartSLOduration=1.690565367 podStartE2EDuration="4.10752119s" totalImagesPullingTime="2.416955823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:11:02.106778374 +0000 UTC m=+453.813394969" watchObservedRunningTime="2026-06-10 13:11:02.10752119 +0000 UTC m=+453.814137807" Jun 10 13:11:13.078378 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:11:13.078342 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-q92kb" Jun 10 13:13:06.954942 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:06.954906 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-87c574948-t4xs2"] Jun 10 13:13:06.958205 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:06.958189 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-87c574948-t4xs2" Jun 10 13:13:06.961052 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:06.961031 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 10 13:13:06.969668 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:06.969646 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-87c574948-t4xs2"] Jun 10 13:13:07.038286 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.038252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d9faea-dd2a-4e16-8533-01d515275fb7-maas-api-tls\") pod \"maas-api-87c574948-t4xs2\" (UID: \"f3d9faea-dd2a-4e16-8533-01d515275fb7\") " pod="opendatahub/maas-api-87c574948-t4xs2" Jun 10 13:13:07.038427 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.038310 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skgbd\" (UniqueName: \"kubernetes.io/projected/f3d9faea-dd2a-4e16-8533-01d515275fb7-kube-api-access-skgbd\") pod \"maas-api-87c574948-t4xs2\" (UID: \"f3d9faea-dd2a-4e16-8533-01d515275fb7\") " pod="opendatahub/maas-api-87c574948-t4xs2" Jun 10 13:13:07.139026 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.138993 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skgbd\" (UniqueName: \"kubernetes.io/projected/f3d9faea-dd2a-4e16-8533-01d515275fb7-kube-api-access-skgbd\") pod \"maas-api-87c574948-t4xs2\" (UID: \"f3d9faea-dd2a-4e16-8533-01d515275fb7\") " pod="opendatahub/maas-api-87c574948-t4xs2" Jun 10 13:13:07.139187 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.139077 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d9faea-dd2a-4e16-8533-01d515275fb7-maas-api-tls\") pod \"maas-api-87c574948-t4xs2\" (UID: \"f3d9faea-dd2a-4e16-8533-01d515275fb7\") " pod="opendatahub/maas-api-87c574948-t4xs2" Jun 10 13:13:07.139187 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:13:07.139170 2580 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 10 13:13:07.139270 ip-10-0-135-143 kubenswrapper[2580]: E0610 13:13:07.139225 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d9faea-dd2a-4e16-8533-01d515275fb7-maas-api-tls podName:f3d9faea-dd2a-4e16-8533-01d515275fb7 nodeName:}" failed. No retries permitted until 2026-06-10 13:13:07.639207183 +0000 UTC m=+579.345823772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f3d9faea-dd2a-4e16-8533-01d515275fb7-maas-api-tls") pod "maas-api-87c574948-t4xs2" (UID: "f3d9faea-dd2a-4e16-8533-01d515275fb7") : secret "maas-api-serving-cert" not found Jun 10 13:13:07.152913 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.152886 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skgbd\" (UniqueName: \"kubernetes.io/projected/f3d9faea-dd2a-4e16-8533-01d515275fb7-kube-api-access-skgbd\") pod \"maas-api-87c574948-t4xs2\" (UID: \"f3d9faea-dd2a-4e16-8533-01d515275fb7\") " pod="opendatahub/maas-api-87c574948-t4xs2" Jun 10 13:13:07.575827 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.575794 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-mmq8d"] Jun 10 13:13:07.579346 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.579328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-mmq8d" Jun 10 13:13:07.582114 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.582093 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 13:13:07.589881 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.589860 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-mmq8d"] Jun 10 13:13:07.643122 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.643090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d9faea-dd2a-4e16-8533-01d515275fb7-maas-api-tls\") pod \"maas-api-87c574948-t4xs2\" (UID: \"f3d9faea-dd2a-4e16-8533-01d515275fb7\") " pod="opendatahub/maas-api-87c574948-t4xs2" Jun 10 13:13:07.645776 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.645753 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3d9faea-dd2a-4e16-8533-01d515275fb7-maas-api-tls\") pod \"maas-api-87c574948-t4xs2\" (UID: \"f3d9faea-dd2a-4e16-8533-01d515275fb7\") " pod="opendatahub/maas-api-87c574948-t4xs2" Jun 10 13:13:07.734873 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.734844 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:13:07.743595 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.743557 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24dvs\" (UniqueName: \"kubernetes.io/projected/99172245-c146-4367-bfc4-494ac068ee0c-kube-api-access-24dvs\") pod \"payload-pre-processing-579785bc64-mmq8d\" (UID: \"99172245-c146-4367-bfc4-494ac068ee0c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-mmq8d" Jun 10 13:13:07.844673 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.844586 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24dvs\" (UniqueName: \"kubernetes.io/projected/99172245-c146-4367-bfc4-494ac068ee0c-kube-api-access-24dvs\") pod \"payload-pre-processing-579785bc64-mmq8d\" (UID: \"99172245-c146-4367-bfc4-494ac068ee0c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-mmq8d" Jun 10 13:13:07.854716 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.854692 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24dvs\" (UniqueName: \"kubernetes.io/projected/99172245-c146-4367-bfc4-494ac068ee0c-kube-api-access-24dvs\") pod \"payload-pre-processing-579785bc64-mmq8d\" (UID: \"99172245-c146-4367-bfc4-494ac068ee0c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-mmq8d" Jun 10 13:13:07.870257 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.870232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-87c574948-t4xs2" Jun 10 13:13:07.891435 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:07.891411 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-mmq8d" Jun 10 13:13:08.016133 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:08.016106 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-87c574948-t4xs2"] Jun 10 13:13:08.017722 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:13:08.017692 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d9faea_dd2a_4e16_8533_01d515275fb7.slice/crio-621a69a4bf815a5c2b5b2fac0de88576e2b727bac38efe38eeaa3e04f4280e71 WatchSource:0}: Error finding container 621a69a4bf815a5c2b5b2fac0de88576e2b727bac38efe38eeaa3e04f4280e71: Status 404 returned error can't find the container with id 621a69a4bf815a5c2b5b2fac0de88576e2b727bac38efe38eeaa3e04f4280e71 Jun 10 13:13:08.053670 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:08.053649 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-mmq8d"] Jun 10 13:13:08.054781 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:13:08.054757 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99172245_c146_4367_bfc4_494ac068ee0c.slice/crio-ebf47bf2b9d68fd62ee95b73dc7ad346defea05ee15ef3aa474c7ad12e3dc5bc WatchSource:0}: Error finding container ebf47bf2b9d68fd62ee95b73dc7ad346defea05ee15ef3aa474c7ad12e3dc5bc: Status 404 returned error can't find the container with id ebf47bf2b9d68fd62ee95b73dc7ad346defea05ee15ef3aa474c7ad12e3dc5bc Jun 10 13:13:08.665013 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:08.664971 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-mmq8d" event={"ID":"99172245-c146-4367-bfc4-494ac068ee0c","Type":"ContainerStarted","Data":"ebf47bf2b9d68fd62ee95b73dc7ad346defea05ee15ef3aa474c7ad12e3dc5bc"} Jun 10 13:13:08.666680 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:08.666646 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-87c574948-t4xs2" event={"ID":"f3d9faea-dd2a-4e16-8533-01d515275fb7","Type":"ContainerStarted","Data":"621a69a4bf815a5c2b5b2fac0de88576e2b727bac38efe38eeaa3e04f4280e71"} Jun 10 13:13:11.687617 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:11.687524 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-mmq8d" event={"ID":"99172245-c146-4367-bfc4-494ac068ee0c","Type":"ContainerStarted","Data":"c4e3a13c4585d692dd1098d9c028da7de0a6ff173e6bc0062101e346b3536037"} Jun 10 13:13:11.687617 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:11.687612 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-mmq8d" Jun 10 13:13:11.688912 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:11.688892 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-87c574948-t4xs2" event={"ID":"f3d9faea-dd2a-4e16-8533-01d515275fb7","Type":"ContainerStarted","Data":"da6988308cd9dd05e8f3841bf0a5dd34e5f8ebda7ef5498ba8692db254ec63b6"} Jun 10 13:13:11.689022 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:11.689011 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-87c574948-t4xs2" Jun 10 13:13:11.715892 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:11.715847 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-mmq8d" podStartSLOduration=1.3991809339999999 podStartE2EDuration="4.715832196s" totalImagesPullingTime="3.316651262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:13:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:13:11.714823149 +0000 UTC m=+583.421439758" watchObservedRunningTime="2026-06-10 13:13:11.715832196 +0000 UTC m=+583.422448787" Jun 10 13:13:11.736791 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:11.736743 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-87c574948-t4xs2" podStartSLOduration=2.337945056 podStartE2EDuration="5.736726756s" totalImagesPullingTime="3.3987817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:13:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:13:11.736574296 +0000 UTC m=+583.443190890" watchObservedRunningTime="2026-06-10 13:13:11.736726756 +0000 UTC m=+583.443343352" Jun 10 13:13:17.699515 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:17.699468 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-87c574948-t4xs2" Jun 10 13:13:22.696078 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:22.696035 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-mmq8d" Jun 10 13:13:28.755565 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:28.755534 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:13:28.756035 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:28.755808 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:13:28.758481 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:28.758456 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:13:28.758735 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:13:28.758720 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:14:09.079779 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.079748 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l"] Jun 10 13:14:09.083168 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.083151 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.086269 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.086249 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 13:14:09.087857 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.087837 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-58d9f\"" Jun 10 13:14:09.087949 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.087838 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 13:14:09.087949 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.087846 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 13:14:09.093647 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.093627 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l"] Jun 10 13:14:09.178268 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.178240 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.178418 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.178279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.178418 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.178305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn7hs\" (UniqueName: \"kubernetes.io/projected/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-kube-api-access-qn7hs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.178418 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.178373 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.178555 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.178443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.178555 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.178463 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.279511 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.279467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.279674 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.279556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.279674 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.279582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.279674 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.279609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.279674 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.279631 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.279674 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.279655 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn7hs\" (UniqueName: \"kubernetes.io/projected/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-kube-api-access-qn7hs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.280000 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.279904 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.280000 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.279966 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.280121 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.280058 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.281887 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.281865 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.282130 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.282109 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.289357 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.289331 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn7hs\" (UniqueName: \"kubernetes.io/projected/61df7fbe-c01e-49a8-84d8-43bffc7ee0f7-kube-api-access-qn7hs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l\" (UID: \"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.393916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.393837 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:09.535093 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.535058 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:14:09.539989 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.539963 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l"] Jun 10 13:14:09.541785 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:14:09.541762 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61df7fbe_c01e_49a8_84d8_43bffc7ee0f7.slice/crio-082e80bda4ec307eb54c471c02148f7d95f1a0d15fbfa1016caeb0bcab9a5741 WatchSource:0}: Error finding container 082e80bda4ec307eb54c471c02148f7d95f1a0d15fbfa1016caeb0bcab9a5741: Status 404 returned error can't find the container with id 082e80bda4ec307eb54c471c02148f7d95f1a0d15fbfa1016caeb0bcab9a5741 Jun 10 13:14:09.543596 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.543569 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:14:09.969051 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:09.969017 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" event={"ID":"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7","Type":"ContainerStarted","Data":"082e80bda4ec307eb54c471c02148f7d95f1a0d15fbfa1016caeb0bcab9a5741"} Jun 10 13:14:12.988217 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:12.988180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" event={"ID":"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7","Type":"ContainerStarted","Data":"d6e261673d652788cbf185010e740c68303e22a6e764b99c540928c5536dcd6b"} Jun 10 13:14:14.998916 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:14.998884 2580 generic.go:356] "Generic (PLEG): container finished" podID="61df7fbe-c01e-49a8-84d8-43bffc7ee0f7" containerID="d6e261673d652788cbf185010e740c68303e22a6e764b99c540928c5536dcd6b" exitCode=0 Jun 10 13:14:14.999304 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:14.998958 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" event={"ID":"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7","Type":"ContainerDied","Data":"d6e261673d652788cbf185010e740c68303e22a6e764b99c540928c5536dcd6b"} Jun 10 13:14:17.017706 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:17.017668 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" event={"ID":"61df7fbe-c01e-49a8-84d8-43bffc7ee0f7","Type":"ContainerStarted","Data":"4cfe694915e95d33740f74215da4a2ddaf3b664df04de6341af0d289f5711bbc"} Jun 10 13:14:17.053188 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:17.053138 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" podStartSLOduration=1.847932935 podStartE2EDuration="8.053123716s" totalImagesPullingTime="4.524450904s" totalInitContainerRuntime="1.680739877s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:14:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:14:17.051871751 +0000 UTC m=+648.758488346" watchObservedRunningTime="2026-06-10 13:14:17.053123716 +0000 UTC m=+648.759740309" Jun 10 13:14:17.658608 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:17.658573 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:14:19.394349 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:19.394314 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:19.394847 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:19.394384 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:19.407032 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:19.407008 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:20.042623 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:20.042597 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l" Jun 10 13:14:26.374439 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:26.374406 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:14:50.373745 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:50.373709 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:14:52.937614 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:52.937585 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2"] Jun 10 13:14:52.941396 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:52.941375 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:52.944824 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:52.944800 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 13:14:52.953478 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:52.953452 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2"] Jun 10 13:14:53.070793 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.070759 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.070962 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.070801 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.070962 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.070834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.070962 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.070908 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.070962 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.070957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97vbn\" (UniqueName: \"kubernetes.io/projected/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-kube-api-access-97vbn\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.071099 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.071005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.171561 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.171496 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.171759 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.171572 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.171759 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.171602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.171759 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.171639 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.171759 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.171666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.171759 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.171704 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97vbn\" (UniqueName: \"kubernetes.io/projected/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-kube-api-access-97vbn\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.172042 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.172019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.172100 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.172051 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.172167 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.172146 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.173790 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.173766 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.174092 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.174071 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.184686 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.184661 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97vbn\" (UniqueName: \"kubernetes.io/projected/b3bab196-bf0f-4be9-bc64-d0d5e670b4ac-kube-api-access-97vbn\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2\" (UID: \"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.252541 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.252490 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:14:53.388542 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:53.388496 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2"] Jun 10 13:14:53.390497 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:14:53.390468 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3bab196_bf0f_4be9_bc64_d0d5e670b4ac.slice/crio-e177c9e4744e4a5029b186527263e91d581ddb65467a0c8e5fdb96b7e10c1764 WatchSource:0}: Error finding container e177c9e4744e4a5029b186527263e91d581ddb65467a0c8e5fdb96b7e10c1764: Status 404 returned error can't find the container with id e177c9e4744e4a5029b186527263e91d581ddb65467a0c8e5fdb96b7e10c1764 Jun 10 13:14:54.068455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:54.068417 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:14:54.201212 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:54.201179 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" event={"ID":"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac","Type":"ContainerStarted","Data":"2b23ab0b4286d54f5f25e4af5579da6fe757a92db55bd73fd816c09f98d96d27"} Jun 10 13:14:54.201364 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:54.201230 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" event={"ID":"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac","Type":"ContainerStarted","Data":"e177c9e4744e4a5029b186527263e91d581ddb65467a0c8e5fdb96b7e10c1764"} Jun 10 13:14:55.207285 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:55.207252 2580 generic.go:356] "Generic (PLEG): container finished" podID="b3bab196-bf0f-4be9-bc64-d0d5e670b4ac" containerID="2b23ab0b4286d54f5f25e4af5579da6fe757a92db55bd73fd816c09f98d96d27" exitCode=0 Jun 10 13:14:55.207715 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:55.207322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" event={"ID":"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac","Type":"ContainerDied","Data":"2b23ab0b4286d54f5f25e4af5579da6fe757a92db55bd73fd816c09f98d96d27"} Jun 10 13:14:56.214301 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:56.214267 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" event={"ID":"b3bab196-bf0f-4be9-bc64-d0d5e670b4ac","Type":"ContainerStarted","Data":"a9ef82077c9bf23adfd1a8868a7a6dad94e331d9645a89a68463584e612032d3"} Jun 10 13:14:56.236274 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:14:56.236222 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" podStartSLOduration=2.742406092 podStartE2EDuration="4.236205082s" totalImagesPullingTime="259.744609ms" totalInitContainerRuntime="1.234054381s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:14:56.235201579 +0000 UTC m=+687.941818217" watchObservedRunningTime="2026-06-10 13:14:56.236205082 +0000 UTC m=+687.942821675" Jun 10 13:15:03.253237 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:15:03.253195 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:15:03.253757 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:15:03.253265 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:15:03.265876 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:15:03.265853 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:15:04.263797 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:15:04.263769 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2" Jun 10 13:15:06.859435 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:15:06.859399 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:17:24.066351 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:17:24.066314 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:17:34.349580 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:17:34.349543 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:17:43.265973 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:17:43.265939 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:17:53.858763 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:17:53.858728 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:18:02.853443 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:18:02.853403 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:18:12.859649 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:18:12.859616 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:18:28.783751 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:18:28.783665 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:18:28.785610 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:18:28.785586 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:18:28.787806 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:18:28.787785 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:18:28.789281 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:18:28.789262 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:18:45.474077 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:18:45.474045 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:18:51.157674 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:18:51.157639 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:19:29.064322 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:19:29.064286 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:19:44.951883 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:19:44.951849 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:20:23.574369 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:20:23.574335 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:20:40.555671 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:20:40.555633 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:20:55.802361 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:20:55.802325 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:21:11.951531 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:21:11.951490 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:22:12.848582 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:22:12.848547 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:22:21.666407 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:22:21.666374 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:22:38.678206 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:22:38.678174 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:22:47.122353 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:22:47.122318 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:23:04.774618 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:23:04.774543 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:23:12.793530 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:23:12.793488 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:23:28.813068 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:23:28.813036 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:23:28.815843 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:23:28.815823 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:23:28.815972 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:23:28.815955 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:23:28.818849 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:23:28.818831 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:23:45.475581 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:23:45.475542 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:23:54.794774 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:23:54.794744 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:24:02.788574 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:24:02.788535 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:24:10.679873 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:24:10.679838 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:24:19.315531 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:24:19.315440 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:24:44.776774 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:24:44.776737 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:24:56.869517 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:24:56.869470 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:25:45.864954 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:25:45.864915 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:25:53.560283 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:25:53.560211 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:26:12.864166 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:26:12.864135 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:26:21.161175 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:26:21.161133 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:26:30.171089 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:26:30.171057 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:26:38.855107 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:26:38.855072 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:26:48.058394 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:26:48.058359 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:26:56.784077 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:26:56.784037 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:27:05.457945 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:27:05.457912 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:27:13.661830 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:27:13.661791 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:27:22.452034 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:27:22.451946 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:27:30.648458 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:27:30.648416 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:28:28.840961 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:28:28.840923 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:28:28.843917 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:28:28.843895 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:28:28.845366 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:28:28.845347 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:28:28.848196 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:28:28.848181 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:30:01.260040 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:30:01.260007 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:30:05.451984 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:30:05.451947 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:30:32.755493 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:30:32.755412 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:30:36.354884 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:30:36.354850 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:30:46.984174 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:30:46.984132 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:30:56.393247 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:30:56.393217 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:31:06.457535 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:31:06.457481 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:31:15.372484 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:31:15.372443 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:31:26.054245 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:31:26.054210 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:31:36.384776 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:31:36.384742 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:31:46.053630 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:31:46.053593 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:31:56.965823 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:31:56.965742 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:32:06.463771 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:32:06.463736 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:32:11.064127 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:32:11.064089 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:33:28.868947 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:33:28.868918 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:33:28.871764 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:33:28.871740 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:33:28.874780 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:33:28.874760 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:33:28.883915 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:33:28.883891 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sp54d_21f87214-39e8-49ef-a8d8-43f3ea75d506/ovn-acl-logging/0.log" Jun 10 13:33:40.357804 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:33:40.357767 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:34:27.949364 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:34:27.949334 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:34:36.057729 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:34:36.057695 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:34:46.145675 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:34:46.145639 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:34:54.547045 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:34:54.546962 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:35:02.752112 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:02.752081 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:35:15.554085 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:15.554056 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:35:26.564196 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:26.564161 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:35:32.552126 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:32.552094 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-q92kb"] Jun 10 13:35:45.931121 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:45.931090 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-ftx5f_495b2bd0-f81d-437a-9726-4ecfc29cb3bb/manager/0.log" Jun 10 13:35:46.227534 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:46.227489 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-87c574948-t4xs2_f3d9faea-dd2a-4e16-8533-01d515275fb7/maas-api/0.log" Jun 10 13:35:46.740468 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:46.740436 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-4lqbx_21c20727-39a9-4996-9de3-bf435a58fc3e/server/0.log" Jun 10 13:35:46.880144 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:46.880116 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-llhsd_86fe1c9f-470e-42a2-b599-fee73fc30c77/manager/0.log" Jun 10 13:35:47.006697 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:47.006614 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cb5c965-5sl8n_358477f2-f610-47ed-9473-16192ac982ae/copy-manifests/0.log" Jun 10 13:35:47.027153 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:47.027122 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cb5c965-5sl8n_358477f2-f610-47ed-9473-16192ac982ae/manager/0.log" Jun 10 13:35:48.948965 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:48.948937 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rnh8q_86971a32-f14e-451e-8662-5b14ac2701a7/manager/0.log" Jun 10 13:35:49.572177 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:49.572150 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-q92kb_296b6bdd-0b7e-4ba0-8a84-6c117bebec0e/limitador/0.log" Jun 10 13:35:50.220770 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:50.220739 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-jttmd_ffacb045-d476-4b06-aeec-6991ef2418ef/discovery/0.log" Jun 10 13:35:50.458966 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:50.458926 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df986db4-zd4gl_71bae032-b343-4f55-9ec2-8b3ca2f39d51/kube-auth-proxy/0.log" Jun 10 13:35:50.717244 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:50.717217 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-mmq8d_99172245-c146-4367-bfc4-494ac068ee0c/payload-pre-processing/0.log" Jun 10 13:35:50.968008 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:50.967930 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55f6d9476c-gjp6b_8eb6c60d-a781-43fd-9ceb-2a739a930543/router/0.log" Jun 10 13:35:51.338440 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:51.338358 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l_61df7fbe-c01e-49a8-84d8-43bffc7ee0f7/main/0.log" Jun 10 13:35:51.349706 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:51.349681 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-dmp5l_61df7fbe-c01e-49a8-84d8-43bffc7ee0f7/storage-initializer/0.log" Jun 10 13:35:51.872799 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:51.872772 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2_b3bab196-bf0f-4be9-bc64-d0d5e670b4ac/storage-initializer/0.log" Jun 10 13:35:51.882697 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:35:51.882675 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-2hlh2_b3bab196-bf0f-4be9-bc64-d0d5e670b4ac/main/0.log" Jun 10 13:36:00.056791 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:00.056761 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-97st9_c2da8555-0d96-4880-8092-a54510d11495/global-pull-secret-syncer/0.log" Jun 10 13:36:00.255208 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:00.255181 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-srxz8_27812599-fe48-41e6-a6d9-8cd80efcd338/konnectivity-agent/0.log" Jun 10 13:36:00.279498 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:00.279475 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-143.ec2.internal_8c36a00a7cd7fefc8dfa55ac1a7232f3/haproxy/0.log" Jun 10 13:36:04.105065 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:04.105033 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-b7g84_1d285e23-f031-4cf7-883f-1b392ef1092b/sail-operator/0.log" Jun 10 13:36:05.750463 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:05.750423 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rnh8q_86971a32-f14e-451e-8662-5b14ac2701a7/manager/0.log" Jun 10 13:36:05.914419 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:05.914392 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-q92kb_296b6bdd-0b7e-4ba0-8a84-6c117bebec0e/limitador/0.log" Jun 10 13:36:07.645077 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:07.645041 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-mkm4t_832454fb-ae01-48db-b4c8-10210b92fe44/cluster-monitoring-operator/0.log" Jun 10 13:36:08.109871 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:08.109842 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wn7qt_daa8c990-e8fb-4e41-a6ad-898f3ac51ef9/node-exporter/0.log" Jun 10 13:36:08.133289 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:08.133255 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wn7qt_daa8c990-e8fb-4e41-a6ad-898f3ac51ef9/kube-rbac-proxy/0.log" Jun 10 13:36:08.161653 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:08.161626 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wn7qt_daa8c990-e8fb-4e41-a6ad-898f3ac51ef9/init-textfile/0.log" Jun 10 13:36:10.110410 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:10.110384 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-bpxmw_3e6d0894-a562-400b-b5ea-b861f5cf3e02/networking-console-plugin/0.log" Jun 10 13:36:10.860455 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:10.860427 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/2.log" Jun 10 13:36:10.867369 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:10.867348 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvpgc_61ab2ffa-d668-4258-9699-5835aac889fc/console-operator/3.log" Jun 10 13:36:10.916010 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:10.915981 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm"] Jun 10 13:36:10.919514 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:10.919488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:10.922516 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:10.922488 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpk5r\"/\"kube-root-ca.crt\"" Jun 10 13:36:10.923977 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:10.923955 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bpk5r\"/\"default-dockercfg-xzn8r\"" Jun 10 13:36:10.924071 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:10.923993 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpk5r\"/\"openshift-service-ca.crt\"" Jun 10 13:36:10.938954 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:10.938929 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm"] Jun 10 13:36:11.008908 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.008876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-sys\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.008908 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.008911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-podres\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.009125 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.008941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-lib-modules\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.009125 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.008977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tchj\" (UniqueName: \"kubernetes.io/projected/d3e64796-9b6e-482e-9819-2d86764afc50-kube-api-access-8tchj\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.009125 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.009027 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-proc\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.110347 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.110313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-sys\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.110580 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.110352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-podres\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.110580 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.110439 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-sys\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.110580 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.110482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-lib-modules\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.110580 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.110493 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-podres\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.110580 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.110544 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tchj\" (UniqueName: \"kubernetes.io/projected/d3e64796-9b6e-482e-9819-2d86764afc50-kube-api-access-8tchj\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.111009 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.110633 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-lib-modules\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.111009 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.110628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-proc\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.111009 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.110730 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3e64796-9b6e-482e-9819-2d86764afc50-proc\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.121563 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.121537 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tchj\" (UniqueName: \"kubernetes.io/projected/d3e64796-9b6e-482e-9819-2d86764afc50-kube-api-access-8tchj\") pod \"perf-node-gather-daemonset-n25rm\" (UID: \"d3e64796-9b6e-482e-9819-2d86764afc50\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.229527 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.229473 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:11.362242 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:11.362178 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm"] Jun 10 13:36:11.364566 ip-10-0-135-143 kubenswrapper[2580]: W0610 13:36:11.364538 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd3e64796_9b6e_482e_9819_2d86764afc50.slice/crio-b62534a43a4234072e51dfa514ae4c497df410016cbbea0ac38feaaec5fd0116 WatchSource:0}: Error finding container b62534a43a4234072e51dfa514ae4c497df410016cbbea0ac38feaaec5fd0116: Status 404 returned error can't find the container with id b62534a43a4234072e51dfa514ae4c497df410016cbbea0ac38feaaec5fd0116 Jun 10 13:36:12.172130 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:12.172099 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-wlh9s_6cfdebac-6130-4405-971e-2a7556b84dbb/volume-data-source-validator/0.log" Jun 10 13:36:12.257140 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:12.257107 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" event={"ID":"d3e64796-9b6e-482e-9819-2d86764afc50","Type":"ContainerStarted","Data":"bf8349efbce99da71e717edfb4350cf97b9986cec29d0bf64b2f0f6d40c1924a"} Jun 10 13:36:12.257340 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:12.257155 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" event={"ID":"d3e64796-9b6e-482e-9819-2d86764afc50","Type":"ContainerStarted","Data":"b62534a43a4234072e51dfa514ae4c497df410016cbbea0ac38feaaec5fd0116"} Jun 10 13:36:12.257340 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:12.257207 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:12.281764 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:12.281721 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" podStartSLOduration=2.281707268 podStartE2EDuration="2.281707268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:36:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:36:12.281418233 +0000 UTC m=+1963.988034826" watchObservedRunningTime="2026-06-10 13:36:12.281707268 +0000 UTC m=+1963.988323883" Jun 10 13:36:13.430724 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:13.430695 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fxrlc_6dc60ce3-c430-4df1-802f-026c38c787cc/dns/0.log" Jun 10 13:36:13.453219 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:13.453197 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fxrlc_6dc60ce3-c430-4df1-802f-026c38c787cc/kube-rbac-proxy/0.log" Jun 10 13:36:13.502911 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:13.502889 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lxkv7_54b7e057-3679-484b-9c46-bc24300838bc/dns-node-resolver/0.log" Jun 10 13:36:14.122558 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:14.122531 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6s7xc_9fc2d181-6aa1-4530-9c15-74d967622530/node-ca/0.log" Jun 10 13:36:15.233653 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:15.233624 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-jttmd_ffacb045-d476-4b06-aeec-6991ef2418ef/discovery/0.log" Jun 10 13:36:15.282959 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:15.282933 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df986db4-zd4gl_71bae032-b343-4f55-9ec2-8b3ca2f39d51/kube-auth-proxy/0.log" Jun 10 13:36:15.369601 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:15.369575 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-mmq8d_99172245-c146-4367-bfc4-494ac068ee0c/payload-pre-processing/0.log" Jun 10 13:36:15.457112 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:15.457081 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55f6d9476c-gjp6b_8eb6c60d-a781-43fd-9ceb-2a739a930543/router/0.log" Jun 10 13:36:16.147035 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:16.147010 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s99l7_db3e6c41-d0f1-448a-bada-2ef33206b505/serve-healthcheck-canary/0.log" Jun 10 13:36:16.742354 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:16.742324 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-8kj9w_ebc3cb39-0f15-4395-aa67-5661d95d3434/insights-operator/0.log" Jun 10 13:36:16.849171 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:16.849140 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ckc85_a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8/kube-rbac-proxy/0.log" Jun 10 13:36:16.870813 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:16.870786 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ckc85_a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8/exporter/0.log" Jun 10 13:36:16.893795 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:16.893776 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ckc85_a4bcdb44-a0fd-41a8-92e9-fae2883f9ff8/extractor/0.log" Jun 10 13:36:18.272904 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:18.272835 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-n25rm" Jun 10 13:36:19.442871 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:19.442843 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-ftx5f_495b2bd0-f81d-437a-9726-4ecfc29cb3bb/manager/0.log" Jun 10 13:36:19.547407 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:19.547383 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-87c574948-t4xs2_f3d9faea-dd2a-4e16-8533-01d515275fb7/maas-api/0.log" Jun 10 13:36:19.674609 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:19.674576 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-4lqbx_21c20727-39a9-4996-9de3-bf435a58fc3e/server/0.log" Jun 10 13:36:19.748097 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:19.748072 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-llhsd_86fe1c9f-470e-42a2-b599-fee73fc30c77/manager/0.log" Jun 10 13:36:19.870487 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:19.870455 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cb5c965-5sl8n_358477f2-f610-47ed-9473-16192ac982ae/manager/0.log" Jun 10 13:36:19.892755 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:19.892729 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cb5c965-5sl8n_358477f2-f610-47ed-9473-16192ac982ae/copy-manifests/0.log" Jun 10 13:36:24.793391 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:24.793362 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-jttmd_ffacb045-d476-4b06-aeec-6991ef2418ef/discovery/0.log" Jun 10 13:36:24.830937 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:24.830907 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df986db4-zd4gl_71bae032-b343-4f55-9ec2-8b3ca2f39d51/kube-auth-proxy/0.log" Jun 10 13:36:24.895802 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:24.895768 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-mmq8d_99172245-c146-4367-bfc4-494ac068ee0c/payload-pre-processing/0.log" Jun 10 13:36:24.960588 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:24.960557 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55f6d9476c-gjp6b_8eb6c60d-a781-43fd-9ceb-2a739a930543/router/0.log" Jun 10 13:36:26.160998 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:26.160966 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-jttmd_ffacb045-d476-4b06-aeec-6991ef2418ef/discovery/0.log" Jun 10 13:36:26.188031 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:26.188008 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df986db4-zd4gl_71bae032-b343-4f55-9ec2-8b3ca2f39d51/kube-auth-proxy/0.log" Jun 10 13:36:26.259262 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:26.259217 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-mmq8d_99172245-c146-4367-bfc4-494ac068ee0c/payload-pre-processing/0.log" Jun 10 13:36:26.338058 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:26.338027 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55f6d9476c-gjp6b_8eb6c60d-a781-43fd-9ceb-2a739a930543/router/0.log" Jun 10 13:36:27.640353 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:27.640325 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-k2g2d_b7aa19d2-82f1-493c-94e9-41373e555cec/migrator/0.log" Jun 10 13:36:27.664107 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:27.664084 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-k2g2d_b7aa19d2-82f1-493c-94e9-41373e555cec/graceful-termination/0.log" Jun 10 13:36:28.095658 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:28.095622 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-jttmd_ffacb045-d476-4b06-aeec-6991ef2418ef/discovery/0.log" Jun 10 13:36:28.133037 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:28.132986 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-gcmhh_62b98720-ab2f-47b0-8671-75a1d8dc5c9d/kube-storage-version-migrator-operator/1.log" Jun 10 13:36:28.134471 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:28.134448 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-gcmhh_62b98720-ab2f-47b0-8671-75a1d8dc5c9d/kube-storage-version-migrator-operator/0.log" Jun 10 13:36:28.171749 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:28.171711 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df986db4-zd4gl_71bae032-b343-4f55-9ec2-8b3ca2f39d51/kube-auth-proxy/0.log" Jun 10 13:36:28.238227 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:28.238199 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-mmq8d_99172245-c146-4367-bfc4-494ac068ee0c/payload-pre-processing/0.log" Jun 10 13:36:28.295471 ip-10-0-135-143 kubenswrapper[2580]: I0610 13:36:28.295445 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55f6d9476c-gjp6b_8eb6c60d-a781-43fd-9ceb-2a739a930543/router/0.log"