Jun 11 16:17:09.764066 ip-10-0-131-101 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 16:17:09.764080 ip-10-0-131-101 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 16:17:09.764090 ip-10-0-131-101 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 16:17:09.764296 ip-10-0-131-101 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 16:17:19.842987 ip-10-0-131-101 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 16:17:19.843009 ip-10-0-131-101 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cee99911c59d42e8afc45dc10b3df26f -- Jun 11 16:19:57.789859 ip-10-0-131-101 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:19:58.177688 ip-10-0-131-101 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:58.177688 ip-10-0-131-101 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:19:58.177688 ip-10-0-131-101 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:58.177688 ip-10-0-131-101 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:19:58.177688 ip-10-0-131-101 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:19:58.178621 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.178524 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:19:58.182941 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182925 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:58.182941 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182941 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182945 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182948 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182951 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182954 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182957 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182961 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182964 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182967 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182970 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182973 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182977 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182980 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182983 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182986 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182989 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182991 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182994 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182997 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.182999 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:58.183006 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183002 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183005 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183008 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183011 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183013 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183017 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183019 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183022 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183024 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183027 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183030 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183033 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183035 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183038 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183040 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183043 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183045 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183047 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183050 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183052 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:58.183483 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183055 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183057 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183059 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183062 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183064 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183067 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183069 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183071 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183074 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183076 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183079 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183082 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183084 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183088 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183093 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183096 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183098 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183101 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183104 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:58.184021 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183107 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183110 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183113 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183117 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183121 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183125 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183128 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183132 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183135 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183138 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183141 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183144 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183147 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183150 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183153 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183156 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183158 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183161 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183164 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:58.184498 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183167 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183170 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183173 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183175 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183178 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183180 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183183 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183186 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183189 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183192 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183194 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183197 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183199 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183202 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183204 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183207 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183209 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183212 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183215 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183217 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:58.184946 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183964 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183970 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183973 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183977 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183980 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183983 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183985 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183987 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183990 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183993 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183995 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.183999 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184003 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184007 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184010 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184012 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184015 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184018 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184020 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:58.185418 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184024 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184027 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184030 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184033 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184036 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184039 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184042 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184044 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184047 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184049 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184052 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184055 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184058 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184061 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184063 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184067 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184071 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184074 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184078 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:58.185990 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184081 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184084 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184086 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184089 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184091 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184094 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184097 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184099 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184102 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184105 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184108 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184110 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184113 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184116 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184119 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184121 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184124 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184126 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184129 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184132 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:58.186458 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184134 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184138 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184140 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184143 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184146 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184148 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184151 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184154 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184157 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184159 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184162 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184164 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184166 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184169 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184171 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184174 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184176 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184179 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184181 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184184 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:58.186988 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184186 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184189 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184192 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184196 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184199 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184203 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184206 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184209 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184212 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184215 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184217 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184220 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184222 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184225 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184228 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184230 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184233 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184235 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184238 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184241 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:58.187478 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184243 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184696 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184704 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184707 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184710 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184713 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184716 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184719 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184722 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184725 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184728 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184731 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184733 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184736 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184738 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184741 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184745 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184749 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184752 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:58.187986 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184756 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184759 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184762 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184765 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184768 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184770 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184773 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184775 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184778 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184781 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184783 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184785 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184789 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184791 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184794 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184796 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184799 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184801 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184803 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184806 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:58.188448 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184809 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184812 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184815 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184818 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184820 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184823 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184825 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184829 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184832 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184835 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184838 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184840 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184843 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184845 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184848 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184850 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184853 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184855 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184858 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:58.188940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184860 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184863 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184866 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184868 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184871 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184873 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184876 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184879 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184881 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184884 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184886 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184888 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184891 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184893 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184896 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184899 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184901 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184903 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184906 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:58.189397 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184909 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184912 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184914 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184916 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184919 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184922 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184925 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184927 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184931 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184933 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184936 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184938 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184941 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184943 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184946 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184948 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184951 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184954 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184956 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184959 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:58.189879 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184962 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184965 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.184967 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185034 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185041 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185048 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185053 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185057 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185060 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185064 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185068 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185071 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185074 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185078 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185081 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185085 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185088 2580 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185091 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185094 2580 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185097 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185100 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185104 2580 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185107 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185110 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:19:58.190406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185119 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185123 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185126 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185129 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185132 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185136 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185139 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185142 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185145 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185148 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185151 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185155 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185158 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185161 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185164 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185167 2580 flags.go:64] FLAG: --enable-server="true" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185169 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185175 2580 flags.go:64] FLAG: --event-burst="100" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185177 2580 flags.go:64] FLAG: --event-qps="50" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185181 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185183 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185186 2580 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185190 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185193 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185196 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:19:58.191010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185199 2580 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185202 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185205 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185208 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185211 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185214 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185217 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185221 2580 flags.go:64] FLAG: --feature-gates="" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185224 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185227 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185230 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185233 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185236 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185239 2580 flags.go:64] FLAG: --help="false" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185242 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185245 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185248 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185261 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185265 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185268 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185271 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185274 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185277 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:19:58.191656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185280 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185283 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185286 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185289 2580 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185292 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185294 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185298 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185303 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185306 2580 flags.go:64] FLAG: --lock-file="" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185309 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185312 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185315 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185320 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185323 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185326 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185329 2580 flags.go:64] FLAG: --logging-format="text" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185333 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185336 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185339 2580 flags.go:64] FLAG: --manifest-url="" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185342 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185346 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185350 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185354 2580 flags.go:64] FLAG: --max-pods="110" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185357 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185360 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:19:58.192234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185363 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185366 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185369 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185373 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185376 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185383 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185386 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185388 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185391 2580 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185394 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185400 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185403 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185406 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185408 2580 flags.go:64] FLAG: --port="10250" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185412 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185415 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ee03ae79f6deede8" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185419 2580 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185422 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185425 2580 flags.go:64] FLAG: --register-node="true" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185428 2580 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185432 2580 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185435 2580 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185438 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185442 2580 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185445 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:19:58.192895 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185448 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185451 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185454 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185457 2580 flags.go:64] FLAG: --runonce="false" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185460 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185463 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185466 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185469 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185472 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185475 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185478 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185481 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185497 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185501 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185503 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185506 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185509 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185512 2580 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185515 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185520 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185523 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185526 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185531 2580 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185534 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185537 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:19:58.193914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185540 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185543 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185546 2580 flags.go:64] FLAG: --v="2" Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185550 2580 flags.go:64] FLAG: --version="false" Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185554 2580 flags.go:64] FLAG: --vmodule="" Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185559 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185562 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185695 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185700 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185703 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185705 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185708 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185711 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185713 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185716 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185719 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185721 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185724 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185727 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185730 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185732 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:58.194593 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185735 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185738 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185740 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185743 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185745 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185748 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185751 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185753 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185758 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185761 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185763 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185766 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185769 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185771 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185775 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185779 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185784 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185787 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185790 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:58.195097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185793 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185796 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185798 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185802 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185806 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185809 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185811 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185814 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185816 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185819 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185821 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185825 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185827 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185830 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185832 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185835 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185837 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185840 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185842 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:58.195592 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185845 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185847 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185851 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185853 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185856 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185859 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185861 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185864 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185866 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185869 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185873 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185875 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185879 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185882 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185886 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185889 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185891 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185894 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185897 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:58.196049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185900 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185902 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185905 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185908 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185910 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185912 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185915 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185918 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185920 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185922 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185925 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185928 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185930 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185932 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185935 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185938 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185941 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185944 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185946 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185949 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:58.196548 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185951 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185954 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185957 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185960 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185963 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185965 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185968 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.185970 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.185976 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.194224 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.194243 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.194264 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.194274 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194339 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194344 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:58.197038 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194348 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194352 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194355 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194358 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194361 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194364 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194366 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194369 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194372 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194376 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194381 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194386 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194388 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194391 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194393 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194396 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194399 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194401 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194403 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194406 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:58.197415 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194408 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194411 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194414 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194416 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194419 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194424 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194428 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194431 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194435 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194437 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194440 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194443 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194446 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194450 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194455 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194459 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194462 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194466 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194471 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:58.197920 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194474 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194477 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194479 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194482 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194504 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194510 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194514 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194517 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194520 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194522 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194525 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194528 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194530 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194533 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194536 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194539 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194541 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194544 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194547 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:58.198362 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194550 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194553 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194555 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194558 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194561 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194563 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194566 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194568 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194571 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194575 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194579 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194584 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194587 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194590 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194592 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194595 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194598 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194601 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194603 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194607 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:58.198885 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194610 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194613 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194615 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194618 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194622 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194625 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194628 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194631 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194634 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194636 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194639 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194641 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194644 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194647 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194651 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194655 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194659 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194664 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:58.199383 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194667 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.194672 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194807 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194815 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194820 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194823 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194826 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194829 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194832 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194835 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194837 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194840 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194842 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194845 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194849 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:19:58.199917 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194851 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194854 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194856 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194860 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194862 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194865 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194867 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194870 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194872 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194875 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194877 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194880 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194882 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194887 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194892 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194897 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194900 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194902 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194905 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:19:58.200286 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194907 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194909 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194912 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194914 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194917 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194919 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194922 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194925 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194927 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194929 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194932 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194934 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194937 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194941 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194944 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194947 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194949 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194952 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194955 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194957 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:19:58.200938 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194960 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194964 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194968 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194972 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194976 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194979 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194982 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194984 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194987 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194990 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194992 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194995 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.194997 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195000 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195002 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195005 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195007 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195010 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195012 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:19:58.201447 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195016 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195019 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195022 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195025 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195027 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195030 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195034 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195039 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195045 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195050 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195054 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195058 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195060 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195063 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195065 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195068 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195071 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195073 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195076 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:19:58.202188 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195079 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195081 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195084 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195086 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195088 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195091 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195093 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195096 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:58.195098 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.195104 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.195251 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.199165 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.200541 2580 server.go:1019] "Starting client certificate rotation" Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.200654 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:19:58.202774 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.200697 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:19:58.203632 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.203617 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:19:58.206887 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.206857 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:19:58.221687 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.221666 2580 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:19:58.224881 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.224859 2580 log.go:25] "Validated CRI v1 image API" Jun 11 16:19:58.225718 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.225700 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:19:58.228096 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.228059 2580 fs.go:135] Filesystem UUIDs: map[35cf77d9-4e46-46e7-9726-e18f6810949b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c2e05a6c-2259-4792-a5ab-b63870202c8e:/dev/nvme0n1p3] Jun 11 16:19:58.228203 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.228095 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:19:58.231917 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.231895 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:19:58.234172 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.234042 2580 manager.go:216] Machine: {Timestamp:2026-06-11 16:19:58.232558268 +0000 UTC m=+0.322868215 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100426 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c3ae30b56d6bbe542c904d85f8da4 SystemUUID:ec2c3ae3-0b56-d6bb-e542-c904d85f8da4 BootID:cee99911-c59d-42e8-afc4-5dc10b3df26f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cf:e9:73:c2:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cf:e9:73:c2:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:ed:a2:f0:d3:0b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:19:58.234172 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.234167 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:19:58.234359 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.234337 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:19:58.236913 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.236691 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:19:58.237068 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.236919 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:19:58.237644 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.237633 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:19:58.237679 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.237646 2580 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:19:58.237679 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.237654 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:19:58.238510 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.238484 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:19:58.239621 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.239611 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:19:58.243415 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.243403 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:19:58.243561 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.243551 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:19:58.243599 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.243583 2580 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:19:58.243599 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.243593 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:19:58.243653 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.243604 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:19:58.243653 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.243614 2580 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:19:58.243653 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.243623 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:19:58.244015 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.243992 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:19:58.244015 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.244010 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:19:58.259349 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.259324 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:19:58.260126 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.260105 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:19:58.260221 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.260174 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:19:58.260415 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.260399 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9m6tn" Jun 11 16:19:58.261182 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261147 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:19:58.261182 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261178 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:19:58.261797 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261775 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:19:58.261797 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261794 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:19:58.261878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261802 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:19:58.261878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261808 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:19:58.261878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261817 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:19:58.261878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261822 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:19:58.261878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261831 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:19:58.261878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261836 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:19:58.261878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261843 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:19:58.261878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261849 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:19:58.261878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261857 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:19:58.261878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.261863 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:19:58.262640 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.262631 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:19:58.262640 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.262640 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:19:58.265958 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.265943 2580 server.go:1268] "Started kubelet" Jun 11 16:19:58.266123 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.266030 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:19:58.266178 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.266152 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:19:58.266223 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.266185 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:19:58.267001 ip-10-0-131-101 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:19:58.268101 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.268089 2580 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:19:58.268917 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.268889 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9m6tn" Jun 11 16:19:58.269054 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.269037 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:19:58.270602 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.270586 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:19:58.273622 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.273555 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:19:58.274290 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.273311 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-101.ec2.internal.18b8133b5a69ba1e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-101.ec2.internal,UID:ip-10-0-131-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-101.ec2.internal,},FirstTimestamp:2026-06-11 16:19:58.265907742 +0000 UTC m=+0.356217662,LastTimestamp:2026-06-11 16:19:58.265907742 +0000 UTC m=+0.356217662,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-101.ec2.internal,}" Jun 11 16:19:58.276629 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.276467 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:19:58.276629 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.276469 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:19:58.276755 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.276645 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-101.ec2.internal\" not found" Jun 11 16:19:58.277187 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.277169 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:19:58.277297 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.277280 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:19:58.277392 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.277375 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:19:58.279470 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.277735 2580 factory.go:55] Registering systemd factory Jun 11 16:19:58.279470 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.277750 2580 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:19:58.279470 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.278016 2580 factory.go:153] Registering CRI-O factory Jun 11 16:19:58.279470 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.278030 2580 factory.go:223] Registration of the crio container factory successfully Jun 11 16:19:58.279470 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.278092 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:19:58.279470 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.278129 2580 factory.go:103] Registering Raw factory Jun 11 16:19:58.279470 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.278145 2580 manager.go:1196] Started watching for new ooms in manager Jun 11 16:19:58.279470 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.278587 2580 manager.go:349] Starting recovery of all containers Jun 11 16:19:58.280010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.279527 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:19:58.280010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.279539 2580 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:19:58.280010 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.279693 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:58.282968 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.282828 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-101.ec2.internal\" not found" node="ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.290117 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.290101 2580 manager.go:354] Recovery completed Jun 11 16:19:58.294377 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.294361 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:58.296443 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.296426 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:58.296573 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.296455 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:58.296573 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.296466 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:58.297104 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.297078 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:19:58.297104 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.297104 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:58.297211 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.297102 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:19:58.297211 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.297165 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:19:58.297843 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.297829 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:58.297905 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.297854 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:58.297905 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.297863 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:58.298466 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.298455 2580 policy_none.go:49] "None policy: Start" Jun 11 16:19:58.298519 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.298470 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:19:58.298519 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.298480 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:19:58.299446 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.299437 2580 policy_none.go:47] "Start" Jun 11 16:19:58.339201 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.339183 2580 manager.go:337] "Starting Device Plugin manager" Jun 11 16:19:58.352196 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.339223 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:19:58.352196 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.339236 2580 server.go:87] "Starting device plugin registration server" Jun 11 16:19:58.352196 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.339537 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:19:58.352196 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.339552 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:19:58.352196 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.339641 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:19:58.352196 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.339724 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:19:58.352196 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.339732 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:19:58.352196 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.341099 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:19:58.352196 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.341274 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-101.ec2.internal\" not found" Jun 11 16:19:58.352196 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.351053 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:19:58.352719 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.352517 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:19:58.352719 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.352556 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:19:58.352719 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.352581 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:19:58.352719 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.352658 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:19:58.354819 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.354799 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:58.439896 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.439802 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:58.440805 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.440789 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:58.440865 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.440821 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:58.440865 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.440832 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:58.440865 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.440857 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.449499 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.449471 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.449571 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.449513 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-101.ec2.internal\": node \"ip-10-0-131-101.ec2.internal\" not found" Jun 11 16:19:58.453194 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.453173 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-101.ec2.internal"] Jun 11 16:19:58.453288 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.453249 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:58.455376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.455353 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:58.455445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.455386 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:58.455445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.455398 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:58.456698 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.456684 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:58.456813 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.456794 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.456855 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.456844 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:58.457661 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.457645 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:58.457661 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.457653 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:58.457808 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.457678 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:58.457808 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.457689 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:58.457808 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.457679 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:58.457808 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.457759 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:58.458961 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.458947 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.459001 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.458977 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:19:58.459704 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.459687 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:19:58.459770 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.459719 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:19:58.459770 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.459734 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:19:58.471800 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.471777 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-101.ec2.internal\" not found" Jun 11 16:19:58.480060 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.480039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7e9da9b686ed2beaacc7c3d973690df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal\" (UID: \"c7e9da9b686ed2beaacc7c3d973690df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.480155 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.480068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e9da9b686ed2beaacc7c3d973690df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal\" (UID: \"c7e9da9b686ed2beaacc7c3d973690df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.480155 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.480083 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4922f8f5b3a3c97fad7fcd7149613037-config\") pod \"kube-apiserver-proxy-ip-10-0-131-101.ec2.internal\" (UID: \"4922f8f5b3a3c97fad7fcd7149613037\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.498729 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.498709 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-101.ec2.internal\" not found" node="ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.503412 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.503394 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-101.ec2.internal\" not found" node="ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.571925 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.571892 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-101.ec2.internal\" not found" Jun 11 16:19:58.580324 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.580294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4922f8f5b3a3c97fad7fcd7149613037-config\") pod \"kube-apiserver-proxy-ip-10-0-131-101.ec2.internal\" (UID: \"4922f8f5b3a3c97fad7fcd7149613037\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.580458 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.580324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7e9da9b686ed2beaacc7c3d973690df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal\" (UID: \"c7e9da9b686ed2beaacc7c3d973690df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.580458 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.580347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e9da9b686ed2beaacc7c3d973690df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal\" (UID: \"c7e9da9b686ed2beaacc7c3d973690df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.580458 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.580374 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e9da9b686ed2beaacc7c3d973690df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal\" (UID: \"c7e9da9b686ed2beaacc7c3d973690df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.580458 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.580401 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4922f8f5b3a3c97fad7fcd7149613037-config\") pod \"kube-apiserver-proxy-ip-10-0-131-101.ec2.internal\" (UID: \"4922f8f5b3a3c97fad7fcd7149613037\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.580458 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.580404 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7e9da9b686ed2beaacc7c3d973690df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal\" (UID: \"c7e9da9b686ed2beaacc7c3d973690df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.672584 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.672539 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-101.ec2.internal\" not found" Jun 11 16:19:58.773357 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.773289 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-101.ec2.internal\" not found" Jun 11 16:19:58.803785 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.803751 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.807917 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:58.807900 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-101.ec2.internal" Jun 11 16:19:58.873964 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.873917 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-101.ec2.internal\" not found" Jun 11 16:19:58.974543 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:58.974513 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-101.ec2.internal\" not found" Jun 11 16:19:59.068361 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.068274 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:59.077291 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.077272 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-101.ec2.internal" Jun 11 16:19:59.090053 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.090029 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:19:59.091664 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.091649 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" Jun 11 16:19:59.111402 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.111380 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:19:59.199578 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.199544 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:19:59.200169 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.199711 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:19:59.200169 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.199740 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:19:59.200169 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.199740 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:19:59.236466 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.236436 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:19:59.244443 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.244417 2580 apiserver.go:52] "Watching apiserver" Jun 11 16:19:59.252894 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.252862 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:19:59.253233 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.253213 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-p5dp9","kube-system/kube-apiserver-proxy-ip-10-0-131-101.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9","openshift-cluster-node-tuning-operator/tuned-s858k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal","openshift-multus/multus-additional-cni-plugins-8hqtk","openshift-multus/network-metrics-daemon-qg5m6","openshift-network-operator/iptables-alerter-9b9z2","kube-system/global-pull-secret-syncer-56n2p","openshift-dns/node-resolver-x82hp","openshift-image-registry/node-ca-j47kx","openshift-multus/multus-wbbwv","openshift-network-diagnostics/network-check-target-9vshq","openshift-ovn-kubernetes/ovnkube-node-gdbj7"] Jun 11 16:19:59.254640 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.254623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:19:59.254731 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.254707 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:19:59.256038 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.256017 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j47kx" Jun 11 16:19:59.257116 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.257099 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.258172 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.258159 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.258577 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.258554 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:19:59.258730 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.258706 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:19:59.258909 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.258875 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:19:59.258987 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.258973 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2mn7f\"" Jun 11 16:19:59.259337 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.259314 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.259422 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.259381 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-79m6b\"" Jun 11 16:19:59.259544 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.259480 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:19:59.259698 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.259681 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:19:59.259853 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.259841 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:19:59.260423 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.260406 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:19:59.260516 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.260441 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.260516 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.260470 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8sxtf\"" Jun 11 16:19:59.260671 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.260535 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:19:59.261713 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.261697 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:19:59.261793 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.261765 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:19:59.261932 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.261896 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:19:59.262028 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.262006 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:19:59.262945 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.262929 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:19:59.263019 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.262974 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:19:59.263502 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.263472 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:19:59.264049 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.264034 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:19:59.264189 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.264061 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:19:59.264189 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.264163 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-td8kl\"" Jun 11 16:19:59.264189 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.264177 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:19:59.264368 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.264204 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:19:59.264368 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.264214 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:19:59.264368 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.264231 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:19:59.264368 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.264168 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:19:59.264368 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.264230 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q6jbp\"" Jun 11 16:19:59.264649 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.264444 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9b9z2" Jun 11 16:19:59.264743 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.264729 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:19:59.265794 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.265781 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x82hp" Jun 11 16:19:59.267170 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.267154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:19:59.267777 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.267757 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:19:59.267898 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.267782 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4xt8f\"" Jun 11 16:19:59.267968 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.267901 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:19:59.268090 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.268074 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:19:59.268157 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.268089 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gcwkj\"" Jun 11 16:19:59.268157 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.268082 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:19:59.268395 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.268383 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:19:59.268567 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.268551 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.269450 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.269434 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:19:59.269783 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.269767 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-src2g\"" Jun 11 16:19:59.270122 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.270108 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:19:59.271400 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.271114 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:19:59.271400 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.271198 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bh7lh\"" Jun 11 16:19:59.276326 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.276279 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:14:58 +0000 UTC" deadline="2028-02-20 10:13:20.315974562 +0000 UTC" Jun 11 16:19:59.276326 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.276326 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14849h53m21.039651869s" Jun 11 16:19:59.276937 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.276922 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:19:59.278408 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.278392 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:19:59.284798 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.284777 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6ad4098e-5466-48d8-a01d-3266798cef13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.284882 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.284808 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d914bf-3912-41b1-a9c6-e7dda2172ba9-tmp-dir\") pod \"node-resolver-x82hp\" (UID: \"c1d914bf-3912-41b1-a9c6-e7dda2172ba9\") " pod="openshift-dns/node-resolver-x82hp" Jun 11 16:19:59.284882 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.284828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-sysctl-conf\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.284882 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.284853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.285040 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.284886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-os-release\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.285040 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.284926 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6ad4098e-5466-48d8-a01d-3266798cef13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.285040 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.284945 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:19:59.285040 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.284977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-etc-openvswitch\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.285040 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-cni-dir\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.285040 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-var-lib-cni-bin\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-run-multus-certs\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285058 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-modprobe-d\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285072 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-run\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-tmp\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285118 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-run-systemd\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285142 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4gg5\" (UniqueName: \"kubernetes.io/projected/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-kube-api-access-s4gg5\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285159 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-socket-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-cnibin\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285201 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/051b5568-c52b-4904-9e44-ff33691fd7ac-ovn-node-metrics-cert\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1d914bf-3912-41b1-a9c6-e7dda2172ba9-hosts-file\") pod \"node-resolver-x82hp\" (UID: \"c1d914bf-3912-41b1-a9c6-e7dda2172ba9\") " pod="openshift-dns/node-resolver-x82hp" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285228 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-kubernetes\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285247 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-sysctl-d\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285277 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-systemd\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285301 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-run-netns\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.285323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285317 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-etc-kubernetes\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-568mg\" (UniqueName: \"kubernetes.io/projected/35c1ad00-8649-48fe-a926-1677b92d6945-kube-api-access-568mg\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285361 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnw84\" (UniqueName: \"kubernetes.io/projected/f02b9ac4-6014-43d9-b7c6-310d4acd29af-kube-api-access-fnw84\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b2d9560a-496a-4806-86ff-f27541f82a97-konnectivity-ca\") pod \"konnectivity-agent-p5dp9\" (UID: \"b2d9560a-496a-4806-86ff-f27541f82a97\") " pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285391 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-cnibin\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285405 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khmg6\" (UniqueName: \"kubernetes.io/projected/1f61d24b-ee97-4a52-afeb-e13ad1ddb048-kube-api-access-khmg6\") pod \"node-ca-j47kx\" (UID: \"1f61d24b-ee97-4a52-afeb-e13ad1ddb048\") " pod="openshift-image-registry/node-ca-j47kx" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-device-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-etc-selinux\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285510 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ad4098e-5466-48d8-a01d-3266798cef13-cni-binary-copy\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-var-lib-cni-multus\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285567 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-daemon-config\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kft6j\" (UniqueName: \"kubernetes.io/projected/6ad4098e-5466-48d8-a01d-3266798cef13-kube-api-access-kft6j\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285658 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-slash\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7bfec33-1383-4953-b358-7120ea830541-host-slash\") pod \"iptables-alerter-9b9z2\" (UID: \"d7bfec33-1383-4953-b358-7120ea830541\") " pod="openshift-network-operator/iptables-alerter-9b9z2" Jun 11 16:19:59.286026 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-socket-dir-parent\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285738 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-run-k8s-cni-cncf-io\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-node-log\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-system-cni-dir\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285801 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-var-lib-kubelet\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285824 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f61d24b-ee97-4a52-afeb-e13ad1ddb048-host\") pod \"node-ca-j47kx\" (UID: \"1f61d24b-ee97-4a52-afeb-e13ad1ddb048\") " pod="openshift-image-registry/node-ca-j47kx" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vlvj\" (UniqueName: \"kubernetes.io/projected/d7bfec33-1383-4953-b358-7120ea830541-kube-api-access-6vlvj\") pod \"iptables-alerter-9b9z2\" (UID: \"d7bfec33-1383-4953-b358-7120ea830541\") " pod="openshift-network-operator/iptables-alerter-9b9z2" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285867 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-var-lib-kubelet\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285910 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-cni-bin\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25c20d12-a21c-400e-a8c2-dc2597f1318c-kubelet-config\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.285991 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f61d24b-ee97-4a52-afeb-e13ad1ddb048-serviceca\") pod \"node-ca-j47kx\" (UID: \"1f61d24b-ee97-4a52-afeb-e13ad1ddb048\") " pod="openshift-image-registry/node-ca-j47kx" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-system-cni-dir\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-var-lib-openvswitch\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286054 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-os-release\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-host\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.286643 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-run-netns\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286110 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-conf-dir\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286133 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286159 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/051b5568-c52b-4904-9e44-ff33691fd7ac-ovnkube-config\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286180 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/051b5568-c52b-4904-9e44-ff33691fd7ac-ovnkube-script-lib\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286202 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qsp\" (UniqueName: \"kubernetes.io/projected/051b5568-c52b-4904-9e44-ff33691fd7ac-kube-api-access-h5qsp\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-sysconfig\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-tuned\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-log-socket\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286286 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-cni-netd\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286300 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-sys\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-run-openvswitch\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-cni-binary-copy\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286384 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-registration-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286406 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-run-ovn\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25c20d12-a21c-400e-a8c2-dc2597f1318c-dbus\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:19:59.287076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-sys-fs\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.287608 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286474 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-kubelet\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287608 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286521 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7bfec33-1383-4953-b358-7120ea830541-iptables-alerter-script\") pod \"iptables-alerter-9b9z2\" (UID: \"d7bfec33-1383-4953-b358-7120ea830541\") " pod="openshift-network-operator/iptables-alerter-9b9z2" Jun 11 16:19:59.287608 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286557 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdtmt\" (UniqueName: \"kubernetes.io/projected/c1d914bf-3912-41b1-a9c6-e7dda2172ba9-kube-api-access-jdtmt\") pod \"node-resolver-x82hp\" (UID: \"c1d914bf-3912-41b1-a9c6-e7dda2172ba9\") " pod="openshift-dns/node-resolver-x82hp" Jun 11 16:19:59.287608 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286584 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-lib-modules\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.287608 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sblxz\" (UniqueName: \"kubernetes.io/projected/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-kube-api-access-sblxz\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.287608 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286633 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b2d9560a-496a-4806-86ff-f27541f82a97-agent-certs\") pod \"konnectivity-agent-p5dp9\" (UID: \"b2d9560a-496a-4806-86ff-f27541f82a97\") " pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:19:59.287608 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286662 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7xnl\" (UniqueName: \"kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl\") pod \"network-check-target-9vshq\" (UID: \"e90fa1c2-15f9-4810-bcef-bafcb578ec6c\") " pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:19:59.287608 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-systemd-units\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287608 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286703 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/051b5568-c52b-4904-9e44-ff33691fd7ac-env-overrides\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.287608 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.286723 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-hostroot\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.288182 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.288165 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:19:59.297752 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:59.297716 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e9da9b686ed2beaacc7c3d973690df.slice/crio-c546980ed898949530296e39b305aa61929d7c5bd5e79cad5ed9e7d7a6835d21 WatchSource:0}: Error finding container c546980ed898949530296e39b305aa61929d7c5bd5e79cad5ed9e7d7a6835d21: Status 404 returned error can't find the container with id c546980ed898949530296e39b305aa61929d7c5bd5e79cad5ed9e7d7a6835d21 Jun 11 16:19:59.298041 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:59.298024 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4922f8f5b3a3c97fad7fcd7149613037.slice/crio-66043ce74e21f055fd79c3259f130e00a4b7f3ca82351700a0ce23a1f5de96ab WatchSource:0}: Error finding container 66043ce74e21f055fd79c3259f130e00a4b7f3ca82351700a0ce23a1f5de96ab: Status 404 returned error can't find the container with id 66043ce74e21f055fd79c3259f130e00a4b7f3ca82351700a0ce23a1f5de96ab Jun 11 16:19:59.302934 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.302915 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:19:59.332056 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.332035 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d9w2f" Jun 11 16:19:59.340799 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.340782 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d9w2f" Jun 11 16:19:59.356586 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.356501 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-101.ec2.internal" event={"ID":"4922f8f5b3a3c97fad7fcd7149613037","Type":"ContainerStarted","Data":"66043ce74e21f055fd79c3259f130e00a4b7f3ca82351700a0ce23a1f5de96ab"} Jun 11 16:19:59.357555 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.357536 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" event={"ID":"c7e9da9b686ed2beaacc7c3d973690df","Type":"ContainerStarted","Data":"c546980ed898949530296e39b305aa61929d7c5bd5e79cad5ed9e7d7a6835d21"} Jun 11 16:19:59.387048 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f61d24b-ee97-4a52-afeb-e13ad1ddb048-serviceca\") pod \"node-ca-j47kx\" (UID: \"1f61d24b-ee97-4a52-afeb-e13ad1ddb048\") " pod="openshift-image-registry/node-ca-j47kx" Jun 11 16:19:59.387048 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387047 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-system-cni-dir\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.387198 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-var-lib-openvswitch\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387198 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:19:59.387198 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387118 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-os-release\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.387198 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387156 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-var-lib-openvswitch\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387198 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387156 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-system-cni-dir\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.387198 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-host\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-run-netns\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387233 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-os-release\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387255 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-host\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.387259 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387293 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-conf-dir\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387301 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-run-netns\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.387345 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret podName:25c20d12-a21c-400e-a8c2-dc2597f1318c nodeName:}" failed. No retries permitted until 2026-06-11 16:19:59.887320408 +0000 UTC m=+1.977630333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret") pod "global-pull-secret-syncer-56n2p" (UID: "25c20d12-a21c-400e-a8c2-dc2597f1318c") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387348 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-conf-dir\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387377 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/051b5568-c52b-4904-9e44-ff33691fd7ac-ovnkube-config\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387395 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/051b5568-c52b-4904-9e44-ff33691fd7ac-ovnkube-script-lib\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qsp\" (UniqueName: \"kubernetes.io/projected/051b5568-c52b-4904-9e44-ff33691fd7ac-kube-api-access-h5qsp\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-sysconfig\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-tuned\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387517 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-log-socket\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387557 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-log-socket\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387612 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-sysconfig\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387642 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-cni-netd\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387656 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f61d24b-ee97-4a52-afeb-e13ad1ddb048-serviceca\") pod \"node-ca-j47kx\" (UID: \"1f61d24b-ee97-4a52-afeb-e13ad1ddb048\") " pod="openshift-image-registry/node-ca-j47kx" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387674 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-sys\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387705 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-cni-netd\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-run-openvswitch\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387730 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-sys\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-cni-binary-copy\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-registration-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387769 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-run-openvswitch\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-run-ovn\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25c20d12-a21c-400e-a8c2-dc2597f1318c-dbus\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:19:59.387951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387832 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-sys-fs\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387852 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-run-ovn\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387910 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-sys-fs\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387959 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-registration-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-kubelet\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388007 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-kubelet\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7bfec33-1383-4953-b358-7120ea830541-iptables-alerter-script\") pod \"iptables-alerter-9b9z2\" (UID: \"d7bfec33-1383-4953-b358-7120ea830541\") " pod="openshift-network-operator/iptables-alerter-9b9z2" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdtmt\" (UniqueName: \"kubernetes.io/projected/c1d914bf-3912-41b1-a9c6-e7dda2172ba9-kube-api-access-jdtmt\") pod \"node-resolver-x82hp\" (UID: \"c1d914bf-3912-41b1-a9c6-e7dda2172ba9\") " pod="openshift-dns/node-resolver-x82hp" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387949 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388137 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-lib-modules\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-lib-modules\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388174 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sblxz\" (UniqueName: \"kubernetes.io/projected/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-kube-api-access-sblxz\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b2d9560a-496a-4806-86ff-f27541f82a97-agent-certs\") pod \"konnectivity-agent-p5dp9\" (UID: \"b2d9560a-496a-4806-86ff-f27541f82a97\") " pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xnl\" (UniqueName: \"kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl\") pod \"network-check-target-9vshq\" (UID: \"e90fa1c2-15f9-4810-bcef-bafcb578ec6c\") " pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-systemd-units\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/051b5568-c52b-4904-9e44-ff33691fd7ac-env-overrides\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-hostroot\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6ad4098e-5466-48d8-a01d-3266798cef13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.388725 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d914bf-3912-41b1-a9c6-e7dda2172ba9-tmp-dir\") pod \"node-resolver-x82hp\" (UID: \"c1d914bf-3912-41b1-a9c6-e7dda2172ba9\") " pod="openshift-dns/node-resolver-x82hp" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.387912 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25c20d12-a21c-400e-a8c2-dc2597f1318c-dbus\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388452 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/051b5568-c52b-4904-9e44-ff33691fd7ac-ovnkube-script-lib\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388512 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-cni-binary-copy\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388533 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-sysctl-conf\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388580 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-systemd-units\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-sysctl-conf\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388645 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-os-release\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6ad4098e-5466-48d8-a01d-3266798cef13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388692 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388708 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7bfec33-1383-4953-b358-7120ea830541-iptables-alerter-script\") pod \"iptables-alerter-9b9z2\" (UID: \"d7bfec33-1383-4953-b358-7120ea830541\") " pod="openshift-network-operator/iptables-alerter-9b9z2" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388718 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-etc-openvswitch\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388743 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-cni-dir\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388793 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-var-lib-cni-bin\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388819 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/051b5568-c52b-4904-9e44-ff33691fd7ac-env-overrides\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-run-multus-certs\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.389376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-modprobe-d\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388856 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-run-multus-certs\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388938 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.388961 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388988 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d914bf-3912-41b1-a9c6-e7dda2172ba9-tmp-dir\") pod \"node-resolver-x82hp\" (UID: \"c1d914bf-3912-41b1-a9c6-e7dda2172ba9\") " pod="openshift-dns/node-resolver-x82hp" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388999 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-os-release\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.389008 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs podName:f02b9ac4-6014-43d9-b7c6-310d4acd29af nodeName:}" failed. No retries permitted until 2026-06-11 16:19:59.888992007 +0000 UTC m=+1.979301914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs") pod "network-metrics-daemon-qg5m6" (UID: "f02b9ac4-6014-43d9-b7c6-310d4acd29af") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-run\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389039 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-var-lib-cni-bin\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389054 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6ad4098e-5466-48d8-a01d-3266798cef13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-tmp\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389078 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-run\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.388717 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-hostroot\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389107 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-etc-openvswitch\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-run-systemd\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4gg5\" (UniqueName: \"kubernetes.io/projected/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-kube-api-access-s4gg5\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389184 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-run-systemd\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-socket-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.390323 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-cnibin\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/051b5568-c52b-4904-9e44-ff33691fd7ac-ovnkube-config\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389247 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/051b5568-c52b-4904-9e44-ff33691fd7ac-ovn-node-metrics-cert\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389271 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1d914bf-3912-41b1-a9c6-e7dda2172ba9-hosts-file\") pod \"node-resolver-x82hp\" (UID: \"c1d914bf-3912-41b1-a9c6-e7dda2172ba9\") " pod="openshift-dns/node-resolver-x82hp" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389273 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-socket-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389146 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-cni-dir\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389290 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-cnibin\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-kubernetes\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389318 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-sysctl-d\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-systemd\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389349 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1d914bf-3912-41b1-a9c6-e7dda2172ba9-hosts-file\") pod \"node-resolver-x82hp\" (UID: \"c1d914bf-3912-41b1-a9c6-e7dda2172ba9\") " pod="openshift-dns/node-resolver-x82hp" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389360 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-kubernetes\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-run-netns\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389292 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6ad4098e-5466-48d8-a01d-3266798cef13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389396 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-etc-kubernetes\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389397 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-run-netns\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389434 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-systemd\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389522 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-etc-kubernetes\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.391173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389523 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-568mg\" (UniqueName: \"kubernetes.io/projected/35c1ad00-8649-48fe-a926-1677b92d6945-kube-api-access-568mg\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389580 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-sysctl-d\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnw84\" (UniqueName: \"kubernetes.io/projected/f02b9ac4-6014-43d9-b7c6-310d4acd29af-kube-api-access-fnw84\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389612 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-modprobe-d\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b2d9560a-496a-4806-86ff-f27541f82a97-konnectivity-ca\") pod \"konnectivity-agent-p5dp9\" (UID: \"b2d9560a-496a-4806-86ff-f27541f82a97\") " pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389832 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-cnibin\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.389878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khmg6\" (UniqueName: \"kubernetes.io/projected/1f61d24b-ee97-4a52-afeb-e13ad1ddb048-kube-api-access-khmg6\") pod \"node-ca-j47kx\" (UID: \"1f61d24b-ee97-4a52-afeb-e13ad1ddb048\") " pod="openshift-image-registry/node-ca-j47kx" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390067 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-device-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390150 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-etc-selinux\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ad4098e-5466-48d8-a01d-3266798cef13-cni-binary-copy\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-var-lib-cni-multus\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390247 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-daemon-config\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390326 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-var-lib-cni-multus\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390372 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-cnibin\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390405 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kft6j\" (UniqueName: \"kubernetes.io/projected/6ad4098e-5466-48d8-a01d-3266798cef13-kube-api-access-kft6j\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.391967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390459 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-slash\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7bfec33-1383-4953-b358-7120ea830541-host-slash\") pod \"iptables-alerter-9b9z2\" (UID: \"d7bfec33-1383-4953-b358-7120ea830541\") " pod="openshift-network-operator/iptables-alerter-9b9z2" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390518 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-socket-dir-parent\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-run-k8s-cni-cncf-io\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-node-log\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-system-cni-dir\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-var-lib-kubelet\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f61d24b-ee97-4a52-afeb-e13ad1ddb048-host\") pod \"node-ca-j47kx\" (UID: \"1f61d24b-ee97-4a52-afeb-e13ad1ddb048\") " pod="openshift-image-registry/node-ca-j47kx" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390778 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ad4098e-5466-48d8-a01d-3266798cef13-cni-binary-copy\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vlvj\" (UniqueName: \"kubernetes.io/projected/d7bfec33-1383-4953-b358-7120ea830541-kube-api-access-6vlvj\") pod \"iptables-alerter-9b9z2\" (UID: \"d7bfec33-1383-4953-b358-7120ea830541\") " pod="openshift-network-operator/iptables-alerter-9b9z2" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-var-lib-kubelet\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-cni-bin\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390835 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7bfec33-1383-4953-b358-7120ea830541-host-slash\") pod \"iptables-alerter-9b9z2\" (UID: \"d7bfec33-1383-4953-b358-7120ea830541\") " pod="openshift-network-operator/iptables-alerter-9b9z2" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390887 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-socket-dir-parent\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390930 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-cni-bin\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390968 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-run-k8s-cni-cncf-io\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.390983 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b2d9560a-496a-4806-86ff-f27541f82a97-konnectivity-ca\") pod \"konnectivity-agent-p5dp9\" (UID: \"b2d9560a-496a-4806-86ff-f27541f82a97\") " pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391010 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.392445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391040 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-host-slash\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25c20d12-a21c-400e-a8c2-dc2597f1318c-kubelet-config\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391083 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25c20d12-a21c-400e-a8c2-dc2597f1318c-kubelet-config\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391128 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-etc-selinux\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391170 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-host-var-lib-kubelet\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391202 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/051b5568-c52b-4904-9e44-ff33691fd7ac-node-log\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391215 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ad4098e-5466-48d8-a01d-3266798cef13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391244 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-system-cni-dir\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391360 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-multus-daemon-config\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391415 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-var-lib-kubelet\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391464 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f61d24b-ee97-4a52-afeb-e13ad1ddb048-host\") pod \"node-ca-j47kx\" (UID: \"1f61d24b-ee97-4a52-afeb-e13ad1ddb048\") " pod="openshift-image-registry/node-ca-j47kx" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391571 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35c1ad00-8649-48fe-a926-1677b92d6945-device-dir\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.391964 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-tmp\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.392042 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-etc-tuned\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.392099 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/051b5568-c52b-4904-9e44-ff33691fd7ac-ovn-node-metrics-cert\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.392960 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.392208 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b2d9560a-496a-4806-86ff-f27541f82a97-agent-certs\") pod \"konnectivity-agent-p5dp9\" (UID: \"b2d9560a-496a-4806-86ff-f27541f82a97\") " pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:19:59.398470 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.398442 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdtmt\" (UniqueName: \"kubernetes.io/projected/c1d914bf-3912-41b1-a9c6-e7dda2172ba9-kube-api-access-jdtmt\") pod \"node-resolver-x82hp\" (UID: \"c1d914bf-3912-41b1-a9c6-e7dda2172ba9\") " pod="openshift-dns/node-resolver-x82hp" Jun 11 16:19:59.398572 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.398506 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qsp\" (UniqueName: \"kubernetes.io/projected/051b5568-c52b-4904-9e44-ff33691fd7ac-kube-api-access-h5qsp\") pod \"ovnkube-node-gdbj7\" (UID: \"051b5568-c52b-4904-9e44-ff33691fd7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.398864 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.398848 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4gg5\" (UniqueName: \"kubernetes.io/projected/c3e454fd-2e6f-47c4-a7dc-9cf03f157670-kube-api-access-s4gg5\") pod \"multus-wbbwv\" (UID: \"c3e454fd-2e6f-47c4-a7dc-9cf03f157670\") " pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.400598 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.400550 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:59.405116 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.400908 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:59.405116 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.400945 2580 projected.go:196] Error preparing data for projected volume kube-api-access-s7xnl for pod openshift-network-diagnostics/network-check-target-9vshq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:59.405116 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.401029 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl podName:e90fa1c2-15f9-4810-bcef-bafcb578ec6c nodeName:}" failed. No retries permitted until 2026-06-11 16:19:59.901012065 +0000 UTC m=+1.991321992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s7xnl" (UniqueName: "kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl") pod "network-check-target-9vshq" (UID: "e90fa1c2-15f9-4810-bcef-bafcb578ec6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:59.405116 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.402625 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sblxz\" (UniqueName: \"kubernetes.io/projected/59c0dc69-1d2f-44ba-ad88-18f42fa78e2e-kube-api-access-sblxz\") pod \"tuned-s858k\" (UID: \"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e\") " pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.405116 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.403028 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-568mg\" (UniqueName: \"kubernetes.io/projected/35c1ad00-8649-48fe-a926-1677b92d6945-kube-api-access-568mg\") pod \"aws-ebs-csi-driver-node-vt4g9\" (UID: \"35c1ad00-8649-48fe-a926-1677b92d6945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.405798 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.405778 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vlvj\" (UniqueName: \"kubernetes.io/projected/d7bfec33-1383-4953-b358-7120ea830541-kube-api-access-6vlvj\") pod \"iptables-alerter-9b9z2\" (UID: \"d7bfec33-1383-4953-b358-7120ea830541\") " pod="openshift-network-operator/iptables-alerter-9b9z2" Jun 11 16:19:59.406421 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.406397 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnw84\" (UniqueName: \"kubernetes.io/projected/f02b9ac4-6014-43d9-b7c6-310d4acd29af-kube-api-access-fnw84\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:19:59.406720 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.406703 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khmg6\" (UniqueName: \"kubernetes.io/projected/1f61d24b-ee97-4a52-afeb-e13ad1ddb048-kube-api-access-khmg6\") pod \"node-ca-j47kx\" (UID: \"1f61d24b-ee97-4a52-afeb-e13ad1ddb048\") " pod="openshift-image-registry/node-ca-j47kx" Jun 11 16:19:59.407074 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.407059 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kft6j\" (UniqueName: \"kubernetes.io/projected/6ad4098e-5466-48d8-a01d-3266798cef13-kube-api-access-kft6j\") pod \"multus-additional-cni-plugins-8hqtk\" (UID: \"6ad4098e-5466-48d8-a01d-3266798cef13\") " pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.574199 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.574168 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j47kx" Jun 11 16:19:59.582831 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:59.582803 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f61d24b_ee97_4a52_afeb_e13ad1ddb048.slice/crio-8d14960a199eb79b04a0b5af48ef3649df96eae4aae0a6a5a315399a0a1b440c WatchSource:0}: Error finding container 8d14960a199eb79b04a0b5af48ef3649df96eae4aae0a6a5a315399a0a1b440c: Status 404 returned error can't find the container with id 8d14960a199eb79b04a0b5af48ef3649df96eae4aae0a6a5a315399a0a1b440c Jun 11 16:19:59.598971 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.598929 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:19:59.606314 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:59.606281 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d9560a_496a_4806_86ff_f27541f82a97.slice/crio-ce24def03e5d0d3a7d3e1650c14963f16c19852e318905401763d0ea08bd9be2 WatchSource:0}: Error finding container ce24def03e5d0d3a7d3e1650c14963f16c19852e318905401763d0ea08bd9be2: Status 404 returned error can't find the container with id ce24def03e5d0d3a7d3e1650c14963f16c19852e318905401763d0ea08bd9be2 Jun 11 16:19:59.606402 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.606347 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" Jun 11 16:19:59.610814 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.610795 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s858k" Jun 11 16:19:59.613959 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:59.613939 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c1ad00_8649_48fe_a926_1677b92d6945.slice/crio-b72a4f6a7550b4d1432416a5d127bdfe8595e5823ca0047eade30427259fa86f WatchSource:0}: Error finding container b72a4f6a7550b4d1432416a5d127bdfe8595e5823ca0047eade30427259fa86f: Status 404 returned error can't find the container with id b72a4f6a7550b4d1432416a5d127bdfe8595e5823ca0047eade30427259fa86f Jun 11 16:19:59.616948 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.616936 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:19:59.618637 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:59.618613 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c0dc69_1d2f_44ba_ad88_18f42fa78e2e.slice/crio-d2684d1713c11ccfce73779ef527ea9e8a56345fbf0eedd3ed9816b4e4b66f5d WatchSource:0}: Error finding container d2684d1713c11ccfce73779ef527ea9e8a56345fbf0eedd3ed9816b4e4b66f5d: Status 404 returned error can't find the container with id d2684d1713c11ccfce73779ef527ea9e8a56345fbf0eedd3ed9816b4e4b66f5d Jun 11 16:19:59.621102 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.621059 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8hqtk" Jun 11 16:19:59.627405 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:59.627383 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051b5568_c52b_4904_9e44_ff33691fd7ac.slice/crio-906cee9978fb20096736199c70d5d74ee07b574f0f39ab0cd70f22b5f06a590a WatchSource:0}: Error finding container 906cee9978fb20096736199c70d5d74ee07b574f0f39ab0cd70f22b5f06a590a: Status 404 returned error can't find the container with id 906cee9978fb20096736199c70d5d74ee07b574f0f39ab0cd70f22b5f06a590a Jun 11 16:19:59.628168 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.628153 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9b9z2" Jun 11 16:19:59.629752 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:59.629729 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad4098e_5466_48d8_a01d_3266798cef13.slice/crio-1098ec2705483675ea864e655ffa5f3c8ad3e6dcd4b4aa797b82afb2ec38d851 WatchSource:0}: Error finding container 1098ec2705483675ea864e655ffa5f3c8ad3e6dcd4b4aa797b82afb2ec38d851: Status 404 returned error can't find the container with id 1098ec2705483675ea864e655ffa5f3c8ad3e6dcd4b4aa797b82afb2ec38d851 Jun 11 16:19:59.633243 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.633163 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x82hp" Jun 11 16:19:59.636558 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:59.636527 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bfec33_1383_4953_b358_7120ea830541.slice/crio-41fc8ccbbba7f73fa8f1f8325d4959e545f474be1d2f756df75d666d0e121b65 WatchSource:0}: Error finding container 41fc8ccbbba7f73fa8f1f8325d4959e545f474be1d2f756df75d666d0e121b65: Status 404 returned error can't find the container with id 41fc8ccbbba7f73fa8f1f8325d4959e545f474be1d2f756df75d666d0e121b65 Jun 11 16:19:59.637041 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.637020 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wbbwv" Jun 11 16:19:59.643532 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:59.643502 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d914bf_3912_41b1_a9c6_e7dda2172ba9.slice/crio-5c05e4d5172a95cd89689234674087ae1a08d84ab51dc3096e546091944c3f29 WatchSource:0}: Error finding container 5c05e4d5172a95cd89689234674087ae1a08d84ab51dc3096e546091944c3f29: Status 404 returned error can't find the container with id 5c05e4d5172a95cd89689234674087ae1a08d84ab51dc3096e546091944c3f29 Jun 11 16:19:59.647069 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:19:59.647046 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e454fd_2e6f_47c4_a7dc_9cf03f157670.slice/crio-635f521299c5863095e3c4454dbe74688cedbfdad122d06dd3e3315dfcb30058 WatchSource:0}: Error finding container 635f521299c5863095e3c4454dbe74688cedbfdad122d06dd3e3315dfcb30058: Status 404 returned error can't find the container with id 635f521299c5863095e3c4454dbe74688cedbfdad122d06dd3e3315dfcb30058 Jun 11 16:19:59.895453 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.895374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:19:59.895631 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.895456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:19:59.895631 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.895556 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:59.895631 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.895582 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:59.895631 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.895625 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs podName:f02b9ac4-6014-43d9-b7c6-310d4acd29af nodeName:}" failed. No retries permitted until 2026-06-11 16:20:00.895604401 +0000 UTC m=+2.985914308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs") pod "network-metrics-daemon-qg5m6" (UID: "f02b9ac4-6014-43d9-b7c6-310d4acd29af") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:19:59.895833 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.895641 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret podName:25c20d12-a21c-400e-a8c2-dc2597f1318c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:00.895634128 +0000 UTC m=+2.985944034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret") pod "global-pull-secret-syncer-56n2p" (UID: "25c20d12-a21c-400e-a8c2-dc2597f1318c") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:19:59.996170 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:19:59.996134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xnl\" (UniqueName: \"kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl\") pod \"network-check-target-9vshq\" (UID: \"e90fa1c2-15f9-4810-bcef-bafcb578ec6c\") " pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:19:59.996350 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.996312 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:19:59.996350 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.996334 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:19:59.996350 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.996347 2580 projected.go:196] Error preparing data for projected volume kube-api-access-s7xnl for pod openshift-network-diagnostics/network-check-target-9vshq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:19:59.996572 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:19:59.996407 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl podName:e90fa1c2-15f9-4810-bcef-bafcb578ec6c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:00.996388728 +0000 UTC m=+3.086698640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7xnl" (UniqueName: "kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl") pod "network-check-target-9vshq" (UID: "e90fa1c2-15f9-4810-bcef-bafcb578ec6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:00.040873 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.040839 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:20:00.112333 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.112036 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:20:00.343703 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.343557 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:14:59 +0000 UTC" deadline="2028-03-05 22:14:47.709403824 +0000 UTC" Jun 11 16:20:00.343703 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.343601 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15197h54m47.365809099s" Jun 11 16:20:00.354483 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.353933 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:00.354483 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:00.354077 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:00.390187 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.390139 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x82hp" event={"ID":"c1d914bf-3912-41b1-a9c6-e7dda2172ba9","Type":"ContainerStarted","Data":"5c05e4d5172a95cd89689234674087ae1a08d84ab51dc3096e546091944c3f29"} Jun 11 16:20:00.400744 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.400662 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9b9z2" event={"ID":"d7bfec33-1383-4953-b358-7120ea830541","Type":"ContainerStarted","Data":"41fc8ccbbba7f73fa8f1f8325d4959e545f474be1d2f756df75d666d0e121b65"} Jun 11 16:20:00.417378 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.417156 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hqtk" event={"ID":"6ad4098e-5466-48d8-a01d-3266798cef13","Type":"ContainerStarted","Data":"1098ec2705483675ea864e655ffa5f3c8ad3e6dcd4b4aa797b82afb2ec38d851"} Jun 11 16:20:00.432912 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.432874 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s858k" event={"ID":"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e","Type":"ContainerStarted","Data":"d2684d1713c11ccfce73779ef527ea9e8a56345fbf0eedd3ed9816b4e4b66f5d"} Jun 11 16:20:00.479939 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.479798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" event={"ID":"35c1ad00-8649-48fe-a926-1677b92d6945","Type":"ContainerStarted","Data":"b72a4f6a7550b4d1432416a5d127bdfe8595e5823ca0047eade30427259fa86f"} Jun 11 16:20:00.482795 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.482708 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p5dp9" event={"ID":"b2d9560a-496a-4806-86ff-f27541f82a97","Type":"ContainerStarted","Data":"ce24def03e5d0d3a7d3e1650c14963f16c19852e318905401763d0ea08bd9be2"} Jun 11 16:20:00.490432 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.490390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j47kx" event={"ID":"1f61d24b-ee97-4a52-afeb-e13ad1ddb048","Type":"ContainerStarted","Data":"8d14960a199eb79b04a0b5af48ef3649df96eae4aae0a6a5a315399a0a1b440c"} Jun 11 16:20:00.500988 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.500948 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wbbwv" event={"ID":"c3e454fd-2e6f-47c4-a7dc-9cf03f157670","Type":"ContainerStarted","Data":"635f521299c5863095e3c4454dbe74688cedbfdad122d06dd3e3315dfcb30058"} Jun 11 16:20:00.513349 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.513287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" event={"ID":"051b5568-c52b-4904-9e44-ff33691fd7ac","Type":"ContainerStarted","Data":"906cee9978fb20096736199c70d5d74ee07b574f0f39ab0cd70f22b5f06a590a"} Jun 11 16:20:00.858369 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.858337 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:20:00.905292 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.905236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:00.905461 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:00.905309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:00.905461 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:00.905427 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:00.905600 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:00.905507 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret podName:25c20d12-a21c-400e-a8c2-dc2597f1318c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:02.905470084 +0000 UTC m=+4.995779994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret") pod "global-pull-secret-syncer-56n2p" (UID: "25c20d12-a21c-400e-a8c2-dc2597f1318c") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:00.905928 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:00.905908 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:00.906069 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:00.905965 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs podName:f02b9ac4-6014-43d9-b7c6-310d4acd29af nodeName:}" failed. No retries permitted until 2026-06-11 16:20:02.90594769 +0000 UTC m=+4.996257602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs") pod "network-metrics-daemon-qg5m6" (UID: "f02b9ac4-6014-43d9-b7c6-310d4acd29af") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:01.006535 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:01.006475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xnl\" (UniqueName: \"kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl\") pod \"network-check-target-9vshq\" (UID: \"e90fa1c2-15f9-4810-bcef-bafcb578ec6c\") " pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:01.006721 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:01.006659 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:20:01.006721 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:01.006682 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:20:01.006721 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:01.006694 2580 projected.go:196] Error preparing data for projected volume kube-api-access-s7xnl for pod openshift-network-diagnostics/network-check-target-9vshq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:01.006870 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:01.006754 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl podName:e90fa1c2-15f9-4810-bcef-bafcb578ec6c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:03.006736798 +0000 UTC m=+5.097046707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7xnl" (UniqueName: "kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl") pod "network-check-target-9vshq" (UID: "e90fa1c2-15f9-4810-bcef-bafcb578ec6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:01.344802 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:01.344688 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:14:59 +0000 UTC" deadline="2028-01-10 08:39:26.660317485 +0000 UTC" Jun 11 16:20:01.344802 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:01.344753 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13864h19m25.315568703s" Jun 11 16:20:01.353179 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:01.353142 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:01.353369 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:01.353291 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:01.353778 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:01.353757 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:01.353889 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:01.353863 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:02.358192 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:02.357721 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:02.358192 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:02.357851 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:02.924542 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:02.924507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:02.924749 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:02.924587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:02.924749 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:02.924715 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:02.924865 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:02.924773 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret podName:25c20d12-a21c-400e-a8c2-dc2597f1318c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:06.924754743 +0000 UTC m=+9.015064656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret") pod "global-pull-secret-syncer-56n2p" (UID: "25c20d12-a21c-400e-a8c2-dc2597f1318c") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:02.925178 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:02.925159 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:02.925310 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:02.925212 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs podName:f02b9ac4-6014-43d9-b7c6-310d4acd29af nodeName:}" failed. No retries permitted until 2026-06-11 16:20:06.925196256 +0000 UTC m=+9.015506169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs") pod "network-metrics-daemon-qg5m6" (UID: "f02b9ac4-6014-43d9-b7c6-310d4acd29af") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:03.025381 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:03.025347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xnl\" (UniqueName: \"kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl\") pod \"network-check-target-9vshq\" (UID: \"e90fa1c2-15f9-4810-bcef-bafcb578ec6c\") " pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:03.025586 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:03.025516 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:20:03.025586 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:03.025541 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:20:03.025586 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:03.025554 2580 projected.go:196] Error preparing data for projected volume kube-api-access-s7xnl for pod openshift-network-diagnostics/network-check-target-9vshq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:03.025734 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:03.025617 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl podName:e90fa1c2-15f9-4810-bcef-bafcb578ec6c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:07.025599154 +0000 UTC m=+9.115909068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7xnl" (UniqueName: "kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl") pod "network-check-target-9vshq" (UID: "e90fa1c2-15f9-4810-bcef-bafcb578ec6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:03.354067 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:03.353718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:03.354067 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:03.353854 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:03.354067 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:03.353888 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:03.354067 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:03.353949 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:04.353618 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:04.353588 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:04.354065 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:04.353729 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:05.353198 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:05.353164 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:05.353378 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:05.353274 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:05.353663 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:05.353633 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:05.354062 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:05.353745 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:06.356258 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:06.356226 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:06.356744 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:06.356366 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:06.960836 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:06.960799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:06.961003 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:06.960885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:06.961003 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:06.960950 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:06.961109 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:06.961017 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:06.961109 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:06.961029 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs podName:f02b9ac4-6014-43d9-b7c6-310d4acd29af nodeName:}" failed. No retries permitted until 2026-06-11 16:20:14.961006707 +0000 UTC m=+17.051316619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs") pod "network-metrics-daemon-qg5m6" (UID: "f02b9ac4-6014-43d9-b7c6-310d4acd29af") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:06.961109 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:06.961069 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret podName:25c20d12-a21c-400e-a8c2-dc2597f1318c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:14.961054128 +0000 UTC m=+17.051364041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret") pod "global-pull-secret-syncer-56n2p" (UID: "25c20d12-a21c-400e-a8c2-dc2597f1318c") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:07.061860 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:07.061819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xnl\" (UniqueName: \"kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl\") pod \"network-check-target-9vshq\" (UID: \"e90fa1c2-15f9-4810-bcef-bafcb578ec6c\") " pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:07.062051 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:07.062028 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:20:07.062114 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:07.062054 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:20:07.062114 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:07.062064 2580 projected.go:196] Error preparing data for projected volume kube-api-access-s7xnl for pod openshift-network-diagnostics/network-check-target-9vshq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:07.062210 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:07.062116 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl podName:e90fa1c2-15f9-4810-bcef-bafcb578ec6c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:15.062097763 +0000 UTC m=+17.152407670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7xnl" (UniqueName: "kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl") pod "network-check-target-9vshq" (UID: "e90fa1c2-15f9-4810-bcef-bafcb578ec6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:07.353046 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:07.352956 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:07.353219 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:07.353092 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:07.353732 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:07.353565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:07.353732 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:07.353683 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:08.353605 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:08.353574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:08.354078 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:08.353720 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:09.353104 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:09.353021 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:09.353251 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:09.353149 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:09.353474 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:09.353457 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:09.353565 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:09.353548 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:10.353481 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:10.352976 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:10.353481 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:10.353109 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:11.353662 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:11.353626 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:11.354056 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:11.353769 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:11.354056 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:11.353821 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:11.354056 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:11.353921 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:12.353796 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:12.353763 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:12.354199 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:12.353904 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:13.353745 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:13.353705 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:13.353944 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:13.353705 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:13.353944 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:13.353833 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:13.353944 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:13.353900 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:14.353540 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:14.353502 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:14.353714 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:14.353622 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:15.019883 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:15.019847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:15.020351 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:15.019929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:15.020351 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:15.020022 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:15.020351 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:15.020047 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:15.020351 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:15.020103 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret podName:25c20d12-a21c-400e-a8c2-dc2597f1318c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:31.020082249 +0000 UTC m=+33.110392171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret") pod "global-pull-secret-syncer-56n2p" (UID: "25c20d12-a21c-400e-a8c2-dc2597f1318c") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:15.020351 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:15.020125 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs podName:f02b9ac4-6014-43d9-b7c6-310d4acd29af nodeName:}" failed. No retries permitted until 2026-06-11 16:20:31.020113867 +0000 UTC m=+33.110423791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs") pod "network-metrics-daemon-qg5m6" (UID: "f02b9ac4-6014-43d9-b7c6-310d4acd29af") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:15.120695 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:15.120646 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xnl\" (UniqueName: \"kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl\") pod \"network-check-target-9vshq\" (UID: \"e90fa1c2-15f9-4810-bcef-bafcb578ec6c\") " pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:15.120861 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:15.120820 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:20:15.120861 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:15.120839 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:20:15.120861 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:15.120851 2580 projected.go:196] Error preparing data for projected volume kube-api-access-s7xnl for pod openshift-network-diagnostics/network-check-target-9vshq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:15.121018 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:15.120908 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl podName:e90fa1c2-15f9-4810-bcef-bafcb578ec6c nodeName:}" failed. No retries permitted until 2026-06-11 16:20:31.120891317 +0000 UTC m=+33.211201241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7xnl" (UniqueName: "kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl") pod "network-check-target-9vshq" (UID: "e90fa1c2-15f9-4810-bcef-bafcb578ec6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:15.352863 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:15.352791 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:15.353053 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:15.352919 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:15.353053 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:15.352973 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:15.353176 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:15.353091 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:16.352819 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:16.352787 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:16.353294 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:16.352921 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:17.353100 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:17.353065 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:17.353638 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:17.353186 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:17.353638 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:17.353248 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:17.353638 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:17.353354 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:18.353883 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:18.353850 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:18.354314 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:18.353963 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:19.353802 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:19.353776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:19.353802 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:19.353811 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:19.354260 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:19.353897 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:19.354260 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:19.354007 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:20.353375 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.353108 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:20.353482 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:20.353464 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:20.571229 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.571196 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s858k" event={"ID":"59c0dc69-1d2f-44ba-ad88-18f42fa78e2e","Type":"ContainerStarted","Data":"e16981bd2a1855950e1f65d3866bae80a5344e8190ba7707652b844a11e16e0b"} Jun 11 16:20:20.572748 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.572717 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-101.ec2.internal" event={"ID":"4922f8f5b3a3c97fad7fcd7149613037","Type":"ContainerStarted","Data":"1ad6a9211f67ada547bcfd608cde6e6e29107fbd68ed40e5686e7c95e40a7857"} Jun 11 16:20:20.574079 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.574055 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wbbwv" event={"ID":"c3e454fd-2e6f-47c4-a7dc-9cf03f157670","Type":"ContainerStarted","Data":"bf2a737d7d2b2b85fee473f3cd8d61ec8a136aaa1fcb6f15593f89b4c18d0ce8"} Jun 11 16:20:20.579102 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.579082 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:20:20.579412 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.579396 2580 generic.go:356] "Generic (PLEG): container finished" podID="051b5568-c52b-4904-9e44-ff33691fd7ac" containerID="f7f1321f4d3fd0a51ca8a53b6c4f7f477f18b04dca247a86a45001d7189074e9" exitCode=1 Jun 11 16:20:20.579466 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.579422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" event={"ID":"051b5568-c52b-4904-9e44-ff33691fd7ac","Type":"ContainerStarted","Data":"87022df6945d12b757e03e93ecadf4b42b26d02b540442a096175e3911206933"} Jun 11 16:20:20.579523 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.579466 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" event={"ID":"051b5568-c52b-4904-9e44-ff33691fd7ac","Type":"ContainerStarted","Data":"5c416ac9c8b2bf30053454aa9660d84cfdf650672b8c8c087b5b0e9577a9c983"} Jun 11 16:20:20.579523 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.579519 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" event={"ID":"051b5568-c52b-4904-9e44-ff33691fd7ac","Type":"ContainerStarted","Data":"2d2ee14d40241fe3bad31bb01fc32fb6d5bf4b60d832834d41f73a904b9b404b"} Jun 11 16:20:20.579590 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.579549 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" event={"ID":"051b5568-c52b-4904-9e44-ff33691fd7ac","Type":"ContainerStarted","Data":"659d13f3dc0bdc262557b736cd1b0713e9b4c75a7a4c0d4ed88a4129635f887b"} Jun 11 16:20:20.579590 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.579575 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" event={"ID":"051b5568-c52b-4904-9e44-ff33691fd7ac","Type":"ContainerDied","Data":"f7f1321f4d3fd0a51ca8a53b6c4f7f477f18b04dca247a86a45001d7189074e9"} Jun 11 16:20:20.579649 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.579605 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" event={"ID":"051b5568-c52b-4904-9e44-ff33691fd7ac","Type":"ContainerStarted","Data":"2b07631478146d74a5daecc07ae59a5cf054a21a2e6c010c9a01473e442f0171"} Jun 11 16:20:20.595069 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.595023 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s858k" podStartSLOduration=2.598717812 podStartE2EDuration="22.595010477s" totalImagesPullingTime="19.996292665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:20.594901027 +0000 UTC m=+22.685210955" watchObservedRunningTime="2026-06-11 16:20:20.595010477 +0000 UTC m=+22.685320405" Jun 11 16:20:20.617304 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:20.617253 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wbbwv" podStartSLOduration=2.218547558 podStartE2EDuration="22.617234401s" totalImagesPullingTime="20.398686843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:20.61716877 +0000 UTC m=+22.707478721" watchObservedRunningTime="2026-06-11 16:20:20.617234401 +0000 UTC m=+22.707544331" Jun 11 16:20:21.353238 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.353046 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:21.353438 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.353103 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:21.353438 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:21.353333 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:21.353438 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:21.353364 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:21.582459 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.582429 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" event={"ID":"35c1ad00-8649-48fe-a926-1677b92d6945","Type":"ContainerStarted","Data":"48c614498aad50c6bc216312bada4dbd11335d560f25aaa6affe3aa0899b0617"} Jun 11 16:20:21.583634 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.583611 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p5dp9" event={"ID":"b2d9560a-496a-4806-86ff-f27541f82a97","Type":"ContainerStarted","Data":"32ca2260370f3bd0af624ef1c99f70d3e5bbcc45ff69466863b17526aaf0aab9"} Jun 11 16:20:21.584967 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.584940 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j47kx" event={"ID":"1f61d24b-ee97-4a52-afeb-e13ad1ddb048","Type":"ContainerStarted","Data":"123ec7f8cd4e3e2e512388bfbc9dcb28cd7c5373ddd6e9fb0967146a054cc03c"} Jun 11 16:20:21.586313 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.586289 2580 generic.go:356] "Generic (PLEG): container finished" podID="c7e9da9b686ed2beaacc7c3d973690df" containerID="cfd5806b0810d70903853f312d15189589449eafa81e60bd289ec53a65165912" exitCode=0 Jun 11 16:20:21.586413 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.586375 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" event={"ID":"c7e9da9b686ed2beaacc7c3d973690df","Type":"ContainerDied","Data":"cfd5806b0810d70903853f312d15189589449eafa81e60bd289ec53a65165912"} Jun 11 16:20:21.587644 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.587620 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x82hp" event={"ID":"c1d914bf-3912-41b1-a9c6-e7dda2172ba9","Type":"ContainerStarted","Data":"8a2398c472f83b9ae65b4b1fc7999e67f9b3fc5f2124f141f64c0deb60a18f22"} Jun 11 16:20:21.589719 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.589696 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9b9z2" event={"ID":"d7bfec33-1383-4953-b358-7120ea830541","Type":"ContainerStarted","Data":"a6df420388ab270e8ea215f36623d50802cd50a397b2e42bf58948a8a8bef080"} Jun 11 16:20:21.591672 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.591636 2580 generic.go:356] "Generic (PLEG): container finished" podID="6ad4098e-5466-48d8-a01d-3266798cef13" containerID="171c9d656c079b79e118531b8d7db25dac7bed735bfac6ab201934dcdc4aa08f" exitCode=0 Jun 11 16:20:21.592150 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.592097 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hqtk" event={"ID":"6ad4098e-5466-48d8-a01d-3266798cef13","Type":"ContainerDied","Data":"171c9d656c079b79e118531b8d7db25dac7bed735bfac6ab201934dcdc4aa08f"} Jun 11 16:20:21.601874 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.601839 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-101.ec2.internal" podStartSLOduration=22.601828167 podStartE2EDuration="22.601828167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:20.636593696 +0000 UTC m=+22.726903624" watchObservedRunningTime="2026-06-11 16:20:21.601828167 +0000 UTC m=+23.692138095" Jun 11 16:20:21.619139 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.619076 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j47kx" podStartSLOduration=3.585259368 podStartE2EDuration="23.619065165s" totalImagesPullingTime="20.033805797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:21.618746462 +0000 UTC m=+23.709056391" watchObservedRunningTime="2026-06-11 16:20:21.619065165 +0000 UTC m=+23.709375093" Jun 11 16:20:21.619325 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.619307 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p5dp9" podStartSLOduration=3.609026471 podStartE2EDuration="23.619301274s" totalImagesPullingTime="20.010274803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:21.601952651 +0000 UTC m=+23.692262575" watchObservedRunningTime="2026-06-11 16:20:21.619301274 +0000 UTC m=+23.709611251" Jun 11 16:20:21.678360 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.678208 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9b9z2" podStartSLOduration=3.697089853 podStartE2EDuration="23.678193841s" totalImagesPullingTime="19.981103988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:21.66147898 +0000 UTC m=+23.751788969" watchObservedRunningTime="2026-06-11 16:20:21.678193841 +0000 UTC m=+23.768503770" Jun 11 16:20:21.693331 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.693295 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x82hp" podStartSLOduration=3.7196150550000002 podStartE2EDuration="23.693282208s" totalImagesPullingTime="19.973667153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:21.693053463 +0000 UTC m=+23.783363392" watchObservedRunningTime="2026-06-11 16:20:21.693282208 +0000 UTC m=+23.783592136" Jun 11 16:20:21.808569 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:21.808541 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:20:22.353854 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:22.353099 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:20:21.808565486Z","UUID":"228974b0-e9bf-4fbc-9d66-620077b85935","Handler":null,"Name":"","Endpoint":""} Jun 11 16:20:22.353854 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:22.353377 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:22.353854 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:22.353519 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:22.355248 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:22.355215 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:20:22.355357 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:22.355262 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:20:22.596134 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:22.596072 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" event={"ID":"c7e9da9b686ed2beaacc7c3d973690df","Type":"ContainerStarted","Data":"66944c076ade97e282f8b45834d8e97974a0c497ebfbb2d875041bf4effbb515"} Jun 11 16:20:22.602641 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:22.602619 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:20:22.603971 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:22.603163 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" event={"ID":"051b5568-c52b-4904-9e44-ff33691fd7ac","Type":"ContainerStarted","Data":"f54f762050b6d85c4c2209e412d7fe4db9122e16f7e5451806f4c28ddc60e8ad"} Jun 11 16:20:22.606483 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:22.606458 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" event={"ID":"35c1ad00-8649-48fe-a926-1677b92d6945","Type":"ContainerStarted","Data":"6d7aeceb3ad5d52847dfa2621742a90c065a4be3825832d4916b3da3208eac73"} Jun 11 16:20:22.614037 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:22.613996 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-101.ec2.internal" podStartSLOduration=23.613983243 podStartE2EDuration="23.613983243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:22.612925314 +0000 UTC m=+24.703235268" watchObservedRunningTime="2026-06-11 16:20:22.613983243 +0000 UTC m=+24.704293172" Jun 11 16:20:23.052533 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:23.052503 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:20:23.053119 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:23.053098 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:20:23.352869 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:23.352845 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:23.352869 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:23.352870 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:23.353085 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:23.352936 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:23.353085 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:23.353069 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:23.611430 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:23.610939 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" event={"ID":"35c1ad00-8649-48fe-a926-1677b92d6945","Type":"ContainerStarted","Data":"9fe73e8f54c1c59021763c2cda1449b8aaeb3ec345eefcde94bf6b554d848ce0"} Jun 11 16:20:23.611430 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:23.611357 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:20:23.611990 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:23.611909 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p5dp9" Jun 11 16:20:23.657127 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:23.657085 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt4g9" podStartSLOduration=3.61194194 podStartE2EDuration="25.657071193s" totalImagesPullingTime="22.045129253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:23.637330684 +0000 UTC m=+25.727640629" watchObservedRunningTime="2026-06-11 16:20:23.657071193 +0000 UTC m=+25.747381124" Jun 11 16:20:24.353175 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:24.353144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:24.353352 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:24.353276 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:25.352986 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:25.352951 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:25.353360 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:25.353059 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:25.353360 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:25.353112 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:25.353360 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:25.353191 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:25.622385 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:25.622316 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:20:25.622775 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:25.622752 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" event={"ID":"051b5568-c52b-4904-9e44-ff33691fd7ac","Type":"ContainerStarted","Data":"f21debd5303f2a7c6aef9255ee6f81b875d742e437bdd2281aab762ea22592d2"} Jun 11 16:20:25.623226 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:25.623063 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:20:25.623293 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:25.623262 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:20:25.623293 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:25.623272 2580 scope.go:117] "RemoveContainer" containerID="f7f1321f4d3fd0a51ca8a53b6c4f7f477f18b04dca247a86a45001d7189074e9" Jun 11 16:20:25.641080 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:25.641059 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:20:26.353596 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:26.353568 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:26.354018 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:26.353727 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:26.770449 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:26.770415 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9vshq"] Jun 11 16:20:26.770645 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:26.770576 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:26.770704 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:26.770665 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:26.774266 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:26.774191 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-56n2p"] Jun 11 16:20:26.774266 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:26.774247 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qg5m6"] Jun 11 16:20:26.774444 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:26.774333 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:26.774542 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:26.774510 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:26.774677 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:26.774598 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:26.774742 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:26.774682 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:27.633550 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:27.633478 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:20:27.634220 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:27.633945 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" event={"ID":"051b5568-c52b-4904-9e44-ff33691fd7ac","Type":"ContainerStarted","Data":"8af4e25bdd5f1e551095ae1cd957d8e7472ee2b11dee2c472cc2eee4fb50cbc0"} Jun 11 16:20:27.634282 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:27.634229 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:20:27.635956 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:27.635935 2580 generic.go:356] "Generic (PLEG): container finished" podID="6ad4098e-5466-48d8-a01d-3266798cef13" containerID="1419b7537bf3e271e2c1099dfb9901dfa5bcfc30b2c42f5ced1898199a3e846d" exitCode=0 Jun 11 16:20:27.636072 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:27.636009 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hqtk" event={"ID":"6ad4098e-5466-48d8-a01d-3266798cef13","Type":"ContainerDied","Data":"1419b7537bf3e271e2c1099dfb9901dfa5bcfc30b2c42f5ced1898199a3e846d"} Jun 11 16:20:27.649590 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:27.649571 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:20:27.669499 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:27.669449 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" podStartSLOduration=9.638726631 podStartE2EDuration="29.669432553s" totalImagesPullingTime="20.030705922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:27.668167495 +0000 UTC m=+29.758477437" watchObservedRunningTime="2026-06-11 16:20:27.669432553 +0000 UTC m=+29.759742478" Jun 11 16:20:28.354503 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:28.354456 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:28.354743 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:28.354563 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:28.354743 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:28.354677 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:28.354838 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:28.354792 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:28.354886 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:28.354849 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:28.354945 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:28.354923 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:28.640414 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:28.640333 2580 generic.go:356] "Generic (PLEG): container finished" podID="6ad4098e-5466-48d8-a01d-3266798cef13" containerID="573ae493b1b18cb66c8a8f8dbd34d82c47b862b7464ed99eafc2721091068633" exitCode=0 Jun 11 16:20:28.640860 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:28.640412 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hqtk" event={"ID":"6ad4098e-5466-48d8-a01d-3266798cef13","Type":"ContainerDied","Data":"573ae493b1b18cb66c8a8f8dbd34d82c47b862b7464ed99eafc2721091068633"} Jun 11 16:20:29.645274 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:29.645026 2580 generic.go:356] "Generic (PLEG): container finished" podID="6ad4098e-5466-48d8-a01d-3266798cef13" containerID="b198ad37523db175442c146d7f5db3857af2ba8eba1a4e0982572f8db1b76ef8" exitCode=0 Jun 11 16:20:29.645274 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:29.645110 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hqtk" event={"ID":"6ad4098e-5466-48d8-a01d-3266798cef13","Type":"ContainerDied","Data":"b198ad37523db175442c146d7f5db3857af2ba8eba1a4e0982572f8db1b76ef8"} Jun 11 16:20:29.656419 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:29.656390 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" podUID="051b5568-c52b-4904-9e44-ff33691fd7ac" containerName="ovnkube-controller" probeResult="failure" output="" Jun 11 16:20:30.353076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:30.353048 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:30.353254 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:30.353048 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:30.353254 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:30.353183 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:30.353254 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:30.353240 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:30.353395 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:30.353060 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:30.353395 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:30.353341 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:31.051362 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:31.051328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:31.051803 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:31.051392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:31.051803 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:31.051509 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:31.051803 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:31.051509 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:31.051803 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:31.051574 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs podName:f02b9ac4-6014-43d9-b7c6-310d4acd29af nodeName:}" failed. No retries permitted until 2026-06-11 16:21:03.051558583 +0000 UTC m=+65.141868492 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs") pod "network-metrics-daemon-qg5m6" (UID: "f02b9ac4-6014-43d9-b7c6-310d4acd29af") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:20:31.051803 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:31.051588 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret podName:25c20d12-a21c-400e-a8c2-dc2597f1318c nodeName:}" failed. No retries permitted until 2026-06-11 16:21:03.051582238 +0000 UTC m=+65.141892145 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret") pod "global-pull-secret-syncer-56n2p" (UID: "25c20d12-a21c-400e-a8c2-dc2597f1318c") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:20:31.151715 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:31.151683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xnl\" (UniqueName: \"kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl\") pod \"network-check-target-9vshq\" (UID: \"e90fa1c2-15f9-4810-bcef-bafcb578ec6c\") " pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:31.151876 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:31.151818 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:20:31.151876 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:31.151832 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:20:31.151876 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:31.151841 2580 projected.go:196] Error preparing data for projected volume kube-api-access-s7xnl for pod openshift-network-diagnostics/network-check-target-9vshq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:31.152010 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:31.151899 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl podName:e90fa1c2-15f9-4810-bcef-bafcb578ec6c nodeName:}" failed. No retries permitted until 2026-06-11 16:21:03.151881491 +0000 UTC m=+65.242191415 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7xnl" (UniqueName: "kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl") pod "network-check-target-9vshq" (UID: "e90fa1c2-15f9-4810-bcef-bafcb578ec6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:20:32.353847 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.353308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:32.353847 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:32.353443 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56n2p" podUID="25c20d12-a21c-400e-a8c2-dc2597f1318c" Jun 11 16:20:32.353847 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.353546 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:32.353847 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:32.353680 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg5m6" podUID="f02b9ac4-6014-43d9-b7c6-310d4acd29af" Jun 11 16:20:32.354543 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.353316 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:32.354747 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:32.354702 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vshq" podUID="e90fa1c2-15f9-4810-bcef-bafcb578ec6c" Jun 11 16:20:32.694439 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.694411 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-101.ec2.internal" event="NodeReady" Jun 11 16:20:32.694616 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.694552 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:20:32.747949 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.747920 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bbwhj"] Jun 11 16:20:32.776524 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.776483 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mqjsw"] Jun 11 16:20:32.776679 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.776594 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:32.779292 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.779267 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:20:32.779433 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.779303 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:20:32.779433 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.779274 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lmgzf\"" Jun 11 16:20:32.791953 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.791892 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqjsw" Jun 11 16:20:32.791953 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.791900 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bbwhj"] Jun 11 16:20:32.792125 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.791962 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqjsw"] Jun 11 16:20:32.794980 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.794962 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:20:32.795346 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.795330 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:20:32.795426 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.795369 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:20:32.795426 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.795393 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nqb2b\"" Jun 11 16:20:32.863553 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.863522 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ade0857a-0349-43f6-9981-afcf10f251fb-tmp-dir\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:32.863706 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.863563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhmfv\" (UniqueName: \"kubernetes.io/projected/ade0857a-0349-43f6-9981-afcf10f251fb-kube-api-access-hhmfv\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:32.863706 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.863592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:32.863812 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.863747 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ade0857a-0349-43f6-9981-afcf10f251fb-config-volume\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:32.964344 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.964259 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pccx7\" (UniqueName: \"kubernetes.io/projected/1505f0ff-2e38-4aab-8c26-be54fb1067fa-kube-api-access-pccx7\") pod \"ingress-canary-mqjsw\" (UID: \"1505f0ff-2e38-4aab-8c26-be54fb1067fa\") " pod="openshift-ingress-canary/ingress-canary-mqjsw" Jun 11 16:20:32.964344 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.964308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1505f0ff-2e38-4aab-8c26-be54fb1067fa-cert\") pod \"ingress-canary-mqjsw\" (UID: \"1505f0ff-2e38-4aab-8c26-be54fb1067fa\") " pod="openshift-ingress-canary/ingress-canary-mqjsw" Jun 11 16:20:32.964597 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.964378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ade0857a-0349-43f6-9981-afcf10f251fb-config-volume\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:32.964597 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.964412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ade0857a-0349-43f6-9981-afcf10f251fb-tmp-dir\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:32.964597 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.964434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhmfv\" (UniqueName: \"kubernetes.io/projected/ade0857a-0349-43f6-9981-afcf10f251fb-kube-api-access-hhmfv\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:32.964597 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.964461 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:32.964597 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:32.964585 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:32.964775 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:32.964641 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls podName:ade0857a-0349-43f6-9981-afcf10f251fb nodeName:}" failed. No retries permitted until 2026-06-11 16:20:33.464622437 +0000 UTC m=+35.554932346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls") pod "dns-default-bbwhj" (UID: "ade0857a-0349-43f6-9981-afcf10f251fb") : secret "dns-default-metrics-tls" not found Jun 11 16:20:32.964828 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.964795 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ade0857a-0349-43f6-9981-afcf10f251fb-tmp-dir\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:32.964995 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.964978 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ade0857a-0349-43f6-9981-afcf10f251fb-config-volume\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:32.976858 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:32.976833 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhmfv\" (UniqueName: \"kubernetes.io/projected/ade0857a-0349-43f6-9981-afcf10f251fb-kube-api-access-hhmfv\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:33.065183 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:33.065152 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pccx7\" (UniqueName: \"kubernetes.io/projected/1505f0ff-2e38-4aab-8c26-be54fb1067fa-kube-api-access-pccx7\") pod \"ingress-canary-mqjsw\" (UID: \"1505f0ff-2e38-4aab-8c26-be54fb1067fa\") " pod="openshift-ingress-canary/ingress-canary-mqjsw" Jun 11 16:20:33.065336 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:33.065196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1505f0ff-2e38-4aab-8c26-be54fb1067fa-cert\") pod \"ingress-canary-mqjsw\" (UID: \"1505f0ff-2e38-4aab-8c26-be54fb1067fa\") " pod="openshift-ingress-canary/ingress-canary-mqjsw" Jun 11 16:20:33.068262 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:33.068235 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1505f0ff-2e38-4aab-8c26-be54fb1067fa-cert\") pod \"ingress-canary-mqjsw\" (UID: \"1505f0ff-2e38-4aab-8c26-be54fb1067fa\") " pod="openshift-ingress-canary/ingress-canary-mqjsw" Jun 11 16:20:33.074810 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:33.074789 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pccx7\" (UniqueName: \"kubernetes.io/projected/1505f0ff-2e38-4aab-8c26-be54fb1067fa-kube-api-access-pccx7\") pod \"ingress-canary-mqjsw\" (UID: \"1505f0ff-2e38-4aab-8c26-be54fb1067fa\") " pod="openshift-ingress-canary/ingress-canary-mqjsw" Jun 11 16:20:33.101731 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:33.101709 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqjsw" Jun 11 16:20:33.467364 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:33.467335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:33.467924 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:33.467476 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:33.467924 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:33.467587 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls podName:ade0857a-0349-43f6-9981-afcf10f251fb nodeName:}" failed. No retries permitted until 2026-06-11 16:20:34.467567545 +0000 UTC m=+36.557877477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls") pod "dns-default-bbwhj" (UID: "ade0857a-0349-43f6-9981-afcf10f251fb") : secret "dns-default-metrics-tls" not found Jun 11 16:20:33.680444 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:33.680287 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqjsw"] Jun 11 16:20:33.811226 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:20:33.811155 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1505f0ff_2e38_4aab_8c26_be54fb1067fa.slice/crio-fd8eb617a9b882eb7137704ad8da3ba4b4e0ee097c2a12c3074a759962b4eeb7 WatchSource:0}: Error finding container fd8eb617a9b882eb7137704ad8da3ba4b4e0ee097c2a12c3074a759962b4eeb7: Status 404 returned error can't find the container with id fd8eb617a9b882eb7137704ad8da3ba4b4e0ee097c2a12c3074a759962b4eeb7 Jun 11 16:20:34.352977 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.352903 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:20:34.352977 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.352969 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:20:34.353194 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.352971 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:20:34.355909 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.355888 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:20:34.356074 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.356053 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hmdjj\"" Jun 11 16:20:34.357229 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.357016 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:20:34.357229 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.357157 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:20:34.357229 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.357206 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:20:34.357458 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.357206 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chc72\"" Jun 11 16:20:34.474237 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.474210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:34.474725 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:34.474365 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:34.474725 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:34.474433 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls podName:ade0857a-0349-43f6-9981-afcf10f251fb nodeName:}" failed. No retries permitted until 2026-06-11 16:20:36.474414612 +0000 UTC m=+38.564724540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls") pod "dns-default-bbwhj" (UID: "ade0857a-0349-43f6-9981-afcf10f251fb") : secret "dns-default-metrics-tls" not found Jun 11 16:20:34.660347 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.660276 2580 generic.go:356] "Generic (PLEG): container finished" podID="6ad4098e-5466-48d8-a01d-3266798cef13" containerID="32e27bfecd9954101c77b1a7a1b04137b84799c98e3bd293116d32c24df887aa" exitCode=0 Jun 11 16:20:34.660510 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.660344 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hqtk" event={"ID":"6ad4098e-5466-48d8-a01d-3266798cef13","Type":"ContainerDied","Data":"32e27bfecd9954101c77b1a7a1b04137b84799c98e3bd293116d32c24df887aa"} Jun 11 16:20:34.661676 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:34.661651 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqjsw" event={"ID":"1505f0ff-2e38-4aab-8c26-be54fb1067fa","Type":"ContainerStarted","Data":"fd8eb617a9b882eb7137704ad8da3ba4b4e0ee097c2a12c3074a759962b4eeb7"} Jun 11 16:20:35.666656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:35.666625 2580 generic.go:356] "Generic (PLEG): container finished" podID="6ad4098e-5466-48d8-a01d-3266798cef13" containerID="91439d53cb9cdc486d1a11c594544b6c423baa2a334309bd42a2eee99d994d22" exitCode=0 Jun 11 16:20:35.667098 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:35.666695 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hqtk" event={"ID":"6ad4098e-5466-48d8-a01d-3266798cef13","Type":"ContainerDied","Data":"91439d53cb9cdc486d1a11c594544b6c423baa2a334309bd42a2eee99d994d22"} Jun 11 16:20:36.489284 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:36.489249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:36.489420 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:36.489353 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:36.489420 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:36.489400 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls podName:ade0857a-0349-43f6-9981-afcf10f251fb nodeName:}" failed. No retries permitted until 2026-06-11 16:20:40.489387934 +0000 UTC m=+42.579697841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls") pod "dns-default-bbwhj" (UID: "ade0857a-0349-43f6-9981-afcf10f251fb") : secret "dns-default-metrics-tls" not found Jun 11 16:20:36.672167 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:36.672085 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hqtk" event={"ID":"6ad4098e-5466-48d8-a01d-3266798cef13","Type":"ContainerStarted","Data":"39e862d0930ac821e41359c224157badf878cd5ed71abd09fed49ad985dbfdbf"} Jun 11 16:20:36.673542 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:36.673520 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqjsw" event={"ID":"1505f0ff-2e38-4aab-8c26-be54fb1067fa","Type":"ContainerStarted","Data":"6a43d86d5a13535c45718e4cbef554f57ea0921a4e59dc850e18a11b63c3f522"} Jun 11 16:20:36.702098 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:36.702058 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8hqtk" podStartSLOduration=7.477713974 podStartE2EDuration="38.702046102s" totalImagesPullingTime="31.224332128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:36.700442701 +0000 UTC m=+38.790752629" watchObservedRunningTime="2026-06-11 16:20:36.702046102 +0000 UTC m=+38.792356030" Jun 11 16:20:36.722482 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:36.722441 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mqjsw" podStartSLOduration=2.74703213 podStartE2EDuration="4.722429095s" totalImagesPullingTime="1.975396965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:36.72180829 +0000 UTC m=+38.812118219" watchObservedRunningTime="2026-06-11 16:20:36.722429095 +0000 UTC m=+38.812739024" Jun 11 16:20:40.518933 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:40.518742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:40.519316 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:40.518884 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:40.519316 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:40.519023 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls podName:ade0857a-0349-43f6-9981-afcf10f251fb nodeName:}" failed. No retries permitted until 2026-06-11 16:20:48.519008646 +0000 UTC m=+50.609318553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls") pod "dns-default-bbwhj" (UID: "ade0857a-0349-43f6-9981-afcf10f251fb") : secret "dns-default-metrics-tls" not found Jun 11 16:20:48.567503 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:48.567465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:20:48.568061 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:48.567604 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:20:48.568061 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:48.567661 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls podName:ade0857a-0349-43f6-9981-afcf10f251fb nodeName:}" failed. No retries permitted until 2026-06-11 16:21:04.567646743 +0000 UTC m=+66.657956649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls") pod "dns-default-bbwhj" (UID: "ade0857a-0349-43f6-9981-afcf10f251fb") : secret "dns-default-metrics-tls" not found Jun 11 16:20:51.687115 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.687080 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-mcfp9"] Jun 11 16:20:51.689714 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.689695 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.692459 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.692434 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 16:20:51.692459 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.692449 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 16:20:51.692641 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.692465 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:20:51.692641 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.692526 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:20:51.692641 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.692571 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tvtkq\"" Jun 11 16:20:51.697758 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.697737 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 16:20:51.700686 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.700666 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-mcfp9"] Jun 11 16:20:51.790447 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.790420 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e01f338-29ac-4c6f-a980-29984d504529-serving-cert\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.790447 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.790465 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e01f338-29ac-4c6f-a980-29984d504529-tmp\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.790705 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.790483 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e01f338-29ac-4c6f-a980-29984d504529-trusted-ca-bundle\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.790705 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.790521 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5e01f338-29ac-4c6f-a980-29984d504529-snapshots\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.790705 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.790560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e01f338-29ac-4c6f-a980-29984d504529-service-ca-bundle\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.790705 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.790640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4zkj\" (UniqueName: \"kubernetes.io/projected/5e01f338-29ac-4c6f-a980-29984d504529-kube-api-access-g4zkj\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.813073 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.813047 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7579d89c77-4lrjr"] Jun 11 16:20:51.815167 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.815149 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.817799 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.817779 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 16:20:51.817977 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.817821 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 16:20:51.817977 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.817834 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 16:20:51.817977 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.817893 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 16:20:51.817977 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.817932 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 16:20:51.818189 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.818174 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 16:20:51.818226 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.818178 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-897s2\"" Jun 11 16:20:51.828578 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.828558 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7579d89c77-4lrjr"] Jun 11 16:20:51.891099 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891066 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e01f338-29ac-4c6f-a980-29984d504529-serving-cert\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.891231 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-default-certificate\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.891231 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891122 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-stats-auth\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.891231 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891148 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.891387 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e01f338-29ac-4c6f-a980-29984d504529-tmp\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.891387 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891350 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e01f338-29ac-4c6f-a980-29984d504529-trusted-ca-bundle\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.891387 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891383 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5e01f338-29ac-4c6f-a980-29984d504529-snapshots\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.891569 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e01f338-29ac-4c6f-a980-29984d504529-service-ca-bundle\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.891569 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891434 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.891569 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4zkj\" (UniqueName: \"kubernetes.io/projected/5e01f338-29ac-4c6f-a980-29984d504529-kube-api-access-g4zkj\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.891569 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891532 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/cfe39a80-a153-45b8-831e-b336d7549017-kube-api-access-tcl9p\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.891767 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891693 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e01f338-29ac-4c6f-a980-29984d504529-tmp\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.891980 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.891959 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5e01f338-29ac-4c6f-a980-29984d504529-snapshots\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.892072 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.892051 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e01f338-29ac-4c6f-a980-29984d504529-service-ca-bundle\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.892129 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.892087 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e01f338-29ac-4c6f-a980-29984d504529-trusted-ca-bundle\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.894842 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.894824 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e01f338-29ac-4c6f-a980-29984d504529-serving-cert\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.925008 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.924984 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4zkj\" (UniqueName: \"kubernetes.io/projected/5e01f338-29ac-4c6f-a980-29984d504529-kube-api-access-g4zkj\") pod \"insights-operator-896549976-mcfp9\" (UID: \"5e01f338-29ac-4c6f-a980-29984d504529\") " pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:51.992184 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.992120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.992260 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.992181 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/cfe39a80-a153-45b8-831e-b336d7549017-kube-api-access-tcl9p\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.992260 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.992248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-default-certificate\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.992337 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:51.992279 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:52.492261429 +0000 UTC m=+54.582571351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : configmap references non-existent config key: service-ca.crt Jun 11 16:20:51.992391 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.992369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-stats-auth\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.992446 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.992410 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.992540 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:51.992525 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:20:51.992609 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:51.992598 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:52.492580618 +0000 UTC m=+54.582890538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : secret "router-metrics-certs-default" not found Jun 11 16:20:51.994663 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.994645 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-stats-auth\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.994737 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.994715 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-default-certificate\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:51.999519 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:51.999504 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-mcfp9" Jun 11 16:20:52.022716 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:52.022692 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/cfe39a80-a153-45b8-831e-b336d7549017-kube-api-access-tcl9p\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:52.131346 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:52.131314 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-mcfp9"] Jun 11 16:20:52.134874 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:20:52.134849 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e01f338_29ac_4c6f_a980_29984d504529.slice/crio-4b12aa52dcea6eb7ce141b1fc96f481ae2f14d80dd27a26af44c8d0d286a29ad WatchSource:0}: Error finding container 4b12aa52dcea6eb7ce141b1fc96f481ae2f14d80dd27a26af44c8d0d286a29ad: Status 404 returned error can't find the container with id 4b12aa52dcea6eb7ce141b1fc96f481ae2f14d80dd27a26af44c8d0d286a29ad Jun 11 16:20:52.500085 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:52.500061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:52.500220 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:52.500110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:52.500220 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:52.500204 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:20:52.500289 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:52.500223 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:53.500210365 +0000 UTC m=+55.590520271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : configmap references non-existent config key: service-ca.crt Jun 11 16:20:52.500289 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:52.500251 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:53.500238013 +0000 UTC m=+55.590547919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : secret "router-metrics-certs-default" not found Jun 11 16:20:52.710552 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:52.710521 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mcfp9" event={"ID":"5e01f338-29ac-4c6f-a980-29984d504529","Type":"ContainerStarted","Data":"4b12aa52dcea6eb7ce141b1fc96f481ae2f14d80dd27a26af44c8d0d286a29ad"} Jun 11 16:20:53.507381 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:53.507341 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:53.507596 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:53.507455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:53.507596 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:53.507578 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:55.507554152 +0000 UTC m=+57.597864074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : configmap references non-existent config key: service-ca.crt Jun 11 16:20:53.507720 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:53.507620 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:20:53.507720 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:53.507693 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:55.507679631 +0000 UTC m=+57.597989545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : secret "router-metrics-certs-default" not found Jun 11 16:20:54.717153 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:54.717118 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mcfp9" event={"ID":"5e01f338-29ac-4c6f-a980-29984d504529","Type":"ContainerStarted","Data":"39dff9d5401ef4320679337386357e20bc49d5a1dace2c133a252e952d77345d"} Jun 11 16:20:54.737085 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:54.737038 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-mcfp9" podStartSLOduration=1.970896373 podStartE2EDuration="3.737023041s" totalImagesPullingTime="1.766126668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:54.736242387 +0000 UTC m=+56.826552341" watchObservedRunningTime="2026-06-11 16:20:54.737023041 +0000 UTC m=+56.827332968" Jun 11 16:20:55.521584 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:55.521544 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:55.521790 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:55.521623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:55.521790 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:55.521731 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:20:55.521790 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:55.521755 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:59.52173416 +0000 UTC m=+61.612044080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : configmap references non-existent config key: service-ca.crt Jun 11 16:20:55.521919 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:55.521782 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:20:59.521773058 +0000 UTC m=+61.612082967 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : secret "router-metrics-certs-default" not found Jun 11 16:20:56.170532 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.170501 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4"] Jun 11 16:20:56.172369 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.172355 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4" Jun 11 16:20:56.174834 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.174815 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 16:20:56.175622 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.175607 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 16:20:56.176080 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.176066 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-l7nn4\"" Jun 11 16:20:56.188252 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.188232 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4"] Jun 11 16:20:56.226680 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.226655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfxpv\" (UniqueName: \"kubernetes.io/projected/b2e17b5c-254a-4f4a-8179-f8b8d5924630-kube-api-access-pfxpv\") pod \"migrator-955ffdf5f-54xt4\" (UID: \"b2e17b5c-254a-4f4a-8179-f8b8d5924630\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4" Jun 11 16:20:56.327664 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.327637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfxpv\" (UniqueName: \"kubernetes.io/projected/b2e17b5c-254a-4f4a-8179-f8b8d5924630-kube-api-access-pfxpv\") pod \"migrator-955ffdf5f-54xt4\" (UID: \"b2e17b5c-254a-4f4a-8179-f8b8d5924630\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4" Jun 11 16:20:56.340036 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.340012 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfxpv\" (UniqueName: \"kubernetes.io/projected/b2e17b5c-254a-4f4a-8179-f8b8d5924630-kube-api-access-pfxpv\") pod \"migrator-955ffdf5f-54xt4\" (UID: \"b2e17b5c-254a-4f4a-8179-f8b8d5924630\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4" Jun 11 16:20:56.480441 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.480419 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4" Jun 11 16:20:56.627852 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.627825 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4"] Jun 11 16:20:56.631097 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:20:56.631064 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e17b5c_254a_4f4a_8179_f8b8d5924630.slice/crio-846316453bc098089a352a5b5597fdc29559d04d6fd37a1222e83e2892ff25fe WatchSource:0}: Error finding container 846316453bc098089a352a5b5597fdc29559d04d6fd37a1222e83e2892ff25fe: Status 404 returned error can't find the container with id 846316453bc098089a352a5b5597fdc29559d04d6fd37a1222e83e2892ff25fe Jun 11 16:20:56.722112 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:56.722083 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4" event={"ID":"b2e17b5c-254a-4f4a-8179-f8b8d5924630","Type":"ContainerStarted","Data":"846316453bc098089a352a5b5597fdc29559d04d6fd37a1222e83e2892ff25fe"} Jun 11 16:20:57.434376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:57.434337 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x82hp_c1d914bf-3912-41b1-a9c6-e7dda2172ba9/dns-node-resolver/0.log" Jun 11 16:20:58.433376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:58.433353 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j47kx_1f61d24b-ee97-4a52-afeb-e13ad1ddb048/node-ca/0.log" Jun 11 16:20:58.728745 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:58.728715 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4" event={"ID":"b2e17b5c-254a-4f4a-8179-f8b8d5924630","Type":"ContainerStarted","Data":"bfb618f6f23727e9024827c2c4f21f5252fa0087cf588a16b6d177488fdb0644"} Jun 11 16:20:58.729141 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:58.728774 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4" event={"ID":"b2e17b5c-254a-4f4a-8179-f8b8d5924630","Type":"ContainerStarted","Data":"b83e1add9443824f37ee37b95ea96887bec9ef01f810e7261afd26a182fad247"} Jun 11 16:20:59.228910 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:59.228882 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqjsw_1505f0ff-2e38-4aab-8c26-be54fb1067fa/serve-healthcheck-canary/0.log" Jun 11 16:20:59.554959 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:59.554892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:59.554959 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:59.554940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:20:59.555153 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:59.555033 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:07.555019752 +0000 UTC m=+69.645329659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : configmap references non-existent config key: service-ca.crt Jun 11 16:20:59.555153 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:59.555037 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:20:59.555153 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:20:59.555106 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:07.555092658 +0000 UTC m=+69.645402567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : secret "router-metrics-certs-default" not found Jun 11 16:20:59.655908 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:59.655888 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdbj7" Jun 11 16:20:59.695652 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:20:59.695616 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-54xt4" podStartSLOduration=2.096308891 podStartE2EDuration="3.695603682s" totalImagesPullingTime="1.599294791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:58.751685868 +0000 UTC m=+60.841995797" watchObservedRunningTime="2026-06-11 16:20:59.695603682 +0000 UTC m=+61.785913610" Jun 11 16:21:03.077900 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.077867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:21:03.078286 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.077934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:21:03.080602 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.080581 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:21:03.080668 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.080629 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:21:03.088782 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:21:03.088758 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:21:03.088838 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:21:03.088828 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs podName:f02b9ac4-6014-43d9-b7c6-310d4acd29af nodeName:}" failed. No retries permitted until 2026-06-11 16:22:07.088814377 +0000 UTC m=+129.179124284 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs") pod "network-metrics-daemon-qg5m6" (UID: "f02b9ac4-6014-43d9-b7c6-310d4acd29af") : secret "metrics-daemon-secret" not found Jun 11 16:21:03.091018 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.090995 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25c20d12-a21c-400e-a8c2-dc2597f1318c-original-pull-secret\") pod \"global-pull-secret-syncer-56n2p\" (UID: \"25c20d12-a21c-400e-a8c2-dc2597f1318c\") " pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:21:03.165219 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.165191 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56n2p" Jun 11 16:21:03.178939 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.178916 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xnl\" (UniqueName: \"kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl\") pod \"network-check-target-9vshq\" (UID: \"e90fa1c2-15f9-4810-bcef-bafcb578ec6c\") " pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:21:03.181709 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.181687 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:21:03.191546 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.191529 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:21:03.201972 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.201952 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7xnl\" (UniqueName: \"kubernetes.io/projected/e90fa1c2-15f9-4810-bcef-bafcb578ec6c-kube-api-access-s7xnl\") pod \"network-check-target-9vshq\" (UID: \"e90fa1c2-15f9-4810-bcef-bafcb578ec6c\") " pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:21:03.286902 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.286878 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-56n2p"] Jun 11 16:21:03.290165 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:21:03.290141 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c20d12_a21c_400e_a8c2_dc2597f1318c.slice/crio-bb49a11d7c24aba493dd9deebfb712a979281766104add426fe750effc9e7ae9 WatchSource:0}: Error finding container bb49a11d7c24aba493dd9deebfb712a979281766104add426fe750effc9e7ae9: Status 404 returned error can't find the container with id bb49a11d7c24aba493dd9deebfb712a979281766104add426fe750effc9e7ae9 Jun 11 16:21:03.480263 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.480236 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chc72\"" Jun 11 16:21:03.488455 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.488430 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:21:03.618959 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.618933 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9vshq"] Jun 11 16:21:03.621717 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:21:03.621691 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90fa1c2_15f9_4810_bcef_bafcb578ec6c.slice/crio-38ef13837f4381530ccaf396d78b587f28ef9408e109bf2448b3c235c25102e3 WatchSource:0}: Error finding container 38ef13837f4381530ccaf396d78b587f28ef9408e109bf2448b3c235c25102e3: Status 404 returned error can't find the container with id 38ef13837f4381530ccaf396d78b587f28ef9408e109bf2448b3c235c25102e3 Jun 11 16:21:03.742717 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.742632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9vshq" event={"ID":"e90fa1c2-15f9-4810-bcef-bafcb578ec6c","Type":"ContainerStarted","Data":"38ef13837f4381530ccaf396d78b587f28ef9408e109bf2448b3c235c25102e3"} Jun 11 16:21:03.743978 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:03.743936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-56n2p" event={"ID":"25c20d12-a21c-400e-a8c2-dc2597f1318c","Type":"ContainerStarted","Data":"bb49a11d7c24aba493dd9deebfb712a979281766104add426fe750effc9e7ae9"} Jun 11 16:21:04.590190 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:04.590142 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:21:04.590664 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:21:04.590319 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:21:04.590664 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:21:04.590394 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls podName:ade0857a-0349-43f6-9981-afcf10f251fb nodeName:}" failed. No retries permitted until 2026-06-11 16:21:36.590378639 +0000 UTC m=+98.680688549 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls") pod "dns-default-bbwhj" (UID: "ade0857a-0349-43f6-9981-afcf10f251fb") : secret "dns-default-metrics-tls" not found Jun 11 16:21:07.613624 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:07.613577 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:21:07.614067 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:07.613675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:21:07.614067 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:21:07.613718 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:23.613697771 +0000 UTC m=+85.704007678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : configmap references non-existent config key: service-ca.crt Jun 11 16:21:07.614067 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:21:07.613797 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:21:07.614067 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:21:07.613856 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs podName:cfe39a80-a153-45b8-831e-b336d7549017 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:23.613840345 +0000 UTC m=+85.704150254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs") pod "router-default-7579d89c77-4lrjr" (UID: "cfe39a80-a153-45b8-831e-b336d7549017") : secret "router-metrics-certs-default" not found Jun 11 16:21:08.759572 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:08.759532 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9vshq" event={"ID":"e90fa1c2-15f9-4810-bcef-bafcb578ec6c","Type":"ContainerStarted","Data":"bda55ae6ea429952a4bc30753de488e152d0a3ca6628d3f97355929eb5f391ad"} Jun 11 16:21:08.760005 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:08.759639 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:21:08.760978 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:08.760956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-56n2p" event={"ID":"25c20d12-a21c-400e-a8c2-dc2597f1318c","Type":"ContainerStarted","Data":"662291d63e65b40c923786ab56ac739f3fbf8f5288a3f63465cc99dc3c8a96d0"} Jun 11 16:21:08.782616 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:08.782572 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9vshq" podStartSLOduration=66.328220863 podStartE2EDuration="1m10.782559404s" totalImagesPullingTime="4.454338541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:08.782071004 +0000 UTC m=+70.872380953" watchObservedRunningTime="2026-06-11 16:21:08.782559404 +0000 UTC m=+70.872869333" Jun 11 16:21:08.799545 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:08.799477 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-56n2p" podStartSLOduration=66.012622486 podStartE2EDuration="1m10.799464031s" totalImagesPullingTime="4.786841545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:08.799103376 +0000 UTC m=+70.889413304" watchObservedRunningTime="2026-06-11 16:21:08.799464031 +0000 UTC m=+70.889774000" Jun 11 16:21:20.677328 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.677214 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xkntn"] Jun 11 16:21:20.680163 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.680146 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.682619 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.682598 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vg9zq\"" Jun 11 16:21:20.683732 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.683711 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:21:20.683821 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.683717 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:21:20.704307 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.704283 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xkntn"] Jun 11 16:21:20.715802 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.715781 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm"] Jun 11 16:21:20.717686 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.717671 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.722258 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.722238 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 16:21:20.722969 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.722946 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 16:21:20.723085 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.723065 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 16:21:20.723204 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.723188 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 16:21:20.723600 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.723583 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 16:21:20.725403 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.725386 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 16:21:20.725623 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.725607 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 16:21:20.739647 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.739624 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm"] Jun 11 16:21:20.807352 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.807322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2jl7\" (UniqueName: \"kubernetes.io/projected/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-kube-api-access-b2jl7\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.807527 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.807365 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-crio-socket\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.807527 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.807384 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.807527 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.807403 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.807527 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.807462 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/33db8e5f-6947-4cb6-88c8-cf9929559e80-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.807661 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.807537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.807661 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.807555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.807661 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.807570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-ca\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.807661 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.807592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr24z\" (UniqueName: \"kubernetes.io/projected/33db8e5f-6947-4cb6-88c8-cf9929559e80-kube-api-access-mr24z\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.807661 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.807638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-data-volume\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.807804 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.807664 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-hub\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.908776 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.908746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-ca\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.908776 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.908778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr24z\" (UniqueName: \"kubernetes.io/projected/33db8e5f-6947-4cb6-88c8-cf9929559e80-kube-api-access-mr24z\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.908970 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.908802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-data-volume\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.908970 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.908825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-hub\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.908970 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.908900 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2jl7\" (UniqueName: \"kubernetes.io/projected/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-kube-api-access-b2jl7\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.909116 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.909073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-crio-socket\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.909167 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.909126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.909167 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.909155 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-data-volume\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.909269 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.909160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.909269 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.909181 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-crio-socket\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.909269 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.909212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/33db8e5f-6947-4cb6-88c8-cf9929559e80-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.909269 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.909245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.909478 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.909405 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.909844 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.909766 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.910041 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.909919 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/33db8e5f-6947-4cb6-88c8-cf9929559e80-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.911773 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.911743 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-hub\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.911773 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.911761 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.912019 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.911999 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.912056 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.912011 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-ca\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.912250 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.912235 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33db8e5f-6947-4cb6-88c8-cf9929559e80-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.928398 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.928350 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr24z\" (UniqueName: \"kubernetes.io/projected/33db8e5f-6947-4cb6-88c8-cf9929559e80-kube-api-access-mr24z\") pod \"cluster-proxy-proxy-agent-69fc6965d5-xqpnm\" (UID: \"33db8e5f-6947-4cb6-88c8-cf9929559e80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:20.932738 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.932720 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2jl7\" (UniqueName: \"kubernetes.io/projected/bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e-kube-api-access-b2jl7\") pod \"insights-runtime-extractor-xkntn\" (UID: \"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e\") " pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:20.989539 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:20.989511 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xkntn" Jun 11 16:21:21.035878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:21.035477 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" Jun 11 16:21:21.126998 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:21.126954 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xkntn"] Jun 11 16:21:21.131972 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:21:21.131942 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8ec3aa_3edc_41bb_924b_9f3f1a08de1e.slice/crio-0a90a8ad87d2dfcd911e6d5a294c0706db877f4b32b088d1369ae36b550aa21d WatchSource:0}: Error finding container 0a90a8ad87d2dfcd911e6d5a294c0706db877f4b32b088d1369ae36b550aa21d: Status 404 returned error can't find the container with id 0a90a8ad87d2dfcd911e6d5a294c0706db877f4b32b088d1369ae36b550aa21d Jun 11 16:21:21.178332 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:21.178295 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm"] Jun 11 16:21:21.183229 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:21:21.183205 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33db8e5f_6947_4cb6_88c8_cf9929559e80.slice/crio-6cdb07635f8ea7f8528de3a8f4cc83dcc2139b1b20320da97c8e868a58256fba WatchSource:0}: Error finding container 6cdb07635f8ea7f8528de3a8f4cc83dcc2139b1b20320da97c8e868a58256fba: Status 404 returned error can't find the container with id 6cdb07635f8ea7f8528de3a8f4cc83dcc2139b1b20320da97c8e868a58256fba Jun 11 16:21:21.799512 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:21.799466 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" event={"ID":"33db8e5f-6947-4cb6-88c8-cf9929559e80","Type":"ContainerStarted","Data":"6cdb07635f8ea7f8528de3a8f4cc83dcc2139b1b20320da97c8e868a58256fba"} Jun 11 16:21:21.800858 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:21.800835 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkntn" event={"ID":"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e","Type":"ContainerStarted","Data":"5374018c95aa2f077a7d251a8d07f822b4d25f7381492c1b743757f373a46499"} Jun 11 16:21:21.800947 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:21.800883 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkntn" event={"ID":"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e","Type":"ContainerStarted","Data":"0a90a8ad87d2dfcd911e6d5a294c0706db877f4b32b088d1369ae36b550aa21d"} Jun 11 16:21:22.806697 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:22.806656 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkntn" event={"ID":"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e","Type":"ContainerStarted","Data":"f452035c73d98869301d193ccf4a35ddc4facbc9c655b0f2132caaa88726e0eb"} Jun 11 16:21:23.635037 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:23.634999 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:21:23.635230 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:23.635058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:21:23.635741 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:23.635715 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe39a80-a153-45b8-831e-b336d7549017-service-ca-bundle\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:21:23.638434 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:23.638405 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe39a80-a153-45b8-831e-b336d7549017-metrics-certs\") pod \"router-default-7579d89c77-4lrjr\" (UID: \"cfe39a80-a153-45b8-831e-b336d7549017\") " pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:21:23.925747 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:23.925715 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-897s2\"" Jun 11 16:21:23.934140 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:23.934117 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:21:24.078456 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:24.078411 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7579d89c77-4lrjr"] Jun 11 16:21:24.084150 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:21:24.084121 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe39a80_a153_45b8_831e_b336d7549017.slice/crio-eb5111860a664075a2d2f5ed3f414fa8020003e1c208c8295644c5bf6442a762 WatchSource:0}: Error finding container eb5111860a664075a2d2f5ed3f414fa8020003e1c208c8295644c5bf6442a762: Status 404 returned error can't find the container with id eb5111860a664075a2d2f5ed3f414fa8020003e1c208c8295644c5bf6442a762 Jun 11 16:21:24.819909 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:24.819869 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkntn" event={"ID":"bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e","Type":"ContainerStarted","Data":"b1902243b24f3a3f4826567d197f371c8464501235de4193af4121d7b1bf3af6"} Jun 11 16:21:24.821265 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:24.821241 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7579d89c77-4lrjr" event={"ID":"cfe39a80-a153-45b8-831e-b336d7549017","Type":"ContainerStarted","Data":"a92453721b28d7a74e5835dd762659f436656d9c38546b3f9be7e394d4cb35e6"} Jun 11 16:21:24.821394 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:24.821275 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7579d89c77-4lrjr" event={"ID":"cfe39a80-a153-45b8-831e-b336d7549017","Type":"ContainerStarted","Data":"eb5111860a664075a2d2f5ed3f414fa8020003e1c208c8295644c5bf6442a762"} Jun 11 16:21:24.845570 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:24.845518 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xkntn" podStartSLOduration=2.189662246 podStartE2EDuration="4.845504916s" totalImagesPullingTime="2.65584267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:21:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:24.843920177 +0000 UTC m=+86.934230490" watchObservedRunningTime="2026-06-11 16:21:24.845504916 +0000 UTC m=+86.935814836" Jun 11 16:21:24.867281 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:24.867242 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7579d89c77-4lrjr" podStartSLOduration=33.867231137 podStartE2EDuration="33.867231137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:24.866304688 +0000 UTC m=+86.956614674" watchObservedRunningTime="2026-06-11 16:21:24.867231137 +0000 UTC m=+86.957541065" Jun 11 16:21:24.934746 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:24.934715 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:21:24.937741 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:24.937720 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:21:25.825464 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:25.825428 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:21:25.826917 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:25.826894 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7579d89c77-4lrjr" Jun 11 16:21:27.833177 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:27.833137 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" event={"ID":"33db8e5f-6947-4cb6-88c8-cf9929559e80","Type":"ContainerStarted","Data":"823af86e7b975446b22373183fd7d26013016956d0cc48278b67a20d7f7b4791"} Jun 11 16:21:27.833622 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:27.833184 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" event={"ID":"33db8e5f-6947-4cb6-88c8-cf9929559e80","Type":"ContainerStarted","Data":"8bced6d7cde5ba2004e554e6d4f9f2cefec0e8790d1cbf8e52431d9caf31eeaf"} Jun 11 16:21:27.833622 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:27.833203 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" event={"ID":"33db8e5f-6947-4cb6-88c8-cf9929559e80","Type":"ContainerStarted","Data":"6486c5da5045a6dca30a2d2f509bfff4f13699997c907bfe6657e8e23333b66e"} Jun 11 16:21:27.859596 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:27.859550 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69fc6965d5-xqpnm" podStartSLOduration=2.175156693 podStartE2EDuration="7.859536863s" totalImagesPullingTime="5.68438017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:27.858418098 +0000 UTC m=+89.948728029" watchObservedRunningTime="2026-06-11 16:21:27.859536863 +0000 UTC m=+89.949846791" Jun 11 16:21:36.635984 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:36.635902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:21:36.638273 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:36.638238 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ade0857a-0349-43f6-9981-afcf10f251fb-metrics-tls\") pod \"dns-default-bbwhj\" (UID: \"ade0857a-0349-43f6-9981-afcf10f251fb\") " pod="openshift-dns/dns-default-bbwhj" Jun 11 16:21:36.691226 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:36.691199 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lmgzf\"" Jun 11 16:21:36.698037 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:36.698023 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbwhj" Jun 11 16:21:36.829103 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:36.829071 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bbwhj"] Jun 11 16:21:36.832127 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:21:36.832095 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade0857a_0349_43f6_9981_afcf10f251fb.slice/crio-dd0d9a9f4fabcc43e760017df9ab064ce5bbc7ecac0877a21169119f9d65304d WatchSource:0}: Error finding container dd0d9a9f4fabcc43e760017df9ab064ce5bbc7ecac0877a21169119f9d65304d: Status 404 returned error can't find the container with id dd0d9a9f4fabcc43e760017df9ab064ce5bbc7ecac0877a21169119f9d65304d Jun 11 16:21:36.865096 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:36.865069 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbwhj" event={"ID":"ade0857a-0349-43f6-9981-afcf10f251fb","Type":"ContainerStarted","Data":"dd0d9a9f4fabcc43e760017df9ab064ce5bbc7ecac0877a21169119f9d65304d"} Jun 11 16:21:39.765976 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:39.765950 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9vshq" Jun 11 16:21:39.877173 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:39.877140 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbwhj" event={"ID":"ade0857a-0349-43f6-9981-afcf10f251fb","Type":"ContainerStarted","Data":"60c00831c2284bc35303d8cf498af3e54eaea27940dce7dbe0d2658ee13a5928"} Jun 11 16:21:39.877324 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:39.877188 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbwhj" event={"ID":"ade0857a-0349-43f6-9981-afcf10f251fb","Type":"ContainerStarted","Data":"c0e1c90d69ddd066c8fda016e43125676eb163f43874baa8d8b84b9aadc025cf"} Jun 11 16:21:39.877324 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:39.877313 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bbwhj" Jun 11 16:21:42.973071 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:42.973017 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bbwhj" podStartSLOduration=68.430704284 podStartE2EDuration="1m10.973001892s" totalImagesPullingTime="2.542297608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:39.915613352 +0000 UTC m=+102.005923293" watchObservedRunningTime="2026-06-11 16:21:42.973001892 +0000 UTC m=+105.063311833" Jun 11 16:21:42.973761 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:42.973742 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m"] Jun 11 16:21:42.976382 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:42.976363 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:42.980157 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:42.980133 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 16:21:42.980157 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:42.980133 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-f4x7p\"" Jun 11 16:21:42.980352 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:42.980175 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:21:42.980352 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:42.980175 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:21:42.980352 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:42.980230 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:21:42.980352 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:42.980150 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 16:21:42.980644 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:42.980628 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 16:21:42.998060 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:42.998035 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m"] Jun 11 16:21:43.004252 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.004232 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lgn8p"] Jun 11 16:21:43.006250 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.006232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.010784 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.010766 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-62q4t\"" Jun 11 16:21:43.010896 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.010783 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:21:43.010896 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.010794 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:21:43.010896 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.010769 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:21:43.084916 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.084882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-metrics-client-ca\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.085094 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.084920 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.085094 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.084941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-wtmp\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.085094 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.084962 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-tls\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.085094 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.085029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a5faa13-d683-4a51-879b-47c530adcc61-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.085094 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.085062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-sys\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.085094 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.085079 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-root\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.085317 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.085134 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vgdj\" (UniqueName: \"kubernetes.io/projected/7a5faa13-d683-4a51-879b-47c530adcc61-kube-api-access-5vgdj\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.085317 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.085155 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.085317 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.085183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9z4t\" (UniqueName: \"kubernetes.io/projected/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-kube-api-access-w9z4t\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.085317 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.085201 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7a5faa13-d683-4a51-879b-47c530adcc61-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.085317 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.085238 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-textfile\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.085317 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.085259 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.085317 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.085280 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.085317 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.085299 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.186426 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.186376 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-textfile\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.186426 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.186433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.186649 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:21:43.186603 2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 16:21:43.186685 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:21:43.186673 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-tls podName:7a5faa13-d683-4a51-879b-47c530adcc61 nodeName:}" failed. No retries permitted until 2026-06-11 16:21:43.686654268 +0000 UTC m=+105.776964176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-5d99m" (UID: "7a5faa13-d683-4a51-879b-47c530adcc61") : secret "kube-state-metrics-tls" not found Jun 11 16:21:43.186730 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.186601 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.186765 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.186729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.186765 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.186752 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-textfile\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.186826 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.186765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-metrics-client-ca\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.186826 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.186815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.186926 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.186902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-wtmp\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.186977 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.186953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-tls\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.187013 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.186993 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a5faa13-d683-4a51-879b-47c530adcc61-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.187074 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-sys\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.187074 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187029 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-wtmp\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.187074 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-root\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.187203 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187077 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgdj\" (UniqueName: \"kubernetes.io/projected/7a5faa13-d683-4a51-879b-47c530adcc61-kube-api-access-5vgdj\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.187203 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187085 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-sys\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.187203 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.187203 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187127 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-root\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.187203 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9z4t\" (UniqueName: \"kubernetes.io/projected/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-kube-api-access-w9z4t\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.187203 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187181 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7a5faa13-d683-4a51-879b-47c530adcc61-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.187685 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187298 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-metrics-client-ca\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.187685 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187337 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.187685 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187545 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7a5faa13-d683-4a51-879b-47c530adcc61-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.187846 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187757 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a5faa13-d683-4a51-879b-47c530adcc61-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.187846 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.187784 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.189385 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.189356 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.189509 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.189368 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-tls\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.189556 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.189517 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.209378 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.209360 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9z4t\" (UniqueName: \"kubernetes.io/projected/bd9f974b-83fc-48dc-aded-4f57d2fba5a9-kube-api-access-w9z4t\") pod \"node-exporter-lgn8p\" (UID: \"bd9f974b-83fc-48dc-aded-4f57d2fba5a9\") " pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.213770 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.213750 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vgdj\" (UniqueName: \"kubernetes.io/projected/7a5faa13-d683-4a51-879b-47c530adcc61-kube-api-access-5vgdj\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.314900 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.314819 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lgn8p" Jun 11 16:21:43.325452 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:21:43.325424 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd9f974b_83fc_48dc_aded_4f57d2fba5a9.slice/crio-21ee677585da3184f0a254a65fd4ca04c9c65b1e8cf6110c81ab7b1d9a2736b3 WatchSource:0}: Error finding container 21ee677585da3184f0a254a65fd4ca04c9c65b1e8cf6110c81ab7b1d9a2736b3: Status 404 returned error can't find the container with id 21ee677585da3184f0a254a65fd4ca04c9c65b1e8cf6110c81ab7b1d9a2736b3 Jun 11 16:21:43.691365 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.691338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.693791 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.693771 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a5faa13-d683-4a51-879b-47c530adcc61-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-5d99m\" (UID: \"7a5faa13-d683-4a51-879b-47c530adcc61\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.885380 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.885346 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" Jun 11 16:21:43.890472 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:43.890435 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgn8p" event={"ID":"bd9f974b-83fc-48dc-aded-4f57d2fba5a9","Type":"ContainerStarted","Data":"21ee677585da3184f0a254a65fd4ca04c9c65b1e8cf6110c81ab7b1d9a2736b3"} Jun 11 16:21:44.043258 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:44.043236 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m"] Jun 11 16:21:44.227980 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:21:44.227913 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5faa13_d683_4a51_879b_47c530adcc61.slice/crio-c07823165b7a6ef55aa6f4036633dea50790fc7a396117d0a8e8c06dcf7d1e94 WatchSource:0}: Error finding container c07823165b7a6ef55aa6f4036633dea50790fc7a396117d0a8e8c06dcf7d1e94: Status 404 returned error can't find the container with id c07823165b7a6ef55aa6f4036633dea50790fc7a396117d0a8e8c06dcf7d1e94 Jun 11 16:21:44.896406 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:44.896358 2580 generic.go:356] "Generic (PLEG): container finished" podID="bd9f974b-83fc-48dc-aded-4f57d2fba5a9" containerID="c355b8da254d90ba8c050d42194b9732321e1d429cb9334bb60eb255c919c366" exitCode=0 Jun 11 16:21:44.896604 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:44.896521 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgn8p" event={"ID":"bd9f974b-83fc-48dc-aded-4f57d2fba5a9","Type":"ContainerDied","Data":"c355b8da254d90ba8c050d42194b9732321e1d429cb9334bb60eb255c919c366"} Jun 11 16:21:44.897925 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:44.897898 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" event={"ID":"7a5faa13-d683-4a51-879b-47c530adcc61","Type":"ContainerStarted","Data":"c07823165b7a6ef55aa6f4036633dea50790fc7a396117d0a8e8c06dcf7d1e94"} Jun 11 16:21:45.903016 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:45.902973 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgn8p" event={"ID":"bd9f974b-83fc-48dc-aded-4f57d2fba5a9","Type":"ContainerStarted","Data":"c78d674e0f8db57b8a629958b29fe8ea65f58a161421db99ccb49ec329fb6fa5"} Jun 11 16:21:45.903424 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:45.903042 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgn8p" event={"ID":"bd9f974b-83fc-48dc-aded-4f57d2fba5a9","Type":"ContainerStarted","Data":"62d0a79f12f018ce1792d1278a8a1052a195a6efba549c16a830905843b4baf0"} Jun 11 16:21:45.905091 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:45.905069 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" event={"ID":"7a5faa13-d683-4a51-879b-47c530adcc61","Type":"ContainerStarted","Data":"0fe8d31dac87f476a2e82e32ee0d3e0969d8e7af564f4bf003632c337f651b32"} Jun 11 16:21:45.905203 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:45.905109 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" event={"ID":"7a5faa13-d683-4a51-879b-47c530adcc61","Type":"ContainerStarted","Data":"b021b95fe7d83f1d673154bea821943b2a47f8a94a1b5dd6d1063cc74dc14534"} Jun 11 16:21:45.905203 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:45.905127 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" event={"ID":"7a5faa13-d683-4a51-879b-47c530adcc61","Type":"ContainerStarted","Data":"24606a45ae8a4d156ac9f200c9c3eac2d24d1b755df53bedbe9962c3d5f48bb4"} Jun 11 16:21:45.925428 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:45.925381 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lgn8p" podStartSLOduration=2.923316618 podStartE2EDuration="3.925367411s" totalImagesPullingTime="928.62253ms" totalInitContainerRuntime="73.428263ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:45.923772126 +0000 UTC m=+108.014082066" watchObservedRunningTime="2026-06-11 16:21:45.925367411 +0000 UTC m=+108.015677318" Jun 11 16:21:45.986869 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:45.986813 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5d99m" podStartSLOduration=2.9543639 podStartE2EDuration="3.986797119s" totalImagesPullingTime="1.032433219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:45.985064303 +0000 UTC m=+108.075374232" watchObservedRunningTime="2026-06-11 16:21:45.986797119 +0000 UTC m=+108.077107048" Jun 11 16:21:49.882468 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:21:49.882440 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bbwhj" Jun 11 16:22:07.169856 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:07.169815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:22:07.172445 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:07.172418 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02b9ac4-6014-43d9-b7c6-310d4acd29af-metrics-certs\") pod \"network-metrics-daemon-qg5m6\" (UID: \"f02b9ac4-6014-43d9-b7c6-310d4acd29af\") " pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:22:07.374826 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:07.374798 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hmdjj\"" Jun 11 16:22:07.382435 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:07.382412 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg5m6" Jun 11 16:22:07.511285 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:07.511246 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qg5m6"] Jun 11 16:22:07.515440 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:22:07.515381 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02b9ac4_6014_43d9_b7c6_310d4acd29af.slice/crio-a27a769eb5faf49294e30265c3580173facdc8b763f71c3a07f316480abf6b2e WatchSource:0}: Error finding container a27a769eb5faf49294e30265c3580173facdc8b763f71c3a07f316480abf6b2e: Status 404 returned error can't find the container with id a27a769eb5faf49294e30265c3580173facdc8b763f71c3a07f316480abf6b2e Jun 11 16:22:07.979150 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:07.979112 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qg5m6" event={"ID":"f02b9ac4-6014-43d9-b7c6-310d4acd29af","Type":"ContainerStarted","Data":"a27a769eb5faf49294e30265c3580173facdc8b763f71c3a07f316480abf6b2e"} Jun 11 16:22:08.986612 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:08.986572 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qg5m6" event={"ID":"f02b9ac4-6014-43d9-b7c6-310d4acd29af","Type":"ContainerStarted","Data":"aab19dc3363f292dbbdd921c60ecc905337f7aae5a48ba6e962873725cdb68a6"} Jun 11 16:22:08.986984 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:08.986640 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qg5m6" event={"ID":"f02b9ac4-6014-43d9-b7c6-310d4acd29af","Type":"ContainerStarted","Data":"16d7e6193b942d948b0c5b029f8f5e467ff97857c8ed2dfadd4ef3df98b7d8c3"} Jun 11 16:22:20.023543 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:20.023506 2580 generic.go:356] "Generic (PLEG): container finished" podID="5e01f338-29ac-4c6f-a980-29984d504529" containerID="39dff9d5401ef4320679337386357e20bc49d5a1dace2c133a252e952d77345d" exitCode=0 Jun 11 16:22:20.023997 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:20.023565 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mcfp9" event={"ID":"5e01f338-29ac-4c6f-a980-29984d504529","Type":"ContainerDied","Data":"39dff9d5401ef4320679337386357e20bc49d5a1dace2c133a252e952d77345d"} Jun 11 16:22:20.023997 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:20.023982 2580 scope.go:117] "RemoveContainer" containerID="39dff9d5401ef4320679337386357e20bc49d5a1dace2c133a252e952d77345d" Jun 11 16:22:20.052384 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:20.052344 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qg5m6" podStartSLOduration=141.256920703 podStartE2EDuration="2m22.052330956s" totalImagesPullingTime="795.410253ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:22:09.012926347 +0000 UTC m=+131.103236298" watchObservedRunningTime="2026-06-11 16:22:20.052330956 +0000 UTC m=+142.142640885" Jun 11 16:22:21.029172 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:22:21.029135 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-mcfp9" event={"ID":"5e01f338-29ac-4c6f-a980-29984d504529","Type":"ContainerStarted","Data":"308b5e3f73655c2c302aaff384fa423e2bf75b41dc37a9c42b340da718d0a49f"} Jun 11 16:24:58.289662 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:24:58.289620 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:24:58.293799 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:24:58.293772 2580 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:24:58.295240 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:24:58.295219 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:29:08.594615 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.594579 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh"] Jun 11 16:29:08.597543 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.597525 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh" Jun 11 16:29:08.600125 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.600099 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 16:29:08.600224 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.600152 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lqxqs\"" Jun 11 16:29:08.601164 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.601147 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 16:29:08.611628 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.611606 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh"] Jun 11 16:29:08.702336 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.702305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9984e9f3-87c6-4bc1-9105-5730e9ad86cf-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zd8rh\" (UID: \"9984e9f3-87c6-4bc1-9105-5730e9ad86cf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh" Jun 11 16:29:08.702450 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.702371 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9fpc\" (UniqueName: \"kubernetes.io/projected/9984e9f3-87c6-4bc1-9105-5730e9ad86cf-kube-api-access-t9fpc\") pod \"cert-manager-cainjector-5d99449ffd-zd8rh\" (UID: \"9984e9f3-87c6-4bc1-9105-5730e9ad86cf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh" Jun 11 16:29:08.807604 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.803726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9fpc\" (UniqueName: \"kubernetes.io/projected/9984e9f3-87c6-4bc1-9105-5730e9ad86cf-kube-api-access-t9fpc\") pod \"cert-manager-cainjector-5d99449ffd-zd8rh\" (UID: \"9984e9f3-87c6-4bc1-9105-5730e9ad86cf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh" Jun 11 16:29:08.807604 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.803816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9984e9f3-87c6-4bc1-9105-5730e9ad86cf-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zd8rh\" (UID: \"9984e9f3-87c6-4bc1-9105-5730e9ad86cf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh" Jun 11 16:29:08.813310 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.813285 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9984e9f3-87c6-4bc1-9105-5730e9ad86cf-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zd8rh\" (UID: \"9984e9f3-87c6-4bc1-9105-5730e9ad86cf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh" Jun 11 16:29:08.813404 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.813329 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9fpc\" (UniqueName: \"kubernetes.io/projected/9984e9f3-87c6-4bc1-9105-5730e9ad86cf-kube-api-access-t9fpc\") pod \"cert-manager-cainjector-5d99449ffd-zd8rh\" (UID: \"9984e9f3-87c6-4bc1-9105-5730e9ad86cf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh" Jun 11 16:29:08.906444 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:08.906388 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh" Jun 11 16:29:09.030033 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:09.030007 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh"] Jun 11 16:29:09.032464 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:29:09.032438 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9984e9f3_87c6_4bc1_9105_5730e9ad86cf.slice/crio-7fd0eb1ef332b380d59c4ce1eb28274d0bca05c4b6ba6c47a87c2fe1ca9504b3 WatchSource:0}: Error finding container 7fd0eb1ef332b380d59c4ce1eb28274d0bca05c4b6ba6c47a87c2fe1ca9504b3: Status 404 returned error can't find the container with id 7fd0eb1ef332b380d59c4ce1eb28274d0bca05c4b6ba6c47a87c2fe1ca9504b3 Jun 11 16:29:09.034223 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:09.034205 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:29:09.364326 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:09.364296 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh" event={"ID":"9984e9f3-87c6-4bc1-9105-5730e9ad86cf","Type":"ContainerStarted","Data":"7fd0eb1ef332b380d59c4ce1eb28274d0bca05c4b6ba6c47a87c2fe1ca9504b3"} Jun 11 16:29:12.376151 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:12.376117 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh" event={"ID":"9984e9f3-87c6-4bc1-9105-5730e9ad86cf","Type":"ContainerStarted","Data":"4a84773e22b50edcef1f5b2a592c17efa0d0b713f6a8a35e82b4404ad3a56261"} Jun 11 16:29:12.414623 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:12.414535 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zd8rh" podStartSLOduration=1.28558734 podStartE2EDuration="4.414519344s" totalImagesPullingTime="3.128932004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:29:12.411056305 +0000 UTC m=+554.501366234" watchObservedRunningTime="2026-06-11 16:29:12.414519344 +0000 UTC m=+554.504829276" Jun 11 16:29:38.945418 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:38.945384 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4"] Jun 11 16:29:38.948552 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:38.948527 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:38.951878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:38.951856 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 16:29:38.951994 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:38.951968 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n9hnv\"" Jun 11 16:29:38.952294 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:38.952278 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 16:29:38.952350 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:38.952305 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 16:29:38.952774 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:38.952758 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 16:29:38.987419 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:38.987394 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4"] Jun 11 16:29:39.116228 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.116194 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/009db1c7-876b-422d-a478-30e7c5f109e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.116228 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.116229 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj8fh\" (UniqueName: \"kubernetes.io/projected/009db1c7-876b-422d-a478-30e7c5f109e2-kube-api-access-nj8fh\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.116449 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.116252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/009db1c7-876b-422d-a478-30e7c5f109e2-manifests\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.116449 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.116273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/009db1c7-876b-422d-a478-30e7c5f109e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.116449 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.116343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/009db1c7-876b-422d-a478-30e7c5f109e2-tmp\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.217368 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.217290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/009db1c7-876b-422d-a478-30e7c5f109e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.217368 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.217324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj8fh\" (UniqueName: \"kubernetes.io/projected/009db1c7-876b-422d-a478-30e7c5f109e2-kube-api-access-nj8fh\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.217368 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.217348 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/009db1c7-876b-422d-a478-30e7c5f109e2-manifests\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.217663 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.217463 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/009db1c7-876b-422d-a478-30e7c5f109e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.217663 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.217524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/009db1c7-876b-422d-a478-30e7c5f109e2-tmp\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.217939 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.217910 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/009db1c7-876b-422d-a478-30e7c5f109e2-manifests\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.219901 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.219872 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/009db1c7-876b-422d-a478-30e7c5f109e2-tmp\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.220054 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.220034 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/009db1c7-876b-422d-a478-30e7c5f109e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.220110 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.220081 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/009db1c7-876b-422d-a478-30e7c5f109e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.232417 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.232388 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj8fh\" (UniqueName: \"kubernetes.io/projected/009db1c7-876b-422d-a478-30e7c5f109e2-kube-api-access-nj8fh\") pod \"opendatahub-operator-controller-manager-74f85fbfb-rnvl4\" (UID: \"009db1c7-876b-422d-a478-30e7c5f109e2\") " pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.259566 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.259528 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:39.427313 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.427281 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4"] Jun 11 16:29:39.432066 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:29:39.432038 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009db1c7_876b_422d_a478_30e7c5f109e2.slice/crio-072ed8cb91e74130c3b5db6097d8fd37abf7bdbf3c0639326a10d29cc7ebc523 WatchSource:0}: Error finding container 072ed8cb91e74130c3b5db6097d8fd37abf7bdbf3c0639326a10d29cc7ebc523: Status 404 returned error can't find the container with id 072ed8cb91e74130c3b5db6097d8fd37abf7bdbf3c0639326a10d29cc7ebc523 Jun 11 16:29:39.469418 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:39.469337 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" event={"ID":"009db1c7-876b-422d-a478-30e7c5f109e2","Type":"ContainerStarted","Data":"072ed8cb91e74130c3b5db6097d8fd37abf7bdbf3c0639326a10d29cc7ebc523"} Jun 11 16:29:42.481858 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:42.481797 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" event={"ID":"009db1c7-876b-422d-a478-30e7c5f109e2","Type":"ContainerStarted","Data":"e0112b26aeaca70f4ac3aa1ba1c2d1ad8e5055868341ea583e9aacea59b5c836"} Jun 11 16:29:43.486269 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:43.486234 2580 generic.go:356] "Generic (PLEG): container finished" podID="009db1c7-876b-422d-a478-30e7c5f109e2" containerID="e0112b26aeaca70f4ac3aa1ba1c2d1ad8e5055868341ea583e9aacea59b5c836" exitCode=0 Jun 11 16:29:43.486641 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:43.486328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" event={"ID":"009db1c7-876b-422d-a478-30e7c5f109e2","Type":"ContainerDied","Data":"e0112b26aeaca70f4ac3aa1ba1c2d1ad8e5055868341ea583e9aacea59b5c836"} Jun 11 16:29:44.499206 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:44.499161 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" event={"ID":"009db1c7-876b-422d-a478-30e7c5f109e2","Type":"ContainerStarted","Data":"959bbaad2d9656e3b5912e942c59df6cc2c953443e05e1392e987f7def1563c3"} Jun 11 16:29:44.499656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:44.499274 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:44.541293 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:44.541247 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" podStartSLOduration=2.456333494 podStartE2EDuration="6.541230656s" totalImagesPullingTime="3.095523559s" totalInitContainerRuntime="989.373603ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:29:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:29:44.539105224 +0000 UTC m=+586.629415209" watchObservedRunningTime="2026-06-11 16:29:44.541230656 +0000 UTC m=+586.631540644" Jun 11 16:29:55.505647 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:55.505614 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74f85fbfb-rnvl4" Jun 11 16:29:58.316352 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.316321 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:29:58.318449 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.318429 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:29:58.647578 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.647484 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75d74779d6-lttsg"] Jun 11 16:29:58.656099 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.656069 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" Jun 11 16:29:58.660109 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.660081 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 16:29:58.660355 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.660092 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g9kck\"" Jun 11 16:29:58.660431 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.660186 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 16:29:58.661616 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.661590 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75d74779d6-lttsg"] Jun 11 16:29:58.764811 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.764763 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f680b57-df30-4267-b0f6-88018b6b7785-tls-certs\") pod \"kube-auth-proxy-75d74779d6-lttsg\" (UID: \"8f680b57-df30-4267-b0f6-88018b6b7785\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" Jun 11 16:29:58.764983 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.764873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f680b57-df30-4267-b0f6-88018b6b7785-tmp\") pod \"kube-auth-proxy-75d74779d6-lttsg\" (UID: \"8f680b57-df30-4267-b0f6-88018b6b7785\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" Jun 11 16:29:58.764983 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.764940 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxbbh\" (UniqueName: \"kubernetes.io/projected/8f680b57-df30-4267-b0f6-88018b6b7785-kube-api-access-rxbbh\") pod \"kube-auth-proxy-75d74779d6-lttsg\" (UID: \"8f680b57-df30-4267-b0f6-88018b6b7785\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" Jun 11 16:29:58.765570 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.765546 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-8w4rd"] Jun 11 16:29:58.769353 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.769332 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" Jun 11 16:29:58.772203 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.772177 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-v22mz\"" Jun 11 16:29:58.772809 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.772760 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 16:29:58.782878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.782852 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-8w4rd"] Jun 11 16:29:58.865555 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.865516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzwqt\" (UniqueName: \"kubernetes.io/projected/d1801c68-9c60-4fdf-bd96-b3395d476a5b-kube-api-access-fzwqt\") pod \"odh-model-controller-6dc94f689f-8w4rd\" (UID: \"d1801c68-9c60-4fdf-bd96-b3395d476a5b\") " pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" Jun 11 16:29:58.865555 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.865574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f680b57-df30-4267-b0f6-88018b6b7785-tls-certs\") pod \"kube-auth-proxy-75d74779d6-lttsg\" (UID: \"8f680b57-df30-4267-b0f6-88018b6b7785\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" Jun 11 16:29:58.865848 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.865684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f680b57-df30-4267-b0f6-88018b6b7785-tmp\") pod \"kube-auth-proxy-75d74779d6-lttsg\" (UID: \"8f680b57-df30-4267-b0f6-88018b6b7785\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" Jun 11 16:29:58.865848 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.865736 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1801c68-9c60-4fdf-bd96-b3395d476a5b-cert\") pod \"odh-model-controller-6dc94f689f-8w4rd\" (UID: \"d1801c68-9c60-4fdf-bd96-b3395d476a5b\") " pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" Jun 11 16:29:58.865848 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.865796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxbbh\" (UniqueName: \"kubernetes.io/projected/8f680b57-df30-4267-b0f6-88018b6b7785-kube-api-access-rxbbh\") pod \"kube-auth-proxy-75d74779d6-lttsg\" (UID: \"8f680b57-df30-4267-b0f6-88018b6b7785\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" Jun 11 16:29:58.868092 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.868057 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f680b57-df30-4267-b0f6-88018b6b7785-tmp\") pod \"kube-auth-proxy-75d74779d6-lttsg\" (UID: \"8f680b57-df30-4267-b0f6-88018b6b7785\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" Jun 11 16:29:58.868326 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.868308 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f680b57-df30-4267-b0f6-88018b6b7785-tls-certs\") pod \"kube-auth-proxy-75d74779d6-lttsg\" (UID: \"8f680b57-df30-4267-b0f6-88018b6b7785\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" Jun 11 16:29:58.876995 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.876967 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxbbh\" (UniqueName: \"kubernetes.io/projected/8f680b57-df30-4267-b0f6-88018b6b7785-kube-api-access-rxbbh\") pod \"kube-auth-proxy-75d74779d6-lttsg\" (UID: \"8f680b57-df30-4267-b0f6-88018b6b7785\") " pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" Jun 11 16:29:58.966399 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.966356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1801c68-9c60-4fdf-bd96-b3395d476a5b-cert\") pod \"odh-model-controller-6dc94f689f-8w4rd\" (UID: \"d1801c68-9c60-4fdf-bd96-b3395d476a5b\") " pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" Jun 11 16:29:58.966600 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.966412 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" Jun 11 16:29:58.966600 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.966449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzwqt\" (UniqueName: \"kubernetes.io/projected/d1801c68-9c60-4fdf-bd96-b3395d476a5b-kube-api-access-fzwqt\") pod \"odh-model-controller-6dc94f689f-8w4rd\" (UID: \"d1801c68-9c60-4fdf-bd96-b3395d476a5b\") " pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" Jun 11 16:29:58.969042 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.969011 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1801c68-9c60-4fdf-bd96-b3395d476a5b-cert\") pod \"odh-model-controller-6dc94f689f-8w4rd\" (UID: \"d1801c68-9c60-4fdf-bd96-b3395d476a5b\") " pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" Jun 11 16:29:58.983088 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:58.983056 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzwqt\" (UniqueName: \"kubernetes.io/projected/d1801c68-9c60-4fdf-bd96-b3395d476a5b-kube-api-access-fzwqt\") pod \"odh-model-controller-6dc94f689f-8w4rd\" (UID: \"d1801c68-9c60-4fdf-bd96-b3395d476a5b\") " pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" Jun 11 16:29:59.083149 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.083104 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" Jun 11 16:29:59.113009 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.112979 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75d74779d6-lttsg"] Jun 11 16:29:59.115922 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:29:59.115881 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f680b57_df30_4267_b0f6_88018b6b7785.slice/crio-e3cc135747d0148a4b5baf2a896d821e2480e931d86535887f63c62af5800530 WatchSource:0}: Error finding container e3cc135747d0148a4b5baf2a896d821e2480e931d86535887f63c62af5800530: Status 404 returned error can't find the container with id e3cc135747d0148a4b5baf2a896d821e2480e931d86535887f63c62af5800530 Jun 11 16:29:59.232430 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.232341 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-8w4rd"] Jun 11 16:29:59.235177 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:29:59.235152 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1801c68_9c60_4fdf_bd96_b3395d476a5b.slice/crio-8688269b5d1e57a4056f1ba70ee4982361455fddee9dfac6adc5d4dec71825db WatchSource:0}: Error finding container 8688269b5d1e57a4056f1ba70ee4982361455fddee9dfac6adc5d4dec71825db: Status 404 returned error can't find the container with id 8688269b5d1e57a4056f1ba70ee4982361455fddee9dfac6adc5d4dec71825db Jun 11 16:29:59.453084 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.453048 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hdfgw"] Jun 11 16:29:59.457620 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.457602 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" Jun 11 16:29:59.460025 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.460001 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 16:29:59.468140 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.468105 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hdfgw"] Jun 11 16:29:59.555911 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.555803 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" event={"ID":"d1801c68-9c60-4fdf-bd96-b3395d476a5b","Type":"ContainerStarted","Data":"8688269b5d1e57a4056f1ba70ee4982361455fddee9dfac6adc5d4dec71825db"} Jun 11 16:29:59.556841 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.556815 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" event={"ID":"8f680b57-df30-4267-b0f6-88018b6b7785","Type":"ContainerStarted","Data":"e3cc135747d0148a4b5baf2a896d821e2480e931d86535887f63c62af5800530"} Jun 11 16:29:59.572363 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.572323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9747f72d-d91a-4d86-996e-a7c44173d562-tls-certs\") pod \"model-serving-api-5dd488fc48-hdfgw\" (UID: \"9747f72d-d91a-4d86-996e-a7c44173d562\") " pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" Jun 11 16:29:59.572500 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.572393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4srfm\" (UniqueName: \"kubernetes.io/projected/9747f72d-d91a-4d86-996e-a7c44173d562-kube-api-access-4srfm\") pod \"model-serving-api-5dd488fc48-hdfgw\" (UID: \"9747f72d-d91a-4d86-996e-a7c44173d562\") " pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" Jun 11 16:29:59.673300 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.673259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9747f72d-d91a-4d86-996e-a7c44173d562-tls-certs\") pod \"model-serving-api-5dd488fc48-hdfgw\" (UID: \"9747f72d-d91a-4d86-996e-a7c44173d562\") " pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" Jun 11 16:29:59.673464 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.673331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4srfm\" (UniqueName: \"kubernetes.io/projected/9747f72d-d91a-4d86-996e-a7c44173d562-kube-api-access-4srfm\") pod \"model-serving-api-5dd488fc48-hdfgw\" (UID: \"9747f72d-d91a-4d86-996e-a7c44173d562\") " pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" Jun 11 16:29:59.673464 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:29:59.673441 2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 16:29:59.673613 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:29:59.673537 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9747f72d-d91a-4d86-996e-a7c44173d562-tls-certs podName:9747f72d-d91a-4d86-996e-a7c44173d562 nodeName:}" failed. No retries permitted until 2026-06-11 16:30:00.17351527 +0000 UTC m=+602.263825178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9747f72d-d91a-4d86-996e-a7c44173d562-tls-certs") pod "model-serving-api-5dd488fc48-hdfgw" (UID: "9747f72d-d91a-4d86-996e-a7c44173d562") : secret "model-serving-api-tls" not found Jun 11 16:29:59.684633 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:29:59.684597 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4srfm\" (UniqueName: \"kubernetes.io/projected/9747f72d-d91a-4d86-996e-a7c44173d562-kube-api-access-4srfm\") pod \"model-serving-api-5dd488fc48-hdfgw\" (UID: \"9747f72d-d91a-4d86-996e-a7c44173d562\") " pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" Jun 11 16:30:00.178574 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:00.178329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9747f72d-d91a-4d86-996e-a7c44173d562-tls-certs\") pod \"model-serving-api-5dd488fc48-hdfgw\" (UID: \"9747f72d-d91a-4d86-996e-a7c44173d562\") " pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" Jun 11 16:30:00.184691 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:00.184622 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9747f72d-d91a-4d86-996e-a7c44173d562-tls-certs\") pod \"model-serving-api-5dd488fc48-hdfgw\" (UID: \"9747f72d-d91a-4d86-996e-a7c44173d562\") " pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" Jun 11 16:30:00.370638 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:00.370600 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" Jun 11 16:30:00.611270 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:00.609933 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hdfgw"] Jun 11 16:30:02.207945 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:30:02.207901 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9747f72d_d91a_4d86_996e_a7c44173d562.slice/crio-23091e8d999da924b808035bfd10fcfc2302d8864fcbfcc089db637d44db4f07 WatchSource:0}: Error finding container 23091e8d999da924b808035bfd10fcfc2302d8864fcbfcc089db637d44db4f07: Status 404 returned error can't find the container with id 23091e8d999da924b808035bfd10fcfc2302d8864fcbfcc089db637d44db4f07 Jun 11 16:30:02.584632 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:02.584537 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" event={"ID":"9747f72d-d91a-4d86-996e-a7c44173d562","Type":"ContainerStarted","Data":"23091e8d999da924b808035bfd10fcfc2302d8864fcbfcc089db637d44db4f07"} Jun 11 16:30:03.592459 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:03.592195 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" event={"ID":"d1801c68-9c60-4fdf-bd96-b3395d476a5b","Type":"ContainerStarted","Data":"67be2c77d04bc51e2354385b7def38487fa6de70e433c38a634d9135367bf196"} Jun 11 16:30:03.592459 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:03.592437 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" Jun 11 16:30:03.594465 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:03.594431 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" event={"ID":"8f680b57-df30-4267-b0f6-88018b6b7785","Type":"ContainerStarted","Data":"ea6f60b766953777fbb733b7c74754d59a72796159e755ae3a5389f72b29f846"} Jun 11 16:30:03.612231 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:03.612170 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" podStartSLOduration=1.3921803 podStartE2EDuration="5.6121514s" totalImagesPullingTime="4.2199711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:30:03.610416608 +0000 UTC m=+605.700726538" watchObservedRunningTime="2026-06-11 16:30:03.6121514 +0000 UTC m=+605.702461330" Jun 11 16:30:03.629893 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:03.629829 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75d74779d6-lttsg" podStartSLOduration=1.292776133 podStartE2EDuration="5.62980886s" totalImagesPullingTime="4.337032727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:30:03.628614452 +0000 UTC m=+605.718924408" watchObservedRunningTime="2026-06-11 16:30:03.62980886 +0000 UTC m=+605.720118788" Jun 11 16:30:05.604862 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:05.604823 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" event={"ID":"9747f72d-d91a-4d86-996e-a7c44173d562","Type":"ContainerStarted","Data":"2f407a29ef176fc50b6481fdc106b63a8bd95118d7bc99a3707fa58e7f217403"} Jun 11 16:30:05.605344 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:05.604959 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" Jun 11 16:30:05.626467 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:05.626388 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" podStartSLOduration=4.207714686 podStartE2EDuration="6.626369268s" totalImagesPullingTime="2.418654582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:30:05.623926998 +0000 UTC m=+607.714236979" watchObservedRunningTime="2026-06-11 16:30:05.626369268 +0000 UTC m=+607.716679197" Jun 11 16:30:10.076863 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.076829 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qxvnl"] Jun 11 16:30:10.079894 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.079864 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" Jun 11 16:30:10.082481 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.082457 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 16:30:10.082632 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.082461 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lvb56\"" Jun 11 16:30:10.092519 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.092481 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb"] Jun 11 16:30:10.095777 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.095757 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" Jun 11 16:30:10.096330 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.096311 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qxvnl"] Jun 11 16:30:10.102721 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.102705 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jrcsp\"" Jun 11 16:30:10.103102 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.103085 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 16:30:10.123131 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.123105 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb"] Jun 11 16:30:10.159808 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.159773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5559da9-97ab-48f4-a532-9d8b44ffe4ec-cert\") pod \"kserve-controller-manager-69fc866d76-qxvnl\" (UID: \"c5559da9-97ab-48f4-a532-9d8b44ffe4ec\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" Jun 11 16:30:10.159974 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.159821 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h76n\" (UniqueName: \"kubernetes.io/projected/c5559da9-97ab-48f4-a532-9d8b44ffe4ec-kube-api-access-8h76n\") pod \"kserve-controller-manager-69fc866d76-qxvnl\" (UID: \"c5559da9-97ab-48f4-a532-9d8b44ffe4ec\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" Jun 11 16:30:10.159974 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.159856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xknsc\" (UniqueName: \"kubernetes.io/projected/924a2210-2774-4444-9380-48fcdd602a92-kube-api-access-xknsc\") pod \"llmisvc-controller-manager-864bfd7bc9-6qgtb\" (UID: \"924a2210-2774-4444-9380-48fcdd602a92\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" Jun 11 16:30:10.159974 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.159891 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/924a2210-2774-4444-9380-48fcdd602a92-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-6qgtb\" (UID: \"924a2210-2774-4444-9380-48fcdd602a92\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" Jun 11 16:30:10.260560 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.260522 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5559da9-97ab-48f4-a532-9d8b44ffe4ec-cert\") pod \"kserve-controller-manager-69fc866d76-qxvnl\" (UID: \"c5559da9-97ab-48f4-a532-9d8b44ffe4ec\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" Jun 11 16:30:10.260770 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.260569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h76n\" (UniqueName: \"kubernetes.io/projected/c5559da9-97ab-48f4-a532-9d8b44ffe4ec-kube-api-access-8h76n\") pod \"kserve-controller-manager-69fc866d76-qxvnl\" (UID: \"c5559da9-97ab-48f4-a532-9d8b44ffe4ec\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" Jun 11 16:30:10.260770 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.260593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xknsc\" (UniqueName: \"kubernetes.io/projected/924a2210-2774-4444-9380-48fcdd602a92-kube-api-access-xknsc\") pod \"llmisvc-controller-manager-864bfd7bc9-6qgtb\" (UID: \"924a2210-2774-4444-9380-48fcdd602a92\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" Jun 11 16:30:10.260770 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.260617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/924a2210-2774-4444-9380-48fcdd602a92-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-6qgtb\" (UID: \"924a2210-2774-4444-9380-48fcdd602a92\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" Jun 11 16:30:10.266523 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.264647 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5559da9-97ab-48f4-a532-9d8b44ffe4ec-cert\") pod \"kserve-controller-manager-69fc866d76-qxvnl\" (UID: \"c5559da9-97ab-48f4-a532-9d8b44ffe4ec\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" Jun 11 16:30:10.266523 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.264674 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/924a2210-2774-4444-9380-48fcdd602a92-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-6qgtb\" (UID: \"924a2210-2774-4444-9380-48fcdd602a92\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" Jun 11 16:30:10.269786 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.269755 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xknsc\" (UniqueName: \"kubernetes.io/projected/924a2210-2774-4444-9380-48fcdd602a92-kube-api-access-xknsc\") pod \"llmisvc-controller-manager-864bfd7bc9-6qgtb\" (UID: \"924a2210-2774-4444-9380-48fcdd602a92\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" Jun 11 16:30:10.270085 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.270066 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h76n\" (UniqueName: \"kubernetes.io/projected/c5559da9-97ab-48f4-a532-9d8b44ffe4ec-kube-api-access-8h76n\") pod \"kserve-controller-manager-69fc866d76-qxvnl\" (UID: \"c5559da9-97ab-48f4-a532-9d8b44ffe4ec\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" Jun 11 16:30:10.390527 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.390411 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" Jun 11 16:30:10.405836 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.405808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" Jun 11 16:30:10.533403 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.533373 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qxvnl"] Jun 11 16:30:10.535937 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:30:10.535908 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5559da9_97ab_48f4_a532_9d8b44ffe4ec.slice/crio-fefc24115ebd12b47377ec5b6dad72728306b6db26f08fee4ad0810c55af0a40 WatchSource:0}: Error finding container fefc24115ebd12b47377ec5b6dad72728306b6db26f08fee4ad0810c55af0a40: Status 404 returned error can't find the container with id fefc24115ebd12b47377ec5b6dad72728306b6db26f08fee4ad0810c55af0a40 Jun 11 16:30:10.563378 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.563354 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb"] Jun 11 16:30:10.565080 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:30:10.565058 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod924a2210_2774_4444_9380_48fcdd602a92.slice/crio-e81ab66407b7dd5c3b3e054e32a5eae7b502b382776c4891bcba481801bec429 WatchSource:0}: Error finding container e81ab66407b7dd5c3b3e054e32a5eae7b502b382776c4891bcba481801bec429: Status 404 returned error can't find the container with id e81ab66407b7dd5c3b3e054e32a5eae7b502b382776c4891bcba481801bec429 Jun 11 16:30:10.627670 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.627632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" event={"ID":"924a2210-2774-4444-9380-48fcdd602a92","Type":"ContainerStarted","Data":"e81ab66407b7dd5c3b3e054e32a5eae7b502b382776c4891bcba481801bec429"} Jun 11 16:30:10.628971 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:10.628936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" event={"ID":"c5559da9-97ab-48f4-a532-9d8b44ffe4ec","Type":"ContainerStarted","Data":"fefc24115ebd12b47377ec5b6dad72728306b6db26f08fee4ad0810c55af0a40"} Jun 11 16:30:14.600853 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:14.600824 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-8w4rd" Jun 11 16:30:14.650341 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:14.650295 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" event={"ID":"924a2210-2774-4444-9380-48fcdd602a92","Type":"ContainerStarted","Data":"febe9ac67a987915a5e8f1419492675819659d82ba80b841f0a3997c58071ffd"} Jun 11 16:30:14.650560 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:14.650429 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" Jun 11 16:30:14.652076 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:14.652046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" event={"ID":"c5559da9-97ab-48f4-a532-9d8b44ffe4ec","Type":"ContainerStarted","Data":"4a383bed3708b69f30c5b26929d67416ce711df3f987fc211cc3fbc0dc30824f"} Jun 11 16:30:14.652234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:14.652095 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" Jun 11 16:30:14.682449 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:14.682387 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" podStartSLOduration=1.174499223 podStartE2EDuration="4.682366227s" totalImagesPullingTime="3.507867004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:30:14.680463399 +0000 UTC m=+616.770773342" watchObservedRunningTime="2026-06-11 16:30:14.682366227 +0000 UTC m=+616.772676158" Jun 11 16:30:14.700829 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:14.700780 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" podStartSLOduration=1.185943638 podStartE2EDuration="4.700763079s" totalImagesPullingTime="3.514819441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:30:14.699782943 +0000 UTC m=+616.790092888" watchObservedRunningTime="2026-06-11 16:30:14.700763079 +0000 UTC m=+616.791073007" Jun 11 16:30:16.613095 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:16.613012 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-hdfgw" Jun 11 16:30:18.276500 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.276449 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt"] Jun 11 16:30:18.279477 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.279459 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" Jun 11 16:30:18.282662 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.282624 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 16:30:18.282859 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.282842 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-p9vn6\"" Jun 11 16:30:18.283140 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.283124 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 16:30:18.305870 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.305839 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt"] Jun 11 16:30:18.331262 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.331227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a4318af7-7f65-4a75-bb1f-bd13905a1057-operator-config\") pod \"servicemesh-operator3-57f65f65fb-mkkvt\" (UID: \"a4318af7-7f65-4a75-bb1f-bd13905a1057\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" Jun 11 16:30:18.331262 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.331263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wg8f\" (UniqueName: \"kubernetes.io/projected/a4318af7-7f65-4a75-bb1f-bd13905a1057-kube-api-access-6wg8f\") pod \"servicemesh-operator3-57f65f65fb-mkkvt\" (UID: \"a4318af7-7f65-4a75-bb1f-bd13905a1057\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" Jun 11 16:30:18.432193 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.432154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a4318af7-7f65-4a75-bb1f-bd13905a1057-operator-config\") pod \"servicemesh-operator3-57f65f65fb-mkkvt\" (UID: \"a4318af7-7f65-4a75-bb1f-bd13905a1057\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" Jun 11 16:30:18.432393 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.432198 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wg8f\" (UniqueName: \"kubernetes.io/projected/a4318af7-7f65-4a75-bb1f-bd13905a1057-kube-api-access-6wg8f\") pod \"servicemesh-operator3-57f65f65fb-mkkvt\" (UID: \"a4318af7-7f65-4a75-bb1f-bd13905a1057\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" Jun 11 16:30:18.434985 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.434959 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a4318af7-7f65-4a75-bb1f-bd13905a1057-operator-config\") pod \"servicemesh-operator3-57f65f65fb-mkkvt\" (UID: \"a4318af7-7f65-4a75-bb1f-bd13905a1057\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" Jun 11 16:30:18.448602 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.448575 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wg8f\" (UniqueName: \"kubernetes.io/projected/a4318af7-7f65-4a75-bb1f-bd13905a1057-kube-api-access-6wg8f\") pod \"servicemesh-operator3-57f65f65fb-mkkvt\" (UID: \"a4318af7-7f65-4a75-bb1f-bd13905a1057\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" Jun 11 16:30:18.588840 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.588715 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" Jun 11 16:30:18.750387 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:18.750360 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt"] Jun 11 16:30:18.752216 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:30:18.752184 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4318af7_7f65_4a75_bb1f_bd13905a1057.slice/crio-1950dd31bdf05128f5611a7e1b72e52a3d2aed551505a632fe477357d3b73607 WatchSource:0}: Error finding container 1950dd31bdf05128f5611a7e1b72e52a3d2aed551505a632fe477357d3b73607: Status 404 returned error can't find the container with id 1950dd31bdf05128f5611a7e1b72e52a3d2aed551505a632fe477357d3b73607 Jun 11 16:30:19.678963 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:19.678920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" event={"ID":"a4318af7-7f65-4a75-bb1f-bd13905a1057","Type":"ContainerStarted","Data":"1950dd31bdf05128f5611a7e1b72e52a3d2aed551505a632fe477357d3b73607"} Jun 11 16:30:21.691371 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:21.691322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" event={"ID":"a4318af7-7f65-4a75-bb1f-bd13905a1057","Type":"ContainerStarted","Data":"7bb3833df380f2b632484ca3108be26720e1f9ff0d75c17fc110d61384d00c6d"} Jun 11 16:30:21.691818 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:21.691449 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" Jun 11 16:30:28.885729 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:28.885662 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" podStartSLOduration=8.177788888 podStartE2EDuration="10.885639667s" totalImagesPullingTime="2.707850779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:30:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:30:21.730889101 +0000 UTC m=+623.821199029" watchObservedRunningTime="2026-06-11 16:30:28.885639667 +0000 UTC m=+630.975949596" Jun 11 16:30:28.886988 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:28.886967 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-867d74fdd8-frtcj"] Jun 11 16:30:28.890778 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:28.890758 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-867d74fdd8-frtcj" Jun 11 16:30:28.893739 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:28.893708 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pxvx7\"" Jun 11 16:30:28.894001 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:28.893983 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 16:30:28.901384 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:28.901356 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-867d74fdd8-frtcj"] Jun 11 16:30:29.022978 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:29.022942 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpqsl\" (UniqueName: \"kubernetes.io/projected/d1a594eb-c683-435d-9301-26975237b2c4-kube-api-access-rpqsl\") pod \"dashboard-redirect-867d74fdd8-frtcj\" (UID: \"d1a594eb-c683-435d-9301-26975237b2c4\") " pod="opendatahub/dashboard-redirect-867d74fdd8-frtcj" Jun 11 16:30:29.023154 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:29.022985 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d1a594eb-c683-435d-9301-26975237b2c4-redirect-config\") pod \"dashboard-redirect-867d74fdd8-frtcj\" (UID: \"d1a594eb-c683-435d-9301-26975237b2c4\") " pod="opendatahub/dashboard-redirect-867d74fdd8-frtcj" Jun 11 16:30:29.124321 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:29.124276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpqsl\" (UniqueName: \"kubernetes.io/projected/d1a594eb-c683-435d-9301-26975237b2c4-kube-api-access-rpqsl\") pod \"dashboard-redirect-867d74fdd8-frtcj\" (UID: \"d1a594eb-c683-435d-9301-26975237b2c4\") " pod="opendatahub/dashboard-redirect-867d74fdd8-frtcj" Jun 11 16:30:29.124321 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:29.124319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d1a594eb-c683-435d-9301-26975237b2c4-redirect-config\") pod \"dashboard-redirect-867d74fdd8-frtcj\" (UID: \"d1a594eb-c683-435d-9301-26975237b2c4\") " pod="opendatahub/dashboard-redirect-867d74fdd8-frtcj" Jun 11 16:30:29.125074 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:29.125053 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d1a594eb-c683-435d-9301-26975237b2c4-redirect-config\") pod \"dashboard-redirect-867d74fdd8-frtcj\" (UID: \"d1a594eb-c683-435d-9301-26975237b2c4\") " pod="opendatahub/dashboard-redirect-867d74fdd8-frtcj" Jun 11 16:30:29.133666 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:29.133635 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpqsl\" (UniqueName: \"kubernetes.io/projected/d1a594eb-c683-435d-9301-26975237b2c4-kube-api-access-rpqsl\") pod \"dashboard-redirect-867d74fdd8-frtcj\" (UID: \"d1a594eb-c683-435d-9301-26975237b2c4\") " pod="opendatahub/dashboard-redirect-867d74fdd8-frtcj" Jun 11 16:30:29.202159 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:29.202132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-867d74fdd8-frtcj" Jun 11 16:30:29.342107 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:29.342083 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-867d74fdd8-frtcj"] Jun 11 16:30:29.344940 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:30:29.344910 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a594eb_c683_435d_9301_26975237b2c4.slice/crio-118c08ad96ed30b28cad61043b5d5191b9300e4065c7014e11843fb1bfb606cd WatchSource:0}: Error finding container 118c08ad96ed30b28cad61043b5d5191b9300e4065c7014e11843fb1bfb606cd: Status 404 returned error can't find the container with id 118c08ad96ed30b28cad61043b5d5191b9300e4065c7014e11843fb1bfb606cd Jun 11 16:30:29.725529 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:29.725481 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-867d74fdd8-frtcj" event={"ID":"d1a594eb-c683-435d-9301-26975237b2c4","Type":"ContainerStarted","Data":"118c08ad96ed30b28cad61043b5d5191b9300e4065c7014e11843fb1bfb606cd"} Jun 11 16:30:32.698172 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:32.698130 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mkkvt" Jun 11 16:30:34.752694 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:34.752660 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-867d74fdd8-frtcj" event={"ID":"d1a594eb-c683-435d-9301-26975237b2c4","Type":"ContainerStarted","Data":"b114d0d9a74d8899cb6f6679b5ac9a3421a40149057db2580c472c6420212f28"} Jun 11 16:30:34.774886 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:34.774842 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-867d74fdd8-frtcj" podStartSLOduration=2.061774597 podStartE2EDuration="6.774826944s" totalImagesPullingTime="4.713052347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:30:34.774297987 +0000 UTC m=+636.864607973" watchObservedRunningTime="2026-06-11 16:30:34.774826944 +0000 UTC m=+636.865136872" Jun 11 16:30:45.658212 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:45.658182 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qgtb" Jun 11 16:30:45.667558 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:45.661098 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-qxvnl" Jun 11 16:30:48.494191 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.494161 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl"] Jun 11 16:30:48.496819 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.496801 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.499899 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.499872 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 16:30:48.500009 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.499912 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 16:30:48.500164 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.500149 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 16:30:48.500575 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.500559 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 16:30:48.500793 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.500779 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-r4kdk\"" Jun 11 16:30:48.511625 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.511602 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl"] Jun 11 16:30:48.570949 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.570921 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.571070 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.570953 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.571070 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.570974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.571070 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.570991 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wvrj\" (UniqueName: \"kubernetes.io/projected/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-kube-api-access-2wvrj\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.571202 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.571112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.571202 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.571137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.571202 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.571158 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.672391 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.672365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.672543 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.672394 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.672543 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.672416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.672543 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.672476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.672693 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.672551 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.672693 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.672582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.672693 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.672609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wvrj\" (UniqueName: \"kubernetes.io/projected/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-kube-api-access-2wvrj\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.673390 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.673339 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.675083 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.675053 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.675083 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.675064 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.675253 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.675121 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.675253 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.675177 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.686288 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.686263 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.686639 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.686613 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wvrj\" (UniqueName: \"kubernetes.io/projected/f36a1ad3-db13-47c9-b600-ee3f78e0cfb2-kube-api-access-2wvrj\") pod \"istiod-openshift-gateway-75c67f8887-662tl\" (UID: \"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.806736 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.806658 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:48.967633 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:48.967605 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl"] Jun 11 16:30:48.970136 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:30:48.970108 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36a1ad3_db13_47c9_b600_ee3f78e0cfb2.slice/crio-53d6a5ffe6db7be27b6cca7e3f8ba7d6e93d9dfce555e8cd045d5220a00d1bbd WatchSource:0}: Error finding container 53d6a5ffe6db7be27b6cca7e3f8ba7d6e93d9dfce555e8cd045d5220a00d1bbd: Status 404 returned error can't find the container with id 53d6a5ffe6db7be27b6cca7e3f8ba7d6e93d9dfce555e8cd045d5220a00d1bbd Jun 11 16:30:49.822296 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:49.822261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" event={"ID":"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2","Type":"ContainerStarted","Data":"53d6a5ffe6db7be27b6cca7e3f8ba7d6e93d9dfce555e8cd045d5220a00d1bbd"} Jun 11 16:30:51.314772 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:51.314730 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 11 16:30:51.315031 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:51.314807 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 11 16:30:51.833034 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:51.832998 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" event={"ID":"f36a1ad3-db13-47c9-b600-ee3f78e0cfb2","Type":"ContainerStarted","Data":"ce36a993c59faf2c523cb5e1e443d81909e6759b2b051f56cc15c8f0d5d35358"} Jun 11 16:30:51.833226 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:51.833118 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:30:51.858084 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:51.858034 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" podStartSLOduration=1.515723895 podStartE2EDuration="3.858020452s" totalImagesPullingTime="2.342296557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:30:51.856305828 +0000 UTC m=+653.946615807" watchObservedRunningTime="2026-06-11 16:30:51.858020452 +0000 UTC m=+653.948330381" Jun 11 16:30:52.839972 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:30:52.839950 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-662tl" Jun 11 16:31:37.677708 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:37.677677 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl"] Jun 11 16:31:37.685534 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:37.685512 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl" Jun 11 16:31:37.693242 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:37.693222 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:31:37.693561 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:37.693545 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ptqk4\"" Jun 11 16:31:37.693652 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:37.693641 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 16:31:37.694374 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:37.694359 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:31:37.701093 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:37.701074 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl"] Jun 11 16:31:37.751467 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:37.751431 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99lbn\" (UniqueName: \"kubernetes.io/projected/ba78ae55-0204-4444-be5a-05ac71e90995-kube-api-access-99lbn\") pod \"dns-operator-controller-manager-864dd78c4c-v8vbl\" (UID: \"ba78ae55-0204-4444-be5a-05ac71e90995\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl" Jun 11 16:31:37.852688 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:37.852654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99lbn\" (UniqueName: \"kubernetes.io/projected/ba78ae55-0204-4444-be5a-05ac71e90995-kube-api-access-99lbn\") pod \"dns-operator-controller-manager-864dd78c4c-v8vbl\" (UID: \"ba78ae55-0204-4444-be5a-05ac71e90995\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl" Jun 11 16:31:37.862335 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:37.862304 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99lbn\" (UniqueName: \"kubernetes.io/projected/ba78ae55-0204-4444-be5a-05ac71e90995-kube-api-access-99lbn\") pod \"dns-operator-controller-manager-864dd78c4c-v8vbl\" (UID: \"ba78ae55-0204-4444-be5a-05ac71e90995\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl" Jun 11 16:31:37.994957 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:37.994929 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl" Jun 11 16:31:38.131921 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:38.131896 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl"] Jun 11 16:31:38.134577 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:31:38.134542 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba78ae55_0204_4444_be5a_05ac71e90995.slice/crio-be8400b61a34148f42fde300a401d41f40c6cdf6c8d0d0225cfd472c1bd48cbe WatchSource:0}: Error finding container be8400b61a34148f42fde300a401d41f40c6cdf6c8d0d0225cfd472c1bd48cbe: Status 404 returned error can't find the container with id be8400b61a34148f42fde300a401d41f40c6cdf6c8d0d0225cfd472c1bd48cbe Jun 11 16:31:39.038029 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:39.037984 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl" event={"ID":"ba78ae55-0204-4444-be5a-05ac71e90995","Type":"ContainerStarted","Data":"be8400b61a34148f42fde300a401d41f40c6cdf6c8d0d0225cfd472c1bd48cbe"} Jun 11 16:31:41.048697 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:41.048648 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl" event={"ID":"ba78ae55-0204-4444-be5a-05ac71e90995","Type":"ContainerStarted","Data":"8f4ff5ccd9a4830fd7a9f3470c21c62b4fab7edacd24f9def2e7894a5e12d8dc"} Jun 11 16:31:41.049085 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:41.048735 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl" Jun 11 16:31:41.074938 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:41.074625 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl" podStartSLOduration=2.174977094 podStartE2EDuration="4.074606354s" totalImagesPullingTime="1.89962926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:41.073752522 +0000 UTC m=+703.164062471" watchObservedRunningTime="2026-06-11 16:31:41.074606354 +0000 UTC m=+703.164916288" Jun 11 16:31:43.590465 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:43.590426 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9"] Jun 11 16:31:43.593847 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:43.593827 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:43.598188 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:43.598166 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pszn5\"" Jun 11 16:31:43.611308 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:43.611275 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9"] Jun 11 16:31:43.707713 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:43.707671 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh6rj\" (UniqueName: \"kubernetes.io/projected/7b693c61-4b7f-4425-afd1-28f0711e7357-kube-api-access-kh6rj\") pod \"limitador-operator-controller-manager-859d7b78bd-zhsv9\" (UID: \"7b693c61-4b7f-4425-afd1-28f0711e7357\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:43.809148 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:43.809110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh6rj\" (UniqueName: \"kubernetes.io/projected/7b693c61-4b7f-4425-afd1-28f0711e7357-kube-api-access-kh6rj\") pod \"limitador-operator-controller-manager-859d7b78bd-zhsv9\" (UID: \"7b693c61-4b7f-4425-afd1-28f0711e7357\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:43.819458 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:43.819428 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh6rj\" (UniqueName: \"kubernetes.io/projected/7b693c61-4b7f-4425-afd1-28f0711e7357-kube-api-access-kh6rj\") pod \"limitador-operator-controller-manager-859d7b78bd-zhsv9\" (UID: \"7b693c61-4b7f-4425-afd1-28f0711e7357\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:43.903516 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:43.903411 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:44.039934 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:44.039858 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9"] Jun 11 16:31:44.043606 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:31:44.043576 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b693c61_4b7f_4425_afd1_28f0711e7357.slice/crio-bb86a687b8ea212ec6e2afb139177a4cef7fb09997e0794973f8f30a811978f3 WatchSource:0}: Error finding container bb86a687b8ea212ec6e2afb139177a4cef7fb09997e0794973f8f30a811978f3: Status 404 returned error can't find the container with id bb86a687b8ea212ec6e2afb139177a4cef7fb09997e0794973f8f30a811978f3 Jun 11 16:31:44.062378 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:44.062346 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" event={"ID":"7b693c61-4b7f-4425-afd1-28f0711e7357","Type":"ContainerStarted","Data":"bb86a687b8ea212ec6e2afb139177a4cef7fb09997e0794973f8f30a811978f3"} Jun 11 16:31:46.074086 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:46.074046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" event={"ID":"7b693c61-4b7f-4425-afd1-28f0711e7357","Type":"ContainerStarted","Data":"792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a"} Jun 11 16:31:46.074568 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:46.074128 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:46.094412 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:46.094361 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" podStartSLOduration=1.565415767 podStartE2EDuration="3.094346401s" totalImagesPullingTime="1.528930634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:46.093445504 +0000 UTC m=+708.183755434" watchObservedRunningTime="2026-06-11 16:31:46.094346401 +0000 UTC m=+708.184656329" Jun 11 16:31:52.054878 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:52.054842 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v8vbl" Jun 11 16:31:56.094944 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.094905 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9"] Jun 11 16:31:56.095441 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.095111 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" podUID="7b693c61-4b7f-4425-afd1-28f0711e7357" containerName="manager" containerID="cri-o://792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a" gracePeriod=2 Jun 11 16:31:56.097115 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.097088 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:56.113176 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.104535 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9"] Jun 11 16:31:56.113176 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:31:56.104793 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zhsv9\" is forbidden: User \"system:node:ip-10-0-131-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-101.ec2.internal' and this object" podUID="7b693c61-4b7f-4425-afd1-28f0711e7357" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:56.126425 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.126394 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c"] Jun 11 16:31:56.126770 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.126757 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b693c61-4b7f-4425-afd1-28f0711e7357" containerName="manager" Jun 11 16:31:56.126814 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.126773 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b693c61-4b7f-4425-afd1-28f0711e7357" containerName="manager" Jun 11 16:31:56.126847 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.126833 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b693c61-4b7f-4425-afd1-28f0711e7357" containerName="manager" Jun 11 16:31:56.129798 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.129776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c" Jun 11 16:31:56.132568 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:31:56.132536 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zhsv9\" is forbidden: User \"system:node:ip-10-0-131-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-101.ec2.internal' and this object" podUID="7b693c61-4b7f-4425-afd1-28f0711e7357" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:56.140041 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.140020 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c"] Jun 11 16:31:56.308182 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.308153 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp9cf\" (UniqueName: \"kubernetes.io/projected/4b8785e2-364f-48b7-be6f-1da352dd2e59-kube-api-access-wp9cf\") pod \"limitador-operator-controller-manager-859d7b78bd-gn78c\" (UID: \"4b8785e2-364f-48b7-be6f-1da352dd2e59\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c" Jun 11 16:31:56.335454 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.335425 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:56.338904 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:31:56.338878 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zhsv9\" is forbidden: User \"system:node:ip-10-0-131-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-101.ec2.internal' and this object" podUID="7b693c61-4b7f-4425-afd1-28f0711e7357" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:56.408861 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.408800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp9cf\" (UniqueName: \"kubernetes.io/projected/4b8785e2-364f-48b7-be6f-1da352dd2e59-kube-api-access-wp9cf\") pod \"limitador-operator-controller-manager-859d7b78bd-gn78c\" (UID: \"4b8785e2-364f-48b7-be6f-1da352dd2e59\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c" Jun 11 16:31:56.433121 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.433094 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp9cf\" (UniqueName: \"kubernetes.io/projected/4b8785e2-364f-48b7-be6f-1da352dd2e59-kube-api-access-wp9cf\") pod \"limitador-operator-controller-manager-859d7b78bd-gn78c\" (UID: \"4b8785e2-364f-48b7-be6f-1da352dd2e59\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c" Jun 11 16:31:56.472460 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.472425 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c" Jun 11 16:31:56.509383 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.509354 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh6rj\" (UniqueName: \"kubernetes.io/projected/7b693c61-4b7f-4425-afd1-28f0711e7357-kube-api-access-kh6rj\") pod \"7b693c61-4b7f-4425-afd1-28f0711e7357\" (UID: \"7b693c61-4b7f-4425-afd1-28f0711e7357\") " Jun 11 16:31:56.512055 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.512026 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b693c61-4b7f-4425-afd1-28f0711e7357-kube-api-access-kh6rj" (OuterVolumeSpecName: "kube-api-access-kh6rj") pod "7b693c61-4b7f-4425-afd1-28f0711e7357" (UID: "7b693c61-4b7f-4425-afd1-28f0711e7357"). InnerVolumeSpecName "kube-api-access-kh6rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:31:56.599816 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.599792 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c"] Jun 11 16:31:56.602138 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:31:56.602108 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8785e2_364f_48b7_be6f_1da352dd2e59.slice/crio-86e498012fca6192574903d91a552e374960d0e96fdb7ef82853efe64fbf7a5b WatchSource:0}: Error finding container 86e498012fca6192574903d91a552e374960d0e96fdb7ef82853efe64fbf7a5b: Status 404 returned error can't find the container with id 86e498012fca6192574903d91a552e374960d0e96fdb7ef82853efe64fbf7a5b Jun 11 16:31:56.610779 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:56.610695 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh6rj\" (UniqueName: \"kubernetes.io/projected/7b693c61-4b7f-4425-afd1-28f0711e7357-kube-api-access-kh6rj\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 16:31:57.124865 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:57.124828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c" event={"ID":"4b8785e2-364f-48b7-be6f-1da352dd2e59","Type":"ContainerStarted","Data":"5e94a0ea2db1ebbf74252da0adf20375fd99ff1023d074535cc693598892a3bf"} Jun 11 16:31:57.125212 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:57.124884 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c" event={"ID":"4b8785e2-364f-48b7-be6f-1da352dd2e59","Type":"ContainerStarted","Data":"86e498012fca6192574903d91a552e374960d0e96fdb7ef82853efe64fbf7a5b"} Jun 11 16:31:57.125212 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:57.124934 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c" Jun 11 16:31:57.126246 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:57.126223 2580 generic.go:356] "Generic (PLEG): container finished" podID="7b693c61-4b7f-4425-afd1-28f0711e7357" containerID="792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a" exitCode=0 Jun 11 16:31:57.126343 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:57.126260 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zhsv9" Jun 11 16:31:57.126343 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:57.126276 2580 scope.go:117] "RemoveContainer" containerID="792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a" Jun 11 16:31:57.135245 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:57.135230 2580 scope.go:117] "RemoveContainer" containerID="792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a" Jun 11 16:31:57.135502 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:31:57.135469 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a\": container with ID starting with 792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a not found: ID does not exist" containerID="792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a" Jun 11 16:31:57.135582 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:57.135551 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a"} err="failed to get container status \"792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a\": rpc error: code = NotFound desc = could not find container \"792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a\": container with ID starting with 792b3ef116208802f1acc94fa76000a99394b77a1bd50740d0c78323e22d1d6a not found: ID does not exist" Jun 11 16:31:57.155230 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:57.155179 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c" podStartSLOduration=1.155165977 podStartE2EDuration="1.155165977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:57.154703293 +0000 UTC m=+719.245013264" watchObservedRunningTime="2026-06-11 16:31:57.155165977 +0000 UTC m=+719.245475966" Jun 11 16:31:58.357844 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:31:58.357820 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b693c61-4b7f-4425-afd1-28f0711e7357" path="/var/lib/kubelet/pods/7b693c61-4b7f-4425-afd1-28f0711e7357/volumes" Jun 11 16:32:08.134605 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:08.134575 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn78c" Jun 11 16:32:41.671947 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.671911 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kh64q"] Jun 11 16:32:41.675012 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.674996 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:41.677315 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.677294 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 16:32:41.677435 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.677295 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bwrvp\"" Jun 11 16:32:41.683209 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.683189 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kh64q"] Jun 11 16:32:41.757424 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.757392 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7c63f8a-46ef-4791-b222-24725852b15f-config-file\") pod \"limitador-limitador-64c94fd64f-kh64q\" (UID: \"d7c63f8a-46ef-4791-b222-24725852b15f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:41.757683 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.757436 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6lgw\" (UniqueName: \"kubernetes.io/projected/d7c63f8a-46ef-4791-b222-24725852b15f-kube-api-access-w6lgw\") pod \"limitador-limitador-64c94fd64f-kh64q\" (UID: \"d7c63f8a-46ef-4791-b222-24725852b15f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:41.763417 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.763386 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kh64q"] Jun 11 16:32:41.858248 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.858214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7c63f8a-46ef-4791-b222-24725852b15f-config-file\") pod \"limitador-limitador-64c94fd64f-kh64q\" (UID: \"d7c63f8a-46ef-4791-b222-24725852b15f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:41.858419 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.858274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6lgw\" (UniqueName: \"kubernetes.io/projected/d7c63f8a-46ef-4791-b222-24725852b15f-kube-api-access-w6lgw\") pod \"limitador-limitador-64c94fd64f-kh64q\" (UID: \"d7c63f8a-46ef-4791-b222-24725852b15f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:41.858892 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.858867 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7c63f8a-46ef-4791-b222-24725852b15f-config-file\") pod \"limitador-limitador-64c94fd64f-kh64q\" (UID: \"d7c63f8a-46ef-4791-b222-24725852b15f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:41.867058 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.867034 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6lgw\" (UniqueName: \"kubernetes.io/projected/d7c63f8a-46ef-4791-b222-24725852b15f-kube-api-access-w6lgw\") pod \"limitador-limitador-64c94fd64f-kh64q\" (UID: \"d7c63f8a-46ef-4791-b222-24725852b15f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:41.986244 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:41.986186 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:42.146574 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:42.146552 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kh64q"] Jun 11 16:32:42.148616 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:32:42.148586 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c63f8a_46ef_4791_b222_24725852b15f.slice/crio-5df056552794aa76f2d56f55fb79b090a7b9704f66504e79f0c70d2282530883 WatchSource:0}: Error finding container 5df056552794aa76f2d56f55fb79b090a7b9704f66504e79f0c70d2282530883: Status 404 returned error can't find the container with id 5df056552794aa76f2d56f55fb79b090a7b9704f66504e79f0c70d2282530883 Jun 11 16:32:42.323162 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:42.323087 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" event={"ID":"d7c63f8a-46ef-4791-b222-24725852b15f","Type":"ContainerStarted","Data":"5df056552794aa76f2d56f55fb79b090a7b9704f66504e79f0c70d2282530883"} Jun 11 16:32:45.340568 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:45.340438 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" event={"ID":"d7c63f8a-46ef-4791-b222-24725852b15f","Type":"ContainerStarted","Data":"d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e"} Jun 11 16:32:45.340568 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:45.340562 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:45.366657 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:45.366610 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" podStartSLOduration=1.5688011830000002 podStartE2EDuration="4.366597069s" totalImagesPullingTime="2.797795886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:32:45.365221656 +0000 UTC m=+767.455531598" watchObservedRunningTime="2026-06-11 16:32:45.366597069 +0000 UTC m=+767.456906998" Jun 11 16:32:56.346114 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:56.346085 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:58.168665 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:58.168622 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kh64q"] Jun 11 16:32:58.169052 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:58.168858 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" podUID="d7c63f8a-46ef-4791-b222-24725852b15f" containerName="limitador" containerID="cri-o://d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e" gracePeriod=30 Jun 11 16:32:59.119399 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.119376 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:59.298840 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.298764 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6lgw\" (UniqueName: \"kubernetes.io/projected/d7c63f8a-46ef-4791-b222-24725852b15f-kube-api-access-w6lgw\") pod \"d7c63f8a-46ef-4791-b222-24725852b15f\" (UID: \"d7c63f8a-46ef-4791-b222-24725852b15f\") " Jun 11 16:32:59.299196 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.298840 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7c63f8a-46ef-4791-b222-24725852b15f-config-file\") pod \"d7c63f8a-46ef-4791-b222-24725852b15f\" (UID: \"d7c63f8a-46ef-4791-b222-24725852b15f\") " Jun 11 16:32:59.299196 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.299175 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7c63f8a-46ef-4791-b222-24725852b15f-config-file" (OuterVolumeSpecName: "config-file") pod "d7c63f8a-46ef-4791-b222-24725852b15f" (UID: "d7c63f8a-46ef-4791-b222-24725852b15f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:32:59.301007 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.300984 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7c63f8a-46ef-4791-b222-24725852b15f-kube-api-access-w6lgw" (OuterVolumeSpecName: "kube-api-access-w6lgw") pod "d7c63f8a-46ef-4791-b222-24725852b15f" (UID: "d7c63f8a-46ef-4791-b222-24725852b15f"). InnerVolumeSpecName "kube-api-access-w6lgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:32:59.399405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.399379 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6lgw\" (UniqueName: \"kubernetes.io/projected/d7c63f8a-46ef-4791-b222-24725852b15f-kube-api-access-w6lgw\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 16:32:59.399405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.399406 2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7c63f8a-46ef-4791-b222-24725852b15f-config-file\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 16:32:59.399951 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.399928 2580 generic.go:356] "Generic (PLEG): container finished" podID="d7c63f8a-46ef-4791-b222-24725852b15f" containerID="d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e" exitCode=0 Jun 11 16:32:59.400033 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.399968 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" Jun 11 16:32:59.400033 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.400012 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" event={"ID":"d7c63f8a-46ef-4791-b222-24725852b15f","Type":"ContainerDied","Data":"d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e"} Jun 11 16:32:59.400104 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.400055 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kh64q" event={"ID":"d7c63f8a-46ef-4791-b222-24725852b15f","Type":"ContainerDied","Data":"5df056552794aa76f2d56f55fb79b090a7b9704f66504e79f0c70d2282530883"} Jun 11 16:32:59.400104 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.400077 2580 scope.go:117] "RemoveContainer" containerID="d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e" Jun 11 16:32:59.408340 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.408325 2580 scope.go:117] "RemoveContainer" containerID="d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e" Jun 11 16:32:59.408704 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:32:59.408683 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e\": container with ID starting with d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e not found: ID does not exist" containerID="d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e" Jun 11 16:32:59.408779 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.408710 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e"} err="failed to get container status \"d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e\": rpc error: code = NotFound desc = could not find container \"d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e\": container with ID starting with d6827170bb46b428de95ef9d7ed7dec4ec7bb8d6b8ae05695033c621205f9c6e not found: ID does not exist" Jun 11 16:32:59.422457 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.422434 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kh64q"] Jun 11 16:32:59.426060 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:32:59.426039 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kh64q"] Jun 11 16:33:00.358872 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:00.358839 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7c63f8a-46ef-4791-b222-24725852b15f" path="/var/lib/kubelet/pods/d7c63f8a-46ef-4791-b222-24725852b15f/volumes" Jun 11 16:33:02.858249 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:02.858212 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-f6sdf"] Jun 11 16:33:02.858740 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:02.858710 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7c63f8a-46ef-4791-b222-24725852b15f" containerName="limitador" Jun 11 16:33:02.858740 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:02.858730 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7c63f8a-46ef-4791-b222-24725852b15f" containerName="limitador" Jun 11 16:33:02.858858 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:02.858816 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7c63f8a-46ef-4791-b222-24725852b15f" containerName="limitador" Jun 11 16:33:02.864434 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:02.864403 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-f6sdf" Jun 11 16:33:02.867039 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:02.867016 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 16:33:02.870883 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:02.870856 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-f6sdf"] Jun 11 16:33:03.029850 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:03.029815 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxwdm\" (UniqueName: \"kubernetes.io/projected/01b96ae2-2370-4f0a-b498-1c29d2c4fb8c-kube-api-access-kxwdm\") pod \"postgres-69fb4594cf-f6sdf\" (UID: \"01b96ae2-2370-4f0a-b498-1c29d2c4fb8c\") " pod="opendatahub/postgres-69fb4594cf-f6sdf" Jun 11 16:33:03.029850 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:03.029852 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/01b96ae2-2370-4f0a-b498-1c29d2c4fb8c-data\") pod \"postgres-69fb4594cf-f6sdf\" (UID: \"01b96ae2-2370-4f0a-b498-1c29d2c4fb8c\") " pod="opendatahub/postgres-69fb4594cf-f6sdf" Jun 11 16:33:03.130282 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:03.130207 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxwdm\" (UniqueName: \"kubernetes.io/projected/01b96ae2-2370-4f0a-b498-1c29d2c4fb8c-kube-api-access-kxwdm\") pod \"postgres-69fb4594cf-f6sdf\" (UID: \"01b96ae2-2370-4f0a-b498-1c29d2c4fb8c\") " pod="opendatahub/postgres-69fb4594cf-f6sdf" Jun 11 16:33:03.130282 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:03.130252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/01b96ae2-2370-4f0a-b498-1c29d2c4fb8c-data\") pod \"postgres-69fb4594cf-f6sdf\" (UID: \"01b96ae2-2370-4f0a-b498-1c29d2c4fb8c\") " pod="opendatahub/postgres-69fb4594cf-f6sdf" Jun 11 16:33:03.130709 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:03.130690 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/01b96ae2-2370-4f0a-b498-1c29d2c4fb8c-data\") pod \"postgres-69fb4594cf-f6sdf\" (UID: \"01b96ae2-2370-4f0a-b498-1c29d2c4fb8c\") " pod="opendatahub/postgres-69fb4594cf-f6sdf" Jun 11 16:33:03.139075 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:03.139058 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxwdm\" (UniqueName: \"kubernetes.io/projected/01b96ae2-2370-4f0a-b498-1c29d2c4fb8c-kube-api-access-kxwdm\") pod \"postgres-69fb4594cf-f6sdf\" (UID: \"01b96ae2-2370-4f0a-b498-1c29d2c4fb8c\") " pod="opendatahub/postgres-69fb4594cf-f6sdf" Jun 11 16:33:03.175914 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:03.175892 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-f6sdf" Jun 11 16:33:03.308032 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:03.307909 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-f6sdf"] Jun 11 16:33:03.310268 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:33:03.310239 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b96ae2_2370_4f0a_b498_1c29d2c4fb8c.slice/crio-0a1a8cb72418c65ef943ca2a09d22f6edcd4d6a23c28bba7afdb990f405e8470 WatchSource:0}: Error finding container 0a1a8cb72418c65ef943ca2a09d22f6edcd4d6a23c28bba7afdb990f405e8470: Status 404 returned error can't find the container with id 0a1a8cb72418c65ef943ca2a09d22f6edcd4d6a23c28bba7afdb990f405e8470 Jun 11 16:33:03.424782 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:03.424693 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-f6sdf" event={"ID":"01b96ae2-2370-4f0a-b498-1c29d2c4fb8c","Type":"ContainerStarted","Data":"0a1a8cb72418c65ef943ca2a09d22f6edcd4d6a23c28bba7afdb990f405e8470"} Jun 11 16:33:06.440971 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:06.440938 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-f6sdf" event={"ID":"01b96ae2-2370-4f0a-b498-1c29d2c4fb8c","Type":"ContainerStarted","Data":"2b41f7758065094903f5704e874f3253a6c91c512bd3145cb7537b8e6c7ab34c"} Jun 11 16:33:06.441324 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:06.441072 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-f6sdf" Jun 11 16:33:06.459789 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:06.459744 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-f6sdf" podStartSLOduration=2.099749903 podStartE2EDuration="4.459731568s" totalImagesPullingTime="2.359981665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:33:06.45802526 +0000 UTC m=+788.548335188" watchObservedRunningTime="2026-06-11 16:33:06.459731568 +0000 UTC m=+788.550041497" Jun 11 16:33:12.474937 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:12.474911 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-f6sdf" Jun 11 16:33:37.946380 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:37.946304 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:33:37.949714 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:37.949698 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:33:37.952571 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:37.952537 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 16:33:37.952571 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:37.952537 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 16:33:37.952716 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:37.952590 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 16:33:37.953648 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:37.953632 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xmslv\"" Jun 11 16:33:37.959869 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:37.959847 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:33:37.984632 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:37.984602 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np77n\" (UniqueName: \"kubernetes.io/projected/be0aac7f-33d1-4796-9afb-378c5a50fb10-kube-api-access-np77n\") pod \"maas-keycloak-0\" (UID: \"be0aac7f-33d1-4796-9afb-378c5a50fb10\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:33:38.085428 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:38.085398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np77n\" (UniqueName: \"kubernetes.io/projected/be0aac7f-33d1-4796-9afb-378c5a50fb10-kube-api-access-np77n\") pod \"maas-keycloak-0\" (UID: \"be0aac7f-33d1-4796-9afb-378c5a50fb10\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:33:38.094549 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:38.094521 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np77n\" (UniqueName: \"kubernetes.io/projected/be0aac7f-33d1-4796-9afb-378c5a50fb10-kube-api-access-np77n\") pod \"maas-keycloak-0\" (UID: \"be0aac7f-33d1-4796-9afb-378c5a50fb10\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:33:38.259398 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:38.259323 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:33:38.400756 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:38.400728 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:33:38.402521 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:33:38.402471 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0aac7f_33d1_4796_9afb_378c5a50fb10.slice/crio-91c9647ecd39761e6c5bb17800f4af26491fbb162ec84cd5c4b3824914e6f07b WatchSource:0}: Error finding container 91c9647ecd39761e6c5bb17800f4af26491fbb162ec84cd5c4b3824914e6f07b: Status 404 returned error can't find the container with id 91c9647ecd39761e6c5bb17800f4af26491fbb162ec84cd5c4b3824914e6f07b Jun 11 16:33:38.586011 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:38.585934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"be0aac7f-33d1-4796-9afb-378c5a50fb10","Type":"ContainerStarted","Data":"91c9647ecd39761e6c5bb17800f4af26491fbb162ec84cd5c4b3824914e6f07b"} Jun 11 16:33:44.620341 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:44.620300 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"be0aac7f-33d1-4796-9afb-378c5a50fb10","Type":"ContainerStarted","Data":"00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3"} Jun 11 16:33:44.641828 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:44.641772 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.119728612 podStartE2EDuration="7.641752278s" totalImagesPullingTime="5.522023666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:33:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:33:44.638680657 +0000 UTC m=+826.728990601" watchObservedRunningTime="2026-06-11 16:33:44.641752278 +0000 UTC m=+826.732062210" Jun 11 16:33:45.259791 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:45.259754 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 16:33:45.261408 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:45.261373 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:46.260318 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:46.260269 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:47.260261 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:47.260209 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:48.259594 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:48.259554 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:33:48.260227 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:48.259864 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:49.260134 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:49.260085 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:50.260644 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:50.260595 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:51.260737 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:51.260690 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:52.259652 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:52.259610 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:53.260580 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:53.260519 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:54.260282 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:54.260229 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:55.260811 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:55.260757 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:56.260248 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:56.260196 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.29:9000/health/started\": dial tcp 10.134.0.29:9000: connect: connection refused" Jun 11 16:33:57.381667 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:57.381628 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 16:33:57.399402 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:33:57.399342 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:34:07.387796 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:07.387751 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:34:14.325147 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:14.325113 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-858c8f8c6c-qq6xs"] Jun 11 16:34:14.332815 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:14.332775 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:14.335720 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:14.335700 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 16:34:14.335720 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:14.335717 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zvcz9\"" Jun 11 16:34:14.336576 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:14.336557 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 16:34:14.342237 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:14.342206 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-858c8f8c6c-qq6xs"] Jun 11 16:34:14.409797 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:14.409771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24bgd\" (UniqueName: \"kubernetes.io/projected/945fd5ea-a289-4217-a666-b7b3d2d110fd-kube-api-access-24bgd\") pod \"maas-controller-858c8f8c6c-qq6xs\" (UID: \"945fd5ea-a289-4217-a666-b7b3d2d110fd\") " pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:14.409941 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:14.409803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/945fd5ea-a289-4217-a666-b7b3d2d110fd-webhook-cert\") pod \"maas-controller-858c8f8c6c-qq6xs\" (UID: \"945fd5ea-a289-4217-a666-b7b3d2d110fd\") " pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:14.510659 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:14.510632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24bgd\" (UniqueName: \"kubernetes.io/projected/945fd5ea-a289-4217-a666-b7b3d2d110fd-kube-api-access-24bgd\") pod \"maas-controller-858c8f8c6c-qq6xs\" (UID: \"945fd5ea-a289-4217-a666-b7b3d2d110fd\") " pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:14.510659 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:14.510662 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/945fd5ea-a289-4217-a666-b7b3d2d110fd-webhook-cert\") pod \"maas-controller-858c8f8c6c-qq6xs\" (UID: \"945fd5ea-a289-4217-a666-b7b3d2d110fd\") " pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:14.510969 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:34:14.510756 2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 16:34:14.510969 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:34:14.510827 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945fd5ea-a289-4217-a666-b7b3d2d110fd-webhook-cert podName:945fd5ea-a289-4217-a666-b7b3d2d110fd nodeName:}" failed. No retries permitted until 2026-06-11 16:34:15.010799459 +0000 UTC m=+857.101109366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/945fd5ea-a289-4217-a666-b7b3d2d110fd-webhook-cert") pod "maas-controller-858c8f8c6c-qq6xs" (UID: "945fd5ea-a289-4217-a666-b7b3d2d110fd") : secret "maas-controller-webhook-cert" not found Jun 11 16:34:14.529214 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:14.529189 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24bgd\" (UniqueName: \"kubernetes.io/projected/945fd5ea-a289-4217-a666-b7b3d2d110fd-kube-api-access-24bgd\") pod \"maas-controller-858c8f8c6c-qq6xs\" (UID: \"945fd5ea-a289-4217-a666-b7b3d2d110fd\") " pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:15.013467 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:15.013438 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/945fd5ea-a289-4217-a666-b7b3d2d110fd-webhook-cert\") pod \"maas-controller-858c8f8c6c-qq6xs\" (UID: \"945fd5ea-a289-4217-a666-b7b3d2d110fd\") " pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:15.016007 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:15.015985 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/945fd5ea-a289-4217-a666-b7b3d2d110fd-webhook-cert\") pod \"maas-controller-858c8f8c6c-qq6xs\" (UID: \"945fd5ea-a289-4217-a666-b7b3d2d110fd\") " pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:15.244077 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:15.244047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:15.379641 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:15.379617 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-858c8f8c6c-qq6xs"] Jun 11 16:34:15.381617 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:34:15.381591 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod945fd5ea_a289_4217_a666_b7b3d2d110fd.slice/crio-7af7c867b0f62c925aa7158396080061882dd878ccaf9f3a21a961810f06c71c WatchSource:0}: Error finding container 7af7c867b0f62c925aa7158396080061882dd878ccaf9f3a21a961810f06c71c: Status 404 returned error can't find the container with id 7af7c867b0f62c925aa7158396080061882dd878ccaf9f3a21a961810f06c71c Jun 11 16:34:15.382936 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:15.382921 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:34:15.792426 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:15.792390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" event={"ID":"945fd5ea-a289-4217-a666-b7b3d2d110fd","Type":"ContainerStarted","Data":"7af7c867b0f62c925aa7158396080061882dd878ccaf9f3a21a961810f06c71c"} Jun 11 16:34:18.810557 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:18.810512 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" event={"ID":"945fd5ea-a289-4217-a666-b7b3d2d110fd","Type":"ContainerStarted","Data":"a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f"} Jun 11 16:34:18.810964 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:18.810628 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:18.866660 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:18.866617 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" podStartSLOduration=2.201029835 podStartE2EDuration="4.866601869s" totalImagesPullingTime="2.665572034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:18.864207706 +0000 UTC m=+860.954517664" watchObservedRunningTime="2026-06-11 16:34:18.866601869 +0000 UTC m=+860.956911798" Jun 11 16:34:29.311015 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.310975 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-858c8f8c6c-qq6xs"] Jun 11 16:34:29.311458 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.311237 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" podUID="945fd5ea-a289-4217-a666-b7b3d2d110fd" containerName="manager" containerID="cri-o://a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f" gracePeriod=30 Jun 11 16:34:29.319688 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.319644 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:29.546100 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.546079 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:29.627936 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.627865 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/945fd5ea-a289-4217-a666-b7b3d2d110fd-webhook-cert\") pod \"945fd5ea-a289-4217-a666-b7b3d2d110fd\" (UID: \"945fd5ea-a289-4217-a666-b7b3d2d110fd\") " Jun 11 16:34:29.627936 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.627913 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24bgd\" (UniqueName: \"kubernetes.io/projected/945fd5ea-a289-4217-a666-b7b3d2d110fd-kube-api-access-24bgd\") pod \"945fd5ea-a289-4217-a666-b7b3d2d110fd\" (UID: \"945fd5ea-a289-4217-a666-b7b3d2d110fd\") " Jun 11 16:34:29.630197 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.630174 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/945fd5ea-a289-4217-a666-b7b3d2d110fd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "945fd5ea-a289-4217-a666-b7b3d2d110fd" (UID: "945fd5ea-a289-4217-a666-b7b3d2d110fd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:34:29.630307 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.630289 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/945fd5ea-a289-4217-a666-b7b3d2d110fd-kube-api-access-24bgd" (OuterVolumeSpecName: "kube-api-access-24bgd") pod "945fd5ea-a289-4217-a666-b7b3d2d110fd" (UID: "945fd5ea-a289-4217-a666-b7b3d2d110fd"). InnerVolumeSpecName "kube-api-access-24bgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:34:29.728883 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.728850 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/945fd5ea-a289-4217-a666-b7b3d2d110fd-webhook-cert\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 16:34:29.728883 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.728877 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24bgd\" (UniqueName: \"kubernetes.io/projected/945fd5ea-a289-4217-a666-b7b3d2d110fd-kube-api-access-24bgd\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 16:34:29.861425 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.861391 2580 generic.go:356] "Generic (PLEG): container finished" podID="945fd5ea-a289-4217-a666-b7b3d2d110fd" containerID="a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f" exitCode=0 Jun 11 16:34:29.861603 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.861434 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" Jun 11 16:34:29.861603 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.861477 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" event={"ID":"945fd5ea-a289-4217-a666-b7b3d2d110fd","Type":"ContainerDied","Data":"a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f"} Jun 11 16:34:29.861603 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.861545 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-858c8f8c6c-qq6xs" event={"ID":"945fd5ea-a289-4217-a666-b7b3d2d110fd","Type":"ContainerDied","Data":"7af7c867b0f62c925aa7158396080061882dd878ccaf9f3a21a961810f06c71c"} Jun 11 16:34:29.861603 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.861569 2580 scope.go:117] "RemoveContainer" containerID="a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f" Jun 11 16:34:29.870405 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.870390 2580 scope.go:117] "RemoveContainer" containerID="a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f" Jun 11 16:34:29.870661 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:34:29.870643 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f\": container with ID starting with a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f not found: ID does not exist" containerID="a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f" Jun 11 16:34:29.870715 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.870670 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f"} err="failed to get container status \"a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f\": rpc error: code = NotFound desc = could not find container \"a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f\": container with ID starting with a24149abd24534bfdacf0a89dff8c84121962190687eb73fc5af85920b18891f not found: ID does not exist" Jun 11 16:34:29.898812 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.898755 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-858c8f8c6c-qq6xs"] Jun 11 16:34:29.907337 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:29.907313 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-858c8f8c6c-qq6xs"] Jun 11 16:34:30.359376 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:30.359336 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="945fd5ea-a289-4217-a666-b7b3d2d110fd" path="/var/lib/kubelet/pods/945fd5ea-a289-4217-a666-b7b3d2d110fd/volumes" Jun 11 16:34:49.851444 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.851354 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2fjzq"] Jun 11 16:34:49.852055 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.851739 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="945fd5ea-a289-4217-a666-b7b3d2d110fd" containerName="manager" Jun 11 16:34:49.852055 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.851758 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="945fd5ea-a289-4217-a666-b7b3d2d110fd" containerName="manager" Jun 11 16:34:49.852055 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.851858 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="945fd5ea-a289-4217-a666-b7b3d2d110fd" containerName="manager" Jun 11 16:34:49.856604 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.856582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-2fjzq" Jun 11 16:34:49.859383 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.859358 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 16:34:49.859511 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.859361 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gd78p\"" Jun 11 16:34:49.879695 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.879671 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2fjzq"] Jun 11 16:34:49.898683 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.898653 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7gnrb"] Jun 11 16:34:49.901759 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.901740 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-7gnrb" Jun 11 16:34:49.913424 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.913401 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7gnrb"] Jun 11 16:34:49.985875 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.985846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj5hk\" (UniqueName: \"kubernetes.io/projected/c2fb0ed4-3a37-4807-b14b-ce18da57fdc7-kube-api-access-nj5hk\") pod \"payload-pre-processing-579785bc64-7gnrb\" (UID: \"c2fb0ed4-3a37-4807-b14b-ce18da57fdc7\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7gnrb" Jun 11 16:34:49.985991 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:49.985901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lldvj\" (UniqueName: \"kubernetes.io/projected/e101b922-6aab-4f17-8e69-9c954afdb145-kube-api-access-lldvj\") pod \"payload-processing-699b6cd6c-2fjzq\" (UID: \"e101b922-6aab-4f17-8e69-9c954afdb145\") " pod="openshift-ingress/payload-processing-699b6cd6c-2fjzq" Jun 11 16:34:50.087064 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:50.087028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj5hk\" (UniqueName: \"kubernetes.io/projected/c2fb0ed4-3a37-4807-b14b-ce18da57fdc7-kube-api-access-nj5hk\") pod \"payload-pre-processing-579785bc64-7gnrb\" (UID: \"c2fb0ed4-3a37-4807-b14b-ce18da57fdc7\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7gnrb" Jun 11 16:34:50.087227 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:50.087087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lldvj\" (UniqueName: \"kubernetes.io/projected/e101b922-6aab-4f17-8e69-9c954afdb145-kube-api-access-lldvj\") pod \"payload-processing-699b6cd6c-2fjzq\" (UID: \"e101b922-6aab-4f17-8e69-9c954afdb145\") " pod="openshift-ingress/payload-processing-699b6cd6c-2fjzq" Jun 11 16:34:50.097024 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:50.096993 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj5hk\" (UniqueName: \"kubernetes.io/projected/c2fb0ed4-3a37-4807-b14b-ce18da57fdc7-kube-api-access-nj5hk\") pod \"payload-pre-processing-579785bc64-7gnrb\" (UID: \"c2fb0ed4-3a37-4807-b14b-ce18da57fdc7\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7gnrb" Jun 11 16:34:50.097155 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:50.097136 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lldvj\" (UniqueName: \"kubernetes.io/projected/e101b922-6aab-4f17-8e69-9c954afdb145-kube-api-access-lldvj\") pod \"payload-processing-699b6cd6c-2fjzq\" (UID: \"e101b922-6aab-4f17-8e69-9c954afdb145\") " pod="openshift-ingress/payload-processing-699b6cd6c-2fjzq" Jun 11 16:34:50.193200 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:50.193171 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-2fjzq" Jun 11 16:34:50.211584 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:50.211557 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-7gnrb" Jun 11 16:34:50.345802 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:50.345775 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2fjzq"] Jun 11 16:34:50.348538 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:34:50.348482 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode101b922_6aab_4f17_8e69_9c954afdb145.slice/crio-17996df2b693f47173fea88f9042120b6ab6bd4e8e2fb7b6c41564cbae5747fc WatchSource:0}: Error finding container 17996df2b693f47173fea88f9042120b6ab6bd4e8e2fb7b6c41564cbae5747fc: Status 404 returned error can't find the container with id 17996df2b693f47173fea88f9042120b6ab6bd4e8e2fb7b6c41564cbae5747fc Jun 11 16:34:50.378015 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:50.377955 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7gnrb"] Jun 11 16:34:50.380172 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:34:50.380148 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2fb0ed4_3a37_4807_b14b_ce18da57fdc7.slice/crio-ef55df86bb8906a6b233222ad3188770e723b92573ebe00b64d9fd070d8e581b WatchSource:0}: Error finding container ef55df86bb8906a6b233222ad3188770e723b92573ebe00b64d9fd070d8e581b: Status 404 returned error can't find the container with id ef55df86bb8906a6b233222ad3188770e723b92573ebe00b64d9fd070d8e581b Jun 11 16:34:50.959648 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:50.959608 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-2fjzq" event={"ID":"e101b922-6aab-4f17-8e69-9c954afdb145","Type":"ContainerStarted","Data":"17996df2b693f47173fea88f9042120b6ab6bd4e8e2fb7b6c41564cbae5747fc"} Jun 11 16:34:50.960968 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:50.960933 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-7gnrb" event={"ID":"c2fb0ed4-3a37-4807-b14b-ce18da57fdc7","Type":"ContainerStarted","Data":"ef55df86bb8906a6b233222ad3188770e723b92573ebe00b64d9fd070d8e581b"} Jun 11 16:34:52.974393 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:52.974355 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-2fjzq" event={"ID":"e101b922-6aab-4f17-8e69-9c954afdb145","Type":"ContainerStarted","Data":"3e04c3adb41603fa1a29a52fc368fd8ea17307662e20fbba56b6efbbff35a462"} Jun 11 16:34:52.975234 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:52.975204 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-2fjzq" Jun 11 16:34:52.976267 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:52.976243 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-7gnrb" event={"ID":"c2fb0ed4-3a37-4807-b14b-ce18da57fdc7","Type":"ContainerStarted","Data":"165e87dec08b5b978e029c669dd5183e0c1c7e5ef13dda03c4b799df60489468"} Jun 11 16:34:52.976394 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:52.976378 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-7gnrb" Jun 11 16:34:52.995625 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:52.995578 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-2fjzq" podStartSLOduration=1.587248877 podStartE2EDuration="3.995563182s" totalImagesPullingTime="2.408314305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:52.99522129 +0000 UTC m=+895.085531237" watchObservedRunningTime="2026-06-11 16:34:52.995563182 +0000 UTC m=+895.085873112" Jun 11 16:34:53.012097 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:53.012010 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-7gnrb" podStartSLOduration=1.62925736 podStartE2EDuration="4.011995383s" totalImagesPullingTime="2.382738023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:53.011256852 +0000 UTC m=+895.101566807" watchObservedRunningTime="2026-06-11 16:34:53.011995383 +0000 UTC m=+895.102305312" Jun 11 16:34:58.345018 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:58.344988 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:34:58.345430 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:34:58.345350 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:35:03.984007 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:35:03.983974 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-2fjzq" Jun 11 16:35:03.984418 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:35:03.984048 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-7gnrb" Jun 11 16:37:02.836821 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:02.836782 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:37:02.837428 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:02.837022 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" containerID="cri-o://00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3" gracePeriod=30 Jun 11 16:37:04.489390 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.489365 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:04.534393 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.534326 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-np77n\" (UniqueName: \"kubernetes.io/projected/be0aac7f-33d1-4796-9afb-378c5a50fb10-kube-api-access-np77n\") pod \"be0aac7f-33d1-4796-9afb-378c5a50fb10\" (UID: \"be0aac7f-33d1-4796-9afb-378c5a50fb10\") " Jun 11 16:37:04.536783 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.536755 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0aac7f-33d1-4796-9afb-378c5a50fb10-kube-api-access-np77n" (OuterVolumeSpecName: "kube-api-access-np77n") pod "be0aac7f-33d1-4796-9afb-378c5a50fb10" (UID: "be0aac7f-33d1-4796-9afb-378c5a50fb10"). InnerVolumeSpecName "kube-api-access-np77n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:37:04.575862 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.575837 2580 generic.go:356] "Generic (PLEG): container finished" podID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerID="00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3" exitCode=143 Jun 11 16:37:04.575976 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.575879 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:04.575976 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.575920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"be0aac7f-33d1-4796-9afb-378c5a50fb10","Type":"ContainerDied","Data":"00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3"} Jun 11 16:37:04.575976 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.575972 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"be0aac7f-33d1-4796-9afb-378c5a50fb10","Type":"ContainerDied","Data":"91c9647ecd39761e6c5bb17800f4af26491fbb162ec84cd5c4b3824914e6f07b"} Jun 11 16:37:04.576078 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.575998 2580 scope.go:117] "RemoveContainer" containerID="00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3" Jun 11 16:37:04.585185 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.585168 2580 scope.go:117] "RemoveContainer" containerID="00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3" Jun 11 16:37:04.585440 ip-10-0-131-101 kubenswrapper[2580]: E0611 16:37:04.585421 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3\": container with ID starting with 00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3 not found: ID does not exist" containerID="00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3" Jun 11 16:37:04.585511 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.585450 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3"} err="failed to get container status \"00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3\": rpc error: code = NotFound desc = could not find container \"00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3\": container with ID starting with 00c9fb4e573cad24795607901c98006289dd655a77ef2af9e1c87212749502c3 not found: ID does not exist" Jun 11 16:37:04.597548 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.597527 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:37:04.603926 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.603907 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:37:04.631355 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.631335 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:37:04.631690 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.631676 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" Jun 11 16:37:04.631750 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.631691 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" Jun 11 16:37:04.631831 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.631750 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" containerName="keycloak" Jun 11 16:37:04.635872 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.635854 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-np77n\" (UniqueName: \"kubernetes.io/projected/be0aac7f-33d1-4796-9afb-378c5a50fb10-kube-api-access-np77n\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 16:37:04.636079 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.636065 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:04.638885 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.638853 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 16:37:04.638885 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.638873 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 16:37:04.639044 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.638885 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 16:37:04.639044 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.638853 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xmslv\"" Jun 11 16:37:04.639044 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.638946 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 16:37:04.645132 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.645113 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:37:04.737021 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.736991 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7b599558-c812-4936-88b9-470345e46642-test-realms\") pod \"maas-keycloak-0\" (UID: \"7b599558-c812-4936-88b9-470345e46642\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:04.737021 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.737023 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgmn\" (UniqueName: \"kubernetes.io/projected/7b599558-c812-4936-88b9-470345e46642-kube-api-access-zrgmn\") pod \"maas-keycloak-0\" (UID: \"7b599558-c812-4936-88b9-470345e46642\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:04.838279 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.838206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7b599558-c812-4936-88b9-470345e46642-test-realms\") pod \"maas-keycloak-0\" (UID: \"7b599558-c812-4936-88b9-470345e46642\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:04.838279 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.838241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgmn\" (UniqueName: \"kubernetes.io/projected/7b599558-c812-4936-88b9-470345e46642-kube-api-access-zrgmn\") pod \"maas-keycloak-0\" (UID: \"7b599558-c812-4936-88b9-470345e46642\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:04.838956 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.838918 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7b599558-c812-4936-88b9-470345e46642-test-realms\") pod \"maas-keycloak-0\" (UID: \"7b599558-c812-4936-88b9-470345e46642\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:04.850724 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.850702 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgmn\" (UniqueName: \"kubernetes.io/projected/7b599558-c812-4936-88b9-470345e46642-kube-api-access-zrgmn\") pod \"maas-keycloak-0\" (UID: \"7b599558-c812-4936-88b9-470345e46642\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:04.946223 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:04.946201 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:05.086842 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:05.086818 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:37:05.089049 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:37:05.088976 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b599558_c812_4936_88b9_470345e46642.slice/crio-83dad85d4d56e4a1eda3bed905235cd70ddce0d8704db1a8e2a60588aee6d980 WatchSource:0}: Error finding container 83dad85d4d56e4a1eda3bed905235cd70ddce0d8704db1a8e2a60588aee6d980: Status 404 returned error can't find the container with id 83dad85d4d56e4a1eda3bed905235cd70ddce0d8704db1a8e2a60588aee6d980 Jun 11 16:37:05.583180 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:05.583150 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7b599558-c812-4936-88b9-470345e46642","Type":"ContainerStarted","Data":"162dfa3e44b4cabd27b23fa42ec8416e2850fafe71e1fdc5e0520961f9d3246c"} Jun 11 16:37:05.583684 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:05.583199 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7b599558-c812-4936-88b9-470345e46642","Type":"ContainerStarted","Data":"83dad85d4d56e4a1eda3bed905235cd70ddce0d8704db1a8e2a60588aee6d980"} Jun 11 16:37:05.605705 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:05.605615 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.247457629 podStartE2EDuration="1.605599953s" totalImagesPullingTime="358.142324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:37:05.60452258 +0000 UTC m=+1027.694832510" watchObservedRunningTime="2026-06-11 16:37:05.605599953 +0000 UTC m=+1027.695909881" Jun 11 16:37:05.946927 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:05.946847 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:05.948338 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:05.948298 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:06.362440 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:06.362352 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be0aac7f-33d1-4796-9afb-378c5a50fb10" path="/var/lib/kubelet/pods/be0aac7f-33d1-4796-9afb-378c5a50fb10/volumes" Jun 11 16:37:06.947692 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:06.947643 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:07.947343 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:07.947294 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:08.947476 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:08.947414 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:09.947256 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:09.947198 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:10.947530 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:10.947465 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:11.947478 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:11.947428 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:12.947221 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:12.947173 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:13.947219 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:13.947173 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:14.947286 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:14.947239 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:14.947814 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:14.947562 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:15.947018 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:15.946961 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:16.947595 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:16.947548 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:17.947102 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:17.947057 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 16:37:19.050512 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:19.050437 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:19.068566 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:19.068518 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="7b599558-c812-4936-88b9-470345e46642" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:37:29.056430 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:29.056401 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:37:58.437378 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.437347 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb"] Jun 11 16:37:58.442874 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.442853 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.445684 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.445662 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 16:37:58.445788 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.445684 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 16:37:58.446582 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.446559 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 16:37:58.446582 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.446581 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lhsh5\"" Jun 11 16:37:58.451581 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.451559 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb"] Jun 11 16:37:58.503398 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.503372 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cb6b776-b3f4-4611-b521-090283405276-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.503567 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.503422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlzx2\" (UniqueName: \"kubernetes.io/projected/4cb6b776-b3f4-4611-b521-090283405276-kube-api-access-qlzx2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.503567 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.503511 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.503656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.503584 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.503656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.503622 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.503656 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.503651 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.604213 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.604182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlzx2\" (UniqueName: \"kubernetes.io/projected/4cb6b776-b3f4-4611-b521-090283405276-kube-api-access-qlzx2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.604213 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.604217 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.604436 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.604249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.604436 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.604273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.604436 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.604305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.604436 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.604320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cb6b776-b3f4-4611-b521-090283405276-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.604708 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.604677 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.604708 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.604701 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.604856 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.604727 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.606829 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.606801 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cb6b776-b3f4-4611-b521-090283405276-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.607006 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.606986 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cb6b776-b3f4-4611-b521-090283405276-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.612644 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.612625 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlzx2\" (UniqueName: \"kubernetes.io/projected/4cb6b776-b3f4-4611-b521-090283405276-kube-api-access-qlzx2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-k8ghb\" (UID: \"4cb6b776-b3f4-4611-b521-090283405276\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.753897 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.753873 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:37:58.890679 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:58.890654 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb"] Jun 11 16:37:58.892832 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:37:58.892803 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb6b776_b3f4_4611_b521_090283405276.slice/crio-61c2002a31fc8d0ffa6268f30516b983bb062e8068051adaa61d1e65b8968717 WatchSource:0}: Error finding container 61c2002a31fc8d0ffa6268f30516b983bb062e8068051adaa61d1e65b8968717: Status 404 returned error can't find the container with id 61c2002a31fc8d0ffa6268f30516b983bb062e8068051adaa61d1e65b8968717 Jun 11 16:37:59.862939 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:37:59.862905 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" event={"ID":"4cb6b776-b3f4-4611-b521-090283405276","Type":"ContainerStarted","Data":"61c2002a31fc8d0ffa6268f30516b983bb062e8068051adaa61d1e65b8968717"} Jun 11 16:38:02.880756 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:02.880717 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" event={"ID":"4cb6b776-b3f4-4611-b521-090283405276","Type":"ContainerStarted","Data":"e42c841f98bad576208b3b90791609540cdb03dc55cb6fa2323f204eb54b8df1"} Jun 11 16:38:03.887714 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:03.887676 2580 generic.go:356] "Generic (PLEG): container finished" podID="4cb6b776-b3f4-4611-b521-090283405276" containerID="e42c841f98bad576208b3b90791609540cdb03dc55cb6fa2323f204eb54b8df1" exitCode=0 Jun 11 16:38:03.888266 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:03.887758 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" event={"ID":"4cb6b776-b3f4-4611-b521-090283405276","Type":"ContainerDied","Data":"e42c841f98bad576208b3b90791609540cdb03dc55cb6fa2323f204eb54b8df1"} Jun 11 16:38:05.901788 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:05.901753 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" event={"ID":"4cb6b776-b3f4-4611-b521-090283405276","Type":"ContainerStarted","Data":"0472ed58954ede05d3fad12b4d38e58628731b85f310b04f1d5df0d00cdf1e85"} Jun 11 16:38:05.929625 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:05.929578 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" podStartSLOduration=2.042288787 podStartE2EDuration="7.929561935s" totalImagesPullingTime="4.555313195s" totalInitContainerRuntime="1.331959953s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:37:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:38:05.927528815 +0000 UTC m=+1088.017838744" watchObservedRunningTime="2026-06-11 16:38:05.929561935 +0000 UTC m=+1088.019871865" Jun 11 16:38:08.754377 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:08.754339 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:38:08.754821 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:08.754455 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:38:08.767023 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:08.766996 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:38:08.931553 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:08.931529 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-k8ghb" Jun 11 16:38:14.075197 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.075167 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9"] Jun 11 16:38:14.079236 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.079213 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.084171 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.084147 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 16:38:14.098453 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.098416 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9"] Jun 11 16:38:14.135691 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.135658 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.135837 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.135712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.135837 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.135770 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.135837 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.135804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.135979 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.135853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8vdk\" (UniqueName: \"kubernetes.io/projected/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-kube-api-access-q8vdk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.135979 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.135897 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.237170 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.237130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.237338 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.237180 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.237338 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.237211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.237338 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.237259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8vdk\" (UniqueName: \"kubernetes.io/projected/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-kube-api-access-q8vdk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.237338 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.237286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.237338 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.237326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.237619 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.237522 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.237686 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.237661 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.237759 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.237739 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.239549 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.239530 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.246705 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.246681 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.248190 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.248168 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8vdk\" (UniqueName: \"kubernetes.io/projected/7b714303-2c6a-4a5e-b97a-e809f8d33b8d-kube-api-access-q8vdk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9\" (UID: \"7b714303-2c6a-4a5e-b97a-e809f8d33b8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.390317 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.390245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:14.523945 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.523890 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9"] Jun 11 16:38:14.526604 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:38:14.526576 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b714303_2c6a_4a5e_b97a_e809f8d33b8d.slice/crio-935a7defb39b4dff233a425087e9c28402109ccfdb72273f55e6b490aacef722 WatchSource:0}: Error finding container 935a7defb39b4dff233a425087e9c28402109ccfdb72273f55e6b490aacef722: Status 404 returned error can't find the container with id 935a7defb39b4dff233a425087e9c28402109ccfdb72273f55e6b490aacef722 Jun 11 16:38:14.950374 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.950329 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" event={"ID":"7b714303-2c6a-4a5e-b97a-e809f8d33b8d","Type":"ContainerStarted","Data":"01cbd22ea9ee6da3c7684a88b3ffacf9e96a7bf6571ec0bf51c9c5a003a3486c"} Jun 11 16:38:14.950567 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:14.950393 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" event={"ID":"7b714303-2c6a-4a5e-b97a-e809f8d33b8d","Type":"ContainerStarted","Data":"935a7defb39b4dff233a425087e9c28402109ccfdb72273f55e6b490aacef722"} Jun 11 16:38:22.988197 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:22.988162 2580 generic.go:356] "Generic (PLEG): container finished" podID="7b714303-2c6a-4a5e-b97a-e809f8d33b8d" containerID="01cbd22ea9ee6da3c7684a88b3ffacf9e96a7bf6571ec0bf51c9c5a003a3486c" exitCode=0 Jun 11 16:38:22.988609 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:22.988236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" event={"ID":"7b714303-2c6a-4a5e-b97a-e809f8d33b8d","Type":"ContainerDied","Data":"01cbd22ea9ee6da3c7684a88b3ffacf9e96a7bf6571ec0bf51c9c5a003a3486c"} Jun 11 16:38:23.995111 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:23.995073 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" event={"ID":"7b714303-2c6a-4a5e-b97a-e809f8d33b8d","Type":"ContainerStarted","Data":"65b162a792a4a3af683bbcd3f69b306dee954f9cf988320f04e5c5d09bd4cf30"} Jun 11 16:38:24.020860 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:24.020808 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" podStartSLOduration=2.028766987 podStartE2EDuration="10.020792705s" totalImagesPullingTime="199.485621ms" totalInitContainerRuntime="7.792540097s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:38:24.019269837 +0000 UTC m=+1106.109579765" watchObservedRunningTime="2026-06-11 16:38:24.020792705 +0000 UTC m=+1106.111102663" Jun 11 16:38:24.390900 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:24.390817 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:24.390900 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:24.390878 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:24.403449 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:24.403429 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:38:25.011736 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:38:25.011708 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9" Jun 11 16:39:58.381999 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:39:58.381968 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:39:58.382605 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:39:58.382588 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:40:49.200433 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.200359 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68dfd7c487-8l8r7"] Jun 11 16:40:49.203729 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.203707 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68dfd7c487-8l8r7" Jun 11 16:40:49.207672 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.207641 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zvcz9\"" Jun 11 16:40:49.207801 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.207677 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 16:40:49.207801 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.207735 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 16:40:49.213902 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.213884 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68dfd7c487-8l8r7"] Jun 11 16:40:49.293674 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.293648 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f28nb\" (UniqueName: \"kubernetes.io/projected/8b647f4e-053a-48f3-a9bd-3d09462d9c26-kube-api-access-f28nb\") pod \"maas-controller-68dfd7c487-8l8r7\" (UID: \"8b647f4e-053a-48f3-a9bd-3d09462d9c26\") " pod="opendatahub/maas-controller-68dfd7c487-8l8r7" Jun 11 16:40:49.293783 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.293685 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b647f4e-053a-48f3-a9bd-3d09462d9c26-webhook-cert\") pod \"maas-controller-68dfd7c487-8l8r7\" (UID: \"8b647f4e-053a-48f3-a9bd-3d09462d9c26\") " pod="opendatahub/maas-controller-68dfd7c487-8l8r7" Jun 11 16:40:49.394086 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.394032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f28nb\" (UniqueName: \"kubernetes.io/projected/8b647f4e-053a-48f3-a9bd-3d09462d9c26-kube-api-access-f28nb\") pod \"maas-controller-68dfd7c487-8l8r7\" (UID: \"8b647f4e-053a-48f3-a9bd-3d09462d9c26\") " pod="opendatahub/maas-controller-68dfd7c487-8l8r7" Jun 11 16:40:49.394086 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.394075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b647f4e-053a-48f3-a9bd-3d09462d9c26-webhook-cert\") pod \"maas-controller-68dfd7c487-8l8r7\" (UID: \"8b647f4e-053a-48f3-a9bd-3d09462d9c26\") " pod="opendatahub/maas-controller-68dfd7c487-8l8r7" Jun 11 16:40:49.396646 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.396625 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b647f4e-053a-48f3-a9bd-3d09462d9c26-webhook-cert\") pod \"maas-controller-68dfd7c487-8l8r7\" (UID: \"8b647f4e-053a-48f3-a9bd-3d09462d9c26\") " pod="opendatahub/maas-controller-68dfd7c487-8l8r7" Jun 11 16:40:49.405198 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.405175 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f28nb\" (UniqueName: \"kubernetes.io/projected/8b647f4e-053a-48f3-a9bd-3d09462d9c26-kube-api-access-f28nb\") pod \"maas-controller-68dfd7c487-8l8r7\" (UID: \"8b647f4e-053a-48f3-a9bd-3d09462d9c26\") " pod="opendatahub/maas-controller-68dfd7c487-8l8r7" Jun 11 16:40:49.514681 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.514616 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68dfd7c487-8l8r7" Jun 11 16:40:49.658880 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.658856 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68dfd7c487-8l8r7"] Jun 11 16:40:49.661342 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:40:49.661317 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b647f4e_053a_48f3_a9bd_3d09462d9c26.slice/crio-f4198c82d766b1c231eaf058481a911ddb2d1e51cde668a21ab8192b6c598e02 WatchSource:0}: Error finding container f4198c82d766b1c231eaf058481a911ddb2d1e51cde668a21ab8192b6c598e02: Status 404 returned error can't find the container with id f4198c82d766b1c231eaf058481a911ddb2d1e51cde668a21ab8192b6c598e02 Jun 11 16:40:49.662747 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.662723 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:40:49.679771 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:49.679745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68dfd7c487-8l8r7" event={"ID":"8b647f4e-053a-48f3-a9bd-3d09462d9c26","Type":"ContainerStarted","Data":"f4198c82d766b1c231eaf058481a911ddb2d1e51cde668a21ab8192b6c598e02"} Jun 11 16:40:50.686037 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:50.685993 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68dfd7c487-8l8r7" event={"ID":"8b647f4e-053a-48f3-a9bd-3d09462d9c26","Type":"ContainerStarted","Data":"39088f51bb925cfc4ed57da032274d16e4ded85270c7b045f535e04723cb4d42"} Jun 11 16:40:50.686409 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:50.686077 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68dfd7c487-8l8r7" Jun 11 16:40:50.709349 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:40:50.709298 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68dfd7c487-8l8r7" podStartSLOduration=1.3656898800000001 podStartE2EDuration="1.709285209s" totalImagesPullingTime="343.595329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:50.708834041 +0000 UTC m=+1252.799143980" watchObservedRunningTime="2026-06-11 16:40:50.709285209 +0000 UTC m=+1252.799595137" Jun 11 16:41:01.696282 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:41:01.696251 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68dfd7c487-8l8r7" Jun 11 16:44:58.408322 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:44:58.408289 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:44:58.410905 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:44:58.410882 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:45:00.169979 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:00.169949 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686605-6599k"] Jun 11 16:45:00.173223 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:00.173200 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686605-6599k" Jun 11 16:45:00.177388 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:00.177364 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hpl9c\"" Jun 11 16:45:00.208245 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:00.208213 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686605-6599k"] Jun 11 16:45:00.314965 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:00.314922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg59m\" (UniqueName: \"kubernetes.io/projected/90fc1043-0c77-417d-a668-ae5c54fc5d02-kube-api-access-wg59m\") pod \"maas-api-key-cleanup-29686605-6599k\" (UID: \"90fc1043-0c77-417d-a668-ae5c54fc5d02\") " pod="opendatahub/maas-api-key-cleanup-29686605-6599k" Jun 11 16:45:00.415941 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:00.415902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg59m\" (UniqueName: \"kubernetes.io/projected/90fc1043-0c77-417d-a668-ae5c54fc5d02-kube-api-access-wg59m\") pod \"maas-api-key-cleanup-29686605-6599k\" (UID: \"90fc1043-0c77-417d-a668-ae5c54fc5d02\") " pod="opendatahub/maas-api-key-cleanup-29686605-6599k" Jun 11 16:45:00.425361 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:00.425291 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg59m\" (UniqueName: \"kubernetes.io/projected/90fc1043-0c77-417d-a668-ae5c54fc5d02-kube-api-access-wg59m\") pod \"maas-api-key-cleanup-29686605-6599k\" (UID: \"90fc1043-0c77-417d-a668-ae5c54fc5d02\") " pod="opendatahub/maas-api-key-cleanup-29686605-6599k" Jun 11 16:45:00.483024 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:00.482986 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686605-6599k" Jun 11 16:45:00.615806 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:00.615779 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686605-6599k"] Jun 11 16:45:00.617854 ip-10-0-131-101 kubenswrapper[2580]: W0611 16:45:00.617827 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90fc1043_0c77_417d_a668_ae5c54fc5d02.slice/crio-6263030cda13c625087d25a56033a3051d2e148de0fcac53a3c64bb39ca15593 WatchSource:0}: Error finding container 6263030cda13c625087d25a56033a3051d2e148de0fcac53a3c64bb39ca15593: Status 404 returned error can't find the container with id 6263030cda13c625087d25a56033a3051d2e148de0fcac53a3c64bb39ca15593 Jun 11 16:45:00.871685 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:00.871650 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686605-6599k" event={"ID":"90fc1043-0c77-417d-a668-ae5c54fc5d02","Type":"ContainerStarted","Data":"6263030cda13c625087d25a56033a3051d2e148de0fcac53a3c64bb39ca15593"} Jun 11 16:45:03.889774 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:03.889730 2580 generic.go:356] "Generic (PLEG): container finished" podID="90fc1043-0c77-417d-a668-ae5c54fc5d02" containerID="7c7f3a2052508a28b2e4ca2f1746e3952123a1731e1224dcb36f796538bf7be4" exitCode=0 Jun 11 16:45:03.890151 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:03.889774 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686605-6599k" event={"ID":"90fc1043-0c77-417d-a668-ae5c54fc5d02","Type":"ContainerDied","Data":"7c7f3a2052508a28b2e4ca2f1746e3952123a1731e1224dcb36f796538bf7be4"} Jun 11 16:45:05.039890 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:05.039865 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686605-6599k" Jun 11 16:45:05.162805 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:05.162692 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg59m\" (UniqueName: \"kubernetes.io/projected/90fc1043-0c77-417d-a668-ae5c54fc5d02-kube-api-access-wg59m\") pod \"90fc1043-0c77-417d-a668-ae5c54fc5d02\" (UID: \"90fc1043-0c77-417d-a668-ae5c54fc5d02\") " Jun 11 16:45:05.164812 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:05.164780 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90fc1043-0c77-417d-a668-ae5c54fc5d02-kube-api-access-wg59m" (OuterVolumeSpecName: "kube-api-access-wg59m") pod "90fc1043-0c77-417d-a668-ae5c54fc5d02" (UID: "90fc1043-0c77-417d-a668-ae5c54fc5d02"). InnerVolumeSpecName "kube-api-access-wg59m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:45:05.263683 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:05.263649 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg59m\" (UniqueName: \"kubernetes.io/projected/90fc1043-0c77-417d-a668-ae5c54fc5d02-kube-api-access-wg59m\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 16:45:05.903717 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:05.903666 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686605-6599k" event={"ID":"90fc1043-0c77-417d-a668-ae5c54fc5d02","Type":"ContainerDied","Data":"6263030cda13c625087d25a56033a3051d2e148de0fcac53a3c64bb39ca15593"} Jun 11 16:45:05.903717 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:05.903707 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686605-6599k" Jun 11 16:45:05.903944 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:45:05.903729 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6263030cda13c625087d25a56033a3051d2e148de0fcac53a3c64bb39ca15593" Jun 11 16:49:58.439920 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:49:58.439895 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:49:58.443757 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:49:58.443736 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:54:58.466832 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:54:58.466802 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:54:58.471943 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:54:58.471926 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:59:58.496902 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:59:58.496779 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 16:59:58.508288 ip-10-0-131-101 kubenswrapper[2580]: I0611 16:59:58.508269 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gdbj7_051b5568-c52b-4904-9e44-ff33691fd7ac/ovn-acl-logging/0.log" Jun 11 17:00:00.247821 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.247780 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-cpk6r"] Jun 11 17:00:00.248359 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.248339 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90fc1043-0c77-417d-a668-ae5c54fc5d02" containerName="cleanup" Jun 11 17:00:00.248438 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.248363 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="90fc1043-0c77-417d-a668-ae5c54fc5d02" containerName="cleanup" Jun 11 17:00:00.248541 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.248526 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="90fc1043-0c77-417d-a668-ae5c54fc5d02" containerName="cleanup" Jun 11 17:00:00.251208 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.251187 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-cpk6r" Jun 11 17:00:00.258137 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.258117 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hpl9c\"" Jun 11 17:00:00.271192 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.271163 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-cpk6r"] Jun 11 17:00:00.339346 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.339312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxx7w\" (UniqueName: \"kubernetes.io/projected/c59eea17-78ef-4550-b5ed-fe0e3f61b47c-kube-api-access-zxx7w\") pod \"maas-api-key-cleanup-29686620-cpk6r\" (UID: \"c59eea17-78ef-4550-b5ed-fe0e3f61b47c\") " pod="opendatahub/maas-api-key-cleanup-29686620-cpk6r" Jun 11 17:00:00.440375 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.440341 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxx7w\" (UniqueName: \"kubernetes.io/projected/c59eea17-78ef-4550-b5ed-fe0e3f61b47c-kube-api-access-zxx7w\") pod \"maas-api-key-cleanup-29686620-cpk6r\" (UID: \"c59eea17-78ef-4550-b5ed-fe0e3f61b47c\") " pod="opendatahub/maas-api-key-cleanup-29686620-cpk6r" Jun 11 17:00:00.452479 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.452452 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxx7w\" (UniqueName: \"kubernetes.io/projected/c59eea17-78ef-4550-b5ed-fe0e3f61b47c-kube-api-access-zxx7w\") pod \"maas-api-key-cleanup-29686620-cpk6r\" (UID: \"c59eea17-78ef-4550-b5ed-fe0e3f61b47c\") " pod="opendatahub/maas-api-key-cleanup-29686620-cpk6r" Jun 11 17:00:00.561474 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.561394 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-cpk6r" Jun 11 17:00:00.918063 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:00.918032 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686620-cpk6r"] Jun 11 17:00:00.920619 ip-10-0-131-101 kubenswrapper[2580]: W0611 17:00:00.920579 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59eea17_78ef_4550_b5ed_fe0e3f61b47c.slice/crio-c0cd1fcbeac8118a270b2b05d39089b697ab8242af5064e6aac3f89c4c677539 WatchSource:0}: Error finding container c0cd1fcbeac8118a270b2b05d39089b697ab8242af5064e6aac3f89c4c677539: Status 404 returned error can't find the container with id c0cd1fcbeac8118a270b2b05d39089b697ab8242af5064e6aac3f89c4c677539 Jun 11 17:00:01.219998 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:01.219964 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-cpk6r" event={"ID":"c59eea17-78ef-4550-b5ed-fe0e3f61b47c","Type":"ContainerStarted","Data":"0eacbc0873c816521b387a6fc56f5e4ad9e86ee2754c807aec4059ea12bbbc59"} Jun 11 17:00:01.220171 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:01.220021 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-cpk6r" event={"ID":"c59eea17-78ef-4550-b5ed-fe0e3f61b47c","Type":"ContainerStarted","Data":"c0cd1fcbeac8118a270b2b05d39089b697ab8242af5064e6aac3f89c4c677539"} Jun 11 17:00:02.225678 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:02.225631 2580 generic.go:356] "Generic (PLEG): container finished" podID="c59eea17-78ef-4550-b5ed-fe0e3f61b47c" containerID="0eacbc0873c816521b387a6fc56f5e4ad9e86ee2754c807aec4059ea12bbbc59" exitCode=0 Jun 11 17:00:02.226054 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:02.225733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-cpk6r" event={"ID":"c59eea17-78ef-4550-b5ed-fe0e3f61b47c","Type":"ContainerDied","Data":"0eacbc0873c816521b387a6fc56f5e4ad9e86ee2754c807aec4059ea12bbbc59"} Jun 11 17:00:03.355207 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:03.355179 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-cpk6r" Jun 11 17:00:03.469675 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:03.469643 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxx7w\" (UniqueName: \"kubernetes.io/projected/c59eea17-78ef-4550-b5ed-fe0e3f61b47c-kube-api-access-zxx7w\") pod \"c59eea17-78ef-4550-b5ed-fe0e3f61b47c\" (UID: \"c59eea17-78ef-4550-b5ed-fe0e3f61b47c\") " Jun 11 17:00:03.471866 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:03.471831 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c59eea17-78ef-4550-b5ed-fe0e3f61b47c-kube-api-access-zxx7w" (OuterVolumeSpecName: "kube-api-access-zxx7w") pod "c59eea17-78ef-4550-b5ed-fe0e3f61b47c" (UID: "c59eea17-78ef-4550-b5ed-fe0e3f61b47c"). InnerVolumeSpecName "kube-api-access-zxx7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:00:03.570459 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:03.570370 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxx7w\" (UniqueName: \"kubernetes.io/projected/c59eea17-78ef-4550-b5ed-fe0e3f61b47c-kube-api-access-zxx7w\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:00:04.236561 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:04.236519 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686620-cpk6r" event={"ID":"c59eea17-78ef-4550-b5ed-fe0e3f61b47c","Type":"ContainerDied","Data":"c0cd1fcbeac8118a270b2b05d39089b697ab8242af5064e6aac3f89c4c677539"} Jun 11 17:00:04.236822 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:04.236581 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0cd1fcbeac8118a270b2b05d39089b697ab8242af5064e6aac3f89c4c677539" Jun 11 17:00:04.236822 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:00:04.236532 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686620-cpk6r" Jun 11 17:01:34.750437 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.750121 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk"] Jun 11 17:01:34.750798 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.750532 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c59eea17-78ef-4550-b5ed-fe0e3f61b47c" containerName="cleanup" Jun 11 17:01:34.750798 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.750545 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c59eea17-78ef-4550-b5ed-fe0e3f61b47c" containerName="cleanup" Jun 11 17:01:34.750798 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.750633 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c59eea17-78ef-4550-b5ed-fe0e3f61b47c" containerName="cleanup" Jun 11 17:01:34.753719 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.753700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.756811 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.756787 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-af43c8a2-openshift-default-dockercfg-ccbtr\"" Jun 11 17:01:34.780809 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.780784 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk"] Jun 11 17:01:34.807320 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.807295 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-socket\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.807429 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.807352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istiod-ca-cert\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.807504 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.807428 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-envoy\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.807504 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.807462 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-podinfo\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.807606 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.807513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-certs\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.807606 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.807564 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-token\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.807692 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.807608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwkfg\" (UniqueName: \"kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-kube-api-access-jwkfg\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.807692 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.807636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-data\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.807793 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.807715 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-credential-socket\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.908741 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.908687 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-token\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.908917 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.908760 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwkfg\" (UniqueName: \"kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-kube-api-access-jwkfg\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.908917 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.908790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-data\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.908917 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.908831 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-credential-socket\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.908917 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.908866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-socket\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.909156 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.908923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istiod-ca-cert\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.909156 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.908958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-envoy\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.909156 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.908995 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-podinfo\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.909156 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.909027 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-certs\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.909365 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.909254 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-data\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.909365 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.909321 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-socket\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.909959 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.909652 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-certs\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.910097 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.910028 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istiod-ca-cert\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.910097 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.910060 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-credential-socket\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.911932 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.911903 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-envoy\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.912477 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.912454 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-podinfo\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.921577 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.921553 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwkfg\" (UniqueName: \"kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-kube-api-access-jwkfg\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:34.925813 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:34.925786 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-token\") pod \"e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:35.064908 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:35.064829 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:35.239426 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:35.239401 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk"] Jun 11 17:01:35.241062 ip-10-0-131-101 kubenswrapper[2580]: W0611 17:01:35.241026 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1072b05_f8d9_426e_97d3_29ee92eb8ac8.slice/crio-9315e3e0c1c33e8eeafab0591e657fe90175daefa2c07a8e200ae9ef6b6a6194 WatchSource:0}: Error finding container 9315e3e0c1c33e8eeafab0591e657fe90175daefa2c07a8e200ae9ef6b6a6194: Status 404 returned error can't find the container with id 9315e3e0c1c33e8eeafab0591e657fe90175daefa2c07a8e200ae9ef6b6a6194 Jun 11 17:01:35.242993 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:35.242975 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:01:35.673149 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:35.673109 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" event={"ID":"b1072b05-f8d9-426e-97d3-29ee92eb8ac8","Type":"ContainerStarted","Data":"9315e3e0c1c33e8eeafab0591e657fe90175daefa2c07a8e200ae9ef6b6a6194"} Jun 11 17:01:38.820688 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:38.820656 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 11 17:01:38.820908 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:38.820724 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 11 17:01:38.820908 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:38.820751 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 11 17:01:39.696924 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:39.696891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" event={"ID":"b1072b05-f8d9-426e-97d3-29ee92eb8ac8","Type":"ContainerStarted","Data":"7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256"} Jun 11 17:01:39.726427 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:39.726378 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" podStartSLOduration=2.149126593 podStartE2EDuration="5.72636483s" totalImagesPullingTime="3.577238237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:01:39.724705223 +0000 UTC m=+2501.815015152" watchObservedRunningTime="2026-06-11 17:01:39.72636483 +0000 UTC m=+2501.816674759" Jun 11 17:01:40.065610 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:40.065527 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:40.070252 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:40.070228 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:40.703228 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:40.703197 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:40.704016 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:40.703997 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:41.202595 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:41.202557 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk"] Jun 11 17:01:41.708440 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:41.708410 2580 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" secret="" err="secret \"e2e-ait-af43c8a2-openshift-default-dockercfg-ccbtr\" not found" Jun 11 17:01:42.712530 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:42.712473 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" podUID="b1072b05-f8d9-426e-97d3-29ee92eb8ac8" containerName="istio-proxy" containerID="cri-o://7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256" gracePeriod=30 Jun 11 17:01:47.729715 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.729515 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w"] Jun 11 17:01:47.736260 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.735184 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.739431 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.739230 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4b971085-openshift-default-dockercfg-qxjrw\"" Jun 11 17:01:47.748573 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.748546 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w"] Jun 11 17:01:47.824468 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.824438 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-envoy\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.824604 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.824475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-podinfo\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.824604 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.824526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-socket\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.824604 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.824574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-data\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.824709 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.824614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-credential-socket\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.824709 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.824645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istiod-ca-cert\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.824709 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.824698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-token\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.824812 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.824755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-certs\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.824812 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.824790 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzrcx\" (UniqueName: \"kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-kube-api-access-nzrcx\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927110 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.925910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-socket\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927110 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.926030 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-data\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927110 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.926068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-credential-socket\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927110 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.926091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istiod-ca-cert\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927110 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.926146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-token\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927110 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.926218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-certs\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927110 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.926285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzrcx\" (UniqueName: \"kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-kube-api-access-nzrcx\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927110 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.926331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-envoy\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927110 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.926361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-podinfo\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927879 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.927156 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-data\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927879 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.927408 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-credential-socket\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.927989 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.927959 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-socket\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.928968 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.928178 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-certs\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.928968 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.928925 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istiod-ca-cert\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.930129 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.930101 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-podinfo\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.930701 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.930677 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-envoy\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.939536 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.939508 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzrcx\" (UniqueName: \"kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-kube-api-access-nzrcx\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.939758 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.939734 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-token\") pod \"e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:47.991483 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:47.991429 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:48.101852 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.101812 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:48.128024 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.127990 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-envoy\") pod \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " Jun 11 17:01:48.128170 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.128041 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwkfg\" (UniqueName: \"kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-kube-api-access-jwkfg\") pod \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " Jun 11 17:01:48.128170 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.128079 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-podinfo\") pod \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " Jun 11 17:01:48.128170 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.128098 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-token\") pod \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " Jun 11 17:01:48.128170 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.128135 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-socket\") pod \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " Jun 11 17:01:48.128170 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.128159 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istiod-ca-cert\") pod \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " Jun 11 17:01:48.128429 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.128205 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-certs\") pod \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " Jun 11 17:01:48.128429 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.128236 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-data\") pod \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " Jun 11 17:01:48.128429 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.128263 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-credential-socket\") pod \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\" (UID: \"b1072b05-f8d9-426e-97d3-29ee92eb8ac8\") " Jun 11 17:01:48.128429 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.128383 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1072b05-f8d9-426e-97d3-29ee92eb8ac8" (UID: "b1072b05-f8d9-426e-97d3-29ee92eb8ac8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:01:48.130446 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.129052 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1072b05-f8d9-426e-97d3-29ee92eb8ac8" (UID: "b1072b05-f8d9-426e-97d3-29ee92eb8ac8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:01:48.130446 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.129211 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-credential-socket\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:01:48.130446 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.129229 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-socket\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:01:48.130850 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.130813 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1072b05-f8d9-426e-97d3-29ee92eb8ac8" (UID: "b1072b05-f8d9-426e-97d3-29ee92eb8ac8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:01:48.130950 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.130921 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-kube-api-access-jwkfg" (OuterVolumeSpecName: "kube-api-access-jwkfg") pod "b1072b05-f8d9-426e-97d3-29ee92eb8ac8" (UID: "b1072b05-f8d9-426e-97d3-29ee92eb8ac8"). InnerVolumeSpecName "kube-api-access-jwkfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:01:48.131070 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.131050 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1072b05-f8d9-426e-97d3-29ee92eb8ac8" (UID: "b1072b05-f8d9-426e-97d3-29ee92eb8ac8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:01:48.131235 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.131208 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1072b05-f8d9-426e-97d3-29ee92eb8ac8" (UID: "b1072b05-f8d9-426e-97d3-29ee92eb8ac8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 17:01:48.137597 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.131457 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1072b05-f8d9-426e-97d3-29ee92eb8ac8" (UID: "b1072b05-f8d9-426e-97d3-29ee92eb8ac8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:01:48.137597 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.131524 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1072b05-f8d9-426e-97d3-29ee92eb8ac8" (UID: "b1072b05-f8d9-426e-97d3-29ee92eb8ac8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:01:48.137597 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.132628 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1072b05-f8d9-426e-97d3-29ee92eb8ac8" (UID: "b1072b05-f8d9-426e-97d3-29ee92eb8ac8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:01:48.230276 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.230243 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-envoy\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:01:48.230276 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.230276 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwkfg\" (UniqueName: \"kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-kube-api-access-jwkfg\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:01:48.230455 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.230286 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-podinfo\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:01:48.230455 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.230295 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-token\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:01:48.230455 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.230303 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istiod-ca-cert\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:01:48.230455 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.230311 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-workload-certs\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:01:48.230455 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.230318 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1072b05-f8d9-426e-97d3-29ee92eb8ac8-istio-data\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:01:48.247589 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.247483 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w"] Jun 11 17:01:48.251230 ip-10-0-131-101 kubenswrapper[2580]: W0611 17:01:48.251197 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674cbf0a_fbd3_4eb1_aeb1_776860b24b22.slice/crio-5e356ea8ffe6b5ccea1775750f735c3ead1bd48794d0b48848dbc07308fae077 WatchSource:0}: Error finding container 5e356ea8ffe6b5ccea1775750f735c3ead1bd48794d0b48848dbc07308fae077: Status 404 returned error can't find the container with id 5e356ea8ffe6b5ccea1775750f735c3ead1bd48794d0b48848dbc07308fae077 Jun 11 17:01:48.254241 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.254205 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 11 17:01:48.254366 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.254274 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 11 17:01:48.254366 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.254301 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 11 17:01:48.749700 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.749665 2580 generic.go:356] "Generic (PLEG): container finished" podID="b1072b05-f8d9-426e-97d3-29ee92eb8ac8" containerID="7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256" exitCode=0 Jun 11 17:01:48.750095 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.749755 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" Jun 11 17:01:48.750095 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.749748 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" event={"ID":"b1072b05-f8d9-426e-97d3-29ee92eb8ac8","Type":"ContainerDied","Data":"7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256"} Jun 11 17:01:48.750095 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.749883 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk" event={"ID":"b1072b05-f8d9-426e-97d3-29ee92eb8ac8","Type":"ContainerDied","Data":"9315e3e0c1c33e8eeafab0591e657fe90175daefa2c07a8e200ae9ef6b6a6194"} Jun 11 17:01:48.750095 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.749918 2580 scope.go:117] "RemoveContainer" containerID="7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256" Jun 11 17:01:48.752649 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.752621 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" event={"ID":"674cbf0a-fbd3-4eb1-aeb1-776860b24b22","Type":"ContainerStarted","Data":"c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087"} Jun 11 17:01:48.752757 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.752675 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" event={"ID":"674cbf0a-fbd3-4eb1-aeb1-776860b24b22","Type":"ContainerStarted","Data":"5e356ea8ffe6b5ccea1775750f735c3ead1bd48794d0b48848dbc07308fae077"} Jun 11 17:01:48.764538 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.764517 2580 scope.go:117] "RemoveContainer" containerID="7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256" Jun 11 17:01:48.764804 ip-10-0-131-101 kubenswrapper[2580]: E0611 17:01:48.764784 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256\": container with ID starting with 7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256 not found: ID does not exist" containerID="7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256" Jun 11 17:01:48.764871 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.764810 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256"} err="failed to get container status \"7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256\": rpc error: code = NotFound desc = could not find container \"7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256\": container with ID starting with 7b1ff4b863314ba69e64ab5c3e4370f561ab834e41135684f24b5e28d0cb5256 not found: ID does not exist" Jun 11 17:01:48.794622 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.794597 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk"] Jun 11 17:01:48.799881 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.799857 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-af43c8a2-openshift-default-858b6b564b-ckhqk"] Jun 11 17:01:48.845244 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:48.845207 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" podStartSLOduration=1.8451929059999999 podStartE2EDuration="1.845192906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:01:48.843931543 +0000 UTC m=+2510.934241520" watchObservedRunningTime="2026-06-11 17:01:48.845192906 +0000 UTC m=+2510.935502835" Jun 11 17:01:49.102987 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:49.102906 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:49.107784 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:49.107759 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:49.758588 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:49.758551 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:49.759612 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:49.759589 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:01:50.359932 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:50.359904 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1072b05-f8d9-426e-97d3-29ee92eb8ac8" path="/var/lib/kubelet/pods/b1072b05-f8d9-426e-97d3-29ee92eb8ac8/volumes" Jun 11 17:01:55.260413 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:55.260379 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w"] Jun 11 17:01:55.260885 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:01:55.260582 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" podUID="674cbf0a-fbd3-4eb1-aeb1-776860b24b22" containerName="istio-proxy" containerID="cri-o://c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087" gracePeriod=30 Jun 11 17:02:00.503845 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.503821 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:02:00.645919 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.645842 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-token\") pod \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " Jun 11 17:02:00.645919 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.645910 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-podinfo\") pod \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " Jun 11 17:02:00.646081 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.645940 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-certs\") pod \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " Jun 11 17:02:00.646081 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.645975 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istiod-ca-cert\") pod \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " Jun 11 17:02:00.646081 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646004 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-data\") pod \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " Jun 11 17:02:00.646081 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646040 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzrcx\" (UniqueName: \"kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-kube-api-access-nzrcx\") pod \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " Jun 11 17:02:00.646270 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646094 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-credential-socket\") pod \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " Jun 11 17:02:00.646270 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646128 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-socket\") pod \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " Jun 11 17:02:00.646270 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646178 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-envoy\") pod \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\" (UID: \"674cbf0a-fbd3-4eb1-aeb1-776860b24b22\") " Jun 11 17:02:00.646455 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646267 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "674cbf0a-fbd3-4eb1-aeb1-776860b24b22" (UID: "674cbf0a-fbd3-4eb1-aeb1-776860b24b22"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:02:00.646455 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646315 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-data" (OuterVolumeSpecName: "istio-data") pod "674cbf0a-fbd3-4eb1-aeb1-776860b24b22" (UID: "674cbf0a-fbd3-4eb1-aeb1-776860b24b22"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:02:00.646455 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646420 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "674cbf0a-fbd3-4eb1-aeb1-776860b24b22" (UID: "674cbf0a-fbd3-4eb1-aeb1-776860b24b22"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:02:00.646646 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646566 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "674cbf0a-fbd3-4eb1-aeb1-776860b24b22" (UID: "674cbf0a-fbd3-4eb1-aeb1-776860b24b22"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:02:00.646869 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646650 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-certs\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:02:00.646869 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646670 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-data\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:02:00.646869 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646685 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-credential-socket\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:02:00.646869 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.646698 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "674cbf0a-fbd3-4eb1-aeb1-776860b24b22" (UID: "674cbf0a-fbd3-4eb1-aeb1-776860b24b22"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 17:02:00.648302 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.648216 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "674cbf0a-fbd3-4eb1-aeb1-776860b24b22" (UID: "674cbf0a-fbd3-4eb1-aeb1-776860b24b22"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 17:02:00.648302 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.648263 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-kube-api-access-nzrcx" (OuterVolumeSpecName: "kube-api-access-nzrcx") pod "674cbf0a-fbd3-4eb1-aeb1-776860b24b22" (UID: "674cbf0a-fbd3-4eb1-aeb1-776860b24b22"). InnerVolumeSpecName "kube-api-access-nzrcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:02:00.648302 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.648297 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-token" (OuterVolumeSpecName: "istio-token") pod "674cbf0a-fbd3-4eb1-aeb1-776860b24b22" (UID: "674cbf0a-fbd3-4eb1-aeb1-776860b24b22"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:02:00.648561 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.648544 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "674cbf0a-fbd3-4eb1-aeb1-776860b24b22" (UID: "674cbf0a-fbd3-4eb1-aeb1-776860b24b22"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 17:02:00.747790 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.747750 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-workload-socket\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:02:00.747790 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.747786 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-envoy\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:02:00.747790 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.747797 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-token\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:02:00.747790 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.747805 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istio-podinfo\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:02:00.748016 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.747814 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-istiod-ca-cert\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:02:00.748016 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.747822 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzrcx\" (UniqueName: \"kubernetes.io/projected/674cbf0a-fbd3-4eb1-aeb1-776860b24b22-kube-api-access-nzrcx\") on node \"ip-10-0-131-101.ec2.internal\" DevicePath \"\"" Jun 11 17:02:00.811937 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.811906 2580 generic.go:356] "Generic (PLEG): container finished" podID="674cbf0a-fbd3-4eb1-aeb1-776860b24b22" containerID="c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087" exitCode=0 Jun 11 17:02:00.812052 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.811952 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" Jun 11 17:02:00.812052 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.811993 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" event={"ID":"674cbf0a-fbd3-4eb1-aeb1-776860b24b22","Type":"ContainerDied","Data":"c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087"} Jun 11 17:02:00.812052 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.812044 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w" event={"ID":"674cbf0a-fbd3-4eb1-aeb1-776860b24b22","Type":"ContainerDied","Data":"5e356ea8ffe6b5ccea1775750f735c3ead1bd48794d0b48848dbc07308fae077"} Jun 11 17:02:00.812150 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.812068 2580 scope.go:117] "RemoveContainer" containerID="c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087" Jun 11 17:02:00.821478 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.821461 2580 scope.go:117] "RemoveContainer" containerID="c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087" Jun 11 17:02:00.821756 ip-10-0-131-101 kubenswrapper[2580]: E0611 17:02:00.821736 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087\": container with ID starting with c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087 not found: ID does not exist" containerID="c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087" Jun 11 17:02:00.821813 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.821763 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087"} err="failed to get container status \"c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087\": rpc error: code = NotFound desc = could not find container \"c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087\": container with ID starting with c39512bde8a799d0daad1d99277de2d91e6c465e7c4ea45e71b61f6f7ec05087 not found: ID does not exist" Jun 11 17:02:00.842682 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.842656 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w"] Jun 11 17:02:00.851279 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:00.851253 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4b971085-openshift-default-7f8fdcc98b-sxk6w"] Jun 11 17:02:02.359220 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:02.359186 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="674cbf0a-fbd3-4eb1-aeb1-776860b24b22" path="/var/lib/kubelet/pods/674cbf0a-fbd3-4eb1-aeb1-776860b24b22/volumes" Jun 11 17:02:12.903702 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:12.903671 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-867d74fdd8-frtcj_d1a594eb-c683-435d-9301-26975237b2c4/nginx/0.log" Jun 11 17:02:13.011011 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:13.010989 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-qxvnl_c5559da9-97ab-48f4-a532-9d8b44ffe4ec/manager/0.log" Jun 11 17:02:13.137093 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:13.137065 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-6qgtb_924a2210-2774-4444-9380-48fcdd602a92/manager/0.log" Jun 11 17:02:13.370643 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:13.370619 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686605-6599k_90fc1043-0c77-417d-a668-ae5c54fc5d02/cleanup/0.log" Jun 11 17:02:13.479248 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:13.479222 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686620-cpk6r_c59eea17-78ef-4550-b5ed-fe0e3f61b47c/cleanup/0.log" Jun 11 17:02:13.598130 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:13.598107 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68dfd7c487-8l8r7_8b647f4e-053a-48f3-a9bd-3d09462d9c26/manager/0.log" Jun 11 17:02:13.717844 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:13.717824 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hdfgw_9747f72d-d91a-4d86-996e-a7c44173d562/server/0.log" Jun 11 17:02:13.830968 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:13.830945 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-8w4rd_d1801c68-9c60-4fdf-bd96-b3395d476a5b/manager/0.log" Jun 11 17:02:14.239173 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:14.239149 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f85fbfb-rnvl4_009db1c7-876b-422d-a478-30e7c5f109e2/copy-manifests/0.log" Jun 11 17:02:14.251423 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:14.251399 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f85fbfb-rnvl4_009db1c7-876b-422d-a478-30e7c5f109e2/manager/0.log" Jun 11 17:02:14.368622 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:14.368601 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-f6sdf_01b96ae2-2370-4f0a-b498-1c29d2c4fb8c/postgres/0.log" Jun 11 17:02:15.876652 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:15.876624 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-v8vbl_ba78ae55-0204-4444-be5a-05ac71e90995/manager/0.log" Jun 11 17:02:16.449211 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:16.449180 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gn78c_4b8785e2-364f-48b7-be6f-1da352dd2e59/manager/0.log" Jun 11 17:02:16.895273 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:16.895203 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-662tl_f36a1ad3-db13-47c9-b600-ee3f78e0cfb2/discovery/0.log" Jun 11 17:02:17.118177 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:17.118146 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d74779d6-lttsg_8f680b57-df30-4267-b0f6-88018b6b7785/kube-auth-proxy/0.log" Jun 11 17:02:17.369395 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:17.369368 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7gnrb_c2fb0ed4-3a37-4807-b14b-ce18da57fdc7/payload-pre-processing/0.log" Jun 11 17:02:17.483313 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:17.483292 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2fjzq_e101b922-6aab-4f17-8e69-9c954afdb145/payload-processing/0.log" Jun 11 17:02:17.592863 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:17.592833 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7579d89c77-4lrjr_cfe39a80-a153-45b8-831e-b336d7549017/router/0.log" Jun 11 17:02:18.053857 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:18.053826 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-k8ghb_4cb6b776-b3f4-4611-b521-090283405276/storage-initializer/0.log" Jun 11 17:02:18.061598 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:18.061572 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-k8ghb_4cb6b776-b3f4-4611-b521-090283405276/main/0.log" Jun 11 17:02:18.290129 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:18.290104 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9_7b714303-2c6a-4a5e-b97a-e809f8d33b8d/storage-initializer/0.log" Jun 11 17:02:18.297658 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:18.297632 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgpvr9_7b714303-2c6a-4a5e-b97a-e809f8d33b8d/main/0.log" Jun 11 17:02:25.707007 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:25.706981 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-56n2p_25c20d12-a21c-400e-a8c2-dc2597f1318c/global-pull-secret-syncer/0.log" Jun 11 17:02:26.013543 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:26.013457 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p5dp9_b2d9560a-496a-4806-86ff-f27541f82a97/konnectivity-agent/0.log" Jun 11 17:02:26.059550 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:26.059521 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-101.ec2.internal_4922f8f5b3a3c97fad7fcd7149613037/haproxy/0.log" Jun 11 17:02:29.835540 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:29.835444 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-mkkvt_a4318af7-7f65-4a75-bb1f-bd13905a1057/sail-operator/0.log" Jun 11 17:02:30.821543 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:30.821514 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-v8vbl_ba78ae55-0204-4444-be5a-05ac71e90995/manager/0.log" Jun 11 17:02:31.089719 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:31.089639 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gn78c_4b8785e2-364f-48b7-be6f-1da352dd2e59/manager/0.log" Jun 11 17:02:32.949147 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:32.949109 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5d99m_7a5faa13-d683-4a51-879b-47c530adcc61/kube-state-metrics/0.log" Jun 11 17:02:32.973009 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:32.972980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5d99m_7a5faa13-d683-4a51-879b-47c530adcc61/kube-rbac-proxy-main/0.log" Jun 11 17:02:32.995374 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:32.995353 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5d99m_7a5faa13-d683-4a51-879b-47c530adcc61/kube-rbac-proxy-self/0.log" Jun 11 17:02:33.254408 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:33.254344 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lgn8p_bd9f974b-83fc-48dc-aded-4f57d2fba5a9/node-exporter/0.log" Jun 11 17:02:33.280335 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:33.280314 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lgn8p_bd9f974b-83fc-48dc-aded-4f57d2fba5a9/kube-rbac-proxy/0.log" Jun 11 17:02:33.302634 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:33.302617 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lgn8p_bd9f974b-83fc-48dc-aded-4f57d2fba5a9/init-textfile/0.log" Jun 11 17:02:37.264794 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.264757 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj"] Jun 11 17:02:37.265300 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.265257 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674cbf0a-fbd3-4eb1-aeb1-776860b24b22" containerName="istio-proxy" Jun 11 17:02:37.265300 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.265275 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="674cbf0a-fbd3-4eb1-aeb1-776860b24b22" containerName="istio-proxy" Jun 11 17:02:37.265300 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.265293 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1072b05-f8d9-426e-97d3-29ee92eb8ac8" containerName="istio-proxy" Jun 11 17:02:37.265300 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.265299 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1072b05-f8d9-426e-97d3-29ee92eb8ac8" containerName="istio-proxy" Jun 11 17:02:37.265448 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.265355 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1072b05-f8d9-426e-97d3-29ee92eb8ac8" containerName="istio-proxy" Jun 11 17:02:37.265448 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.265362 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="674cbf0a-fbd3-4eb1-aeb1-776860b24b22" containerName="istio-proxy" Jun 11 17:02:37.268101 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.268080 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.270473 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.270450 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gd56l\"/\"kube-root-ca.crt\"" Jun 11 17:02:37.270623 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.270451 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gd56l\"/\"openshift-service-ca.crt\"" Jun 11 17:02:37.271535 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.271515 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gd56l\"/\"default-dockercfg-68j4x\"" Jun 11 17:02:37.277001 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.276978 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj"] Jun 11 17:02:37.332823 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.332794 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-proc\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.332983 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.332827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfjh8\" (UniqueName: \"kubernetes.io/projected/8a1d0249-c4a8-4da9-b147-177c30d2d059-kube-api-access-jfjh8\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.332983 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.332927 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-sys\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.332983 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.332971 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-lib-modules\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.333082 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.333007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-podres\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.434381 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.434344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-sys\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.434602 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.434387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-lib-modules\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.434602 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.434421 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-podres\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.434602 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.434469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-proc\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.434602 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.434521 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfjh8\" (UniqueName: \"kubernetes.io/projected/8a1d0249-c4a8-4da9-b147-177c30d2d059-kube-api-access-jfjh8\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.434602 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.434466 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-sys\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.434602 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.434570 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-proc\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.434893 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.434605 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-podres\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.434893 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.434620 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a1d0249-c4a8-4da9-b147-177c30d2d059-lib-modules\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.443429 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.443407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfjh8\" (UniqueName: \"kubernetes.io/projected/8a1d0249-c4a8-4da9-b147-177c30d2d059-kube-api-access-jfjh8\") pod \"perf-node-gather-daemonset-cjktj\" (UID: \"8a1d0249-c4a8-4da9-b147-177c30d2d059\") " pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.578858 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.578786 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.711390 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.711363 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj"] Jun 11 17:02:37.713775 ip-10-0-131-101 kubenswrapper[2580]: W0611 17:02:37.713747 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a1d0249_c4a8_4da9_b147_177c30d2d059.slice/crio-58681ac13284186218b246a73e50bb93a4e780b6925a6599369af03341fc4e68 WatchSource:0}: Error finding container 58681ac13284186218b246a73e50bb93a4e780b6925a6599369af03341fc4e68: Status 404 returned error can't find the container with id 58681ac13284186218b246a73e50bb93a4e780b6925a6599369af03341fc4e68 Jun 11 17:02:37.996676 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.996645 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" event={"ID":"8a1d0249-c4a8-4da9-b147-177c30d2d059","Type":"ContainerStarted","Data":"55bfdbbb4f147ab0ff668559ac060d713721ebc326e09faed43a1d80bbe2ac1e"} Jun 11 17:02:37.996798 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.996705 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:37.996798 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:37.996722 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" event={"ID":"8a1d0249-c4a8-4da9-b147-177c30d2d059","Type":"ContainerStarted","Data":"58681ac13284186218b246a73e50bb93a4e780b6925a6599369af03341fc4e68"} Jun 11 17:02:38.014914 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:38.014865 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" podStartSLOduration=1.01484938 podStartE2EDuration="1.01484938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:02:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:02:38.013368893 +0000 UTC m=+2560.103678833" watchObservedRunningTime="2026-06-11 17:02:38.01484938 +0000 UTC m=+2560.105159308" Jun 11 17:02:38.761149 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:38.761120 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbwhj_ade0857a-0349-43f6-9981-afcf10f251fb/dns/0.log" Jun 11 17:02:38.783473 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:38.783447 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbwhj_ade0857a-0349-43f6-9981-afcf10f251fb/kube-rbac-proxy/0.log" Jun 11 17:02:38.957015 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:38.956985 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x82hp_c1d914bf-3912-41b1-a9c6-e7dda2172ba9/dns-node-resolver/0.log" Jun 11 17:02:39.696328 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:39.696296 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j47kx_1f61d24b-ee97-4a52-afeb-e13ad1ddb048/node-ca/0.log" Jun 11 17:02:40.745233 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:40.745187 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-662tl_f36a1ad3-db13-47c9-b600-ee3f78e0cfb2/discovery/0.log" Jun 11 17:02:40.801227 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:40.801201 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d74779d6-lttsg_8f680b57-df30-4267-b0f6-88018b6b7785/kube-auth-proxy/0.log" Jun 11 17:02:40.899025 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:40.898998 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7gnrb_c2fb0ed4-3a37-4807-b14b-ce18da57fdc7/payload-pre-processing/0.log" Jun 11 17:02:40.958659 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:40.958634 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2fjzq_e101b922-6aab-4f17-8e69-9c954afdb145/payload-processing/0.log" Jun 11 17:02:40.981380 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:40.981360 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7579d89c77-4lrjr_cfe39a80-a153-45b8-831e-b336d7549017/router/0.log" Jun 11 17:02:41.674367 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:41.674337 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqjsw_1505f0ff-2e38-4aab-8c26-be54fb1067fa/serve-healthcheck-canary/0.log" Jun 11 17:02:42.272560 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:42.272533 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-mcfp9_5e01f338-29ac-4c6f-a980-29984d504529/insights-operator/0.log" Jun 11 17:02:42.273087 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:42.273067 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-mcfp9_5e01f338-29ac-4c6f-a980-29984d504529/insights-operator/1.log" Jun 11 17:02:42.460202 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:42.460169 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkntn_bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e/kube-rbac-proxy/0.log" Jun 11 17:02:42.483209 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:42.483181 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkntn_bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e/exporter/0.log" Jun 11 17:02:42.507251 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:42.507227 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkntn_bd8ec3aa-3edc-41bb-924b-9f3f1a08de1e/extractor/0.log" Jun 11 17:02:44.011229 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:44.011198 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gd56l/perf-node-gather-daemonset-cjktj" Jun 11 17:02:44.818563 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:44.818529 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-867d74fdd8-frtcj_d1a594eb-c683-435d-9301-26975237b2c4/nginx/0.log" Jun 11 17:02:44.848284 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:44.848256 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-qxvnl_c5559da9-97ab-48f4-a532-9d8b44ffe4ec/manager/0.log" Jun 11 17:02:44.925509 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:44.925458 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-6qgtb_924a2210-2774-4444-9380-48fcdd602a92/manager/0.log" Jun 11 17:02:44.980201 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:44.980178 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686605-6599k_90fc1043-0c77-417d-a668-ae5c54fc5d02/cleanup/0.log" Jun 11 17:02:45.005473 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:45.005409 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686620-cpk6r_c59eea17-78ef-4550-b5ed-fe0e3f61b47c/cleanup/0.log" Jun 11 17:02:45.079359 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:45.079330 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68dfd7c487-8l8r7_8b647f4e-053a-48f3-a9bd-3d09462d9c26/manager/0.log" Jun 11 17:02:45.099476 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:45.099454 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hdfgw_9747f72d-d91a-4d86-996e-a7c44173d562/server/0.log" Jun 11 17:02:45.149164 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:45.149141 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-8w4rd_d1801c68-9c60-4fdf-bd96-b3395d476a5b/manager/0.log" Jun 11 17:02:45.340690 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:45.340620 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f85fbfb-rnvl4_009db1c7-876b-422d-a478-30e7c5f109e2/manager/0.log" Jun 11 17:02:45.361298 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:45.361279 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f85fbfb-rnvl4_009db1c7-876b-422d-a478-30e7c5f109e2/copy-manifests/0.log" Jun 11 17:02:45.390036 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:45.390017 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-f6sdf_01b96ae2-2370-4f0a-b498-1c29d2c4fb8c/postgres/0.log" Jun 11 17:02:51.454754 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:51.454724 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-662tl_f36a1ad3-db13-47c9-b600-ee3f78e0cfb2/discovery/0.log" Jun 11 17:02:51.484538 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:51.484515 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d74779d6-lttsg_8f680b57-df30-4267-b0f6-88018b6b7785/kube-auth-proxy/0.log" Jun 11 17:02:51.556259 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:51.556234 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7gnrb_c2fb0ed4-3a37-4807-b14b-ce18da57fdc7/payload-pre-processing/0.log" Jun 11 17:02:51.606168 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:51.606144 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2fjzq_e101b922-6aab-4f17-8e69-9c954afdb145/payload-processing/0.log" Jun 11 17:02:51.624997 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:51.624977 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7579d89c77-4lrjr_cfe39a80-a153-45b8-831e-b336d7549017/router/0.log" Jun 11 17:02:52.866061 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:52.866027 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-662tl_f36a1ad3-db13-47c9-b600-ee3f78e0cfb2/discovery/0.log" Jun 11 17:02:52.877700 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:52.877651 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-54xt4_b2e17b5c-254a-4f4a-8179-f8b8d5924630/migrator/0.log" Jun 11 17:02:52.892145 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:52.892123 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d74779d6-lttsg_8f680b57-df30-4267-b0f6-88018b6b7785/kube-auth-proxy/0.log" Jun 11 17:02:52.898771 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:52.898749 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-54xt4_b2e17b5c-254a-4f4a-8179-f8b8d5924630/graceful-termination/0.log" Jun 11 17:02:52.958033 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:52.958009 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7gnrb_c2fb0ed4-3a37-4807-b14b-ce18da57fdc7/payload-pre-processing/0.log" Jun 11 17:02:53.009771 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:53.009734 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2fjzq_e101b922-6aab-4f17-8e69-9c954afdb145/payload-processing/0.log" Jun 11 17:02:53.025951 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:53.025933 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7579d89c77-4lrjr_cfe39a80-a153-45b8-831e-b336d7549017/router/0.log" Jun 11 17:02:54.724409 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.724383 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hqtk_6ad4098e-5466-48d8-a01d-3266798cef13/kube-multus-additional-cni-plugins/0.log" Jun 11 17:02:54.745878 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.745833 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hqtk_6ad4098e-5466-48d8-a01d-3266798cef13/egress-router-binary-copy/0.log" Jun 11 17:02:54.768981 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.768960 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hqtk_6ad4098e-5466-48d8-a01d-3266798cef13/cni-plugins/0.log" Jun 11 17:02:54.777006 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.776983 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-662tl_f36a1ad3-db13-47c9-b600-ee3f78e0cfb2/discovery/0.log" Jun 11 17:02:54.791233 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.791216 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hqtk_6ad4098e-5466-48d8-a01d-3266798cef13/bond-cni-plugin/0.log" Jun 11 17:02:54.800536 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.800515 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d74779d6-lttsg_8f680b57-df30-4267-b0f6-88018b6b7785/kube-auth-proxy/0.log" Jun 11 17:02:54.811625 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.811609 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hqtk_6ad4098e-5466-48d8-a01d-3266798cef13/routeoverride-cni/0.log" Jun 11 17:02:54.835145 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.835121 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hqtk_6ad4098e-5466-48d8-a01d-3266798cef13/whereabouts-cni-bincopy/0.log" Jun 11 17:02:54.861231 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.861209 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hqtk_6ad4098e-5466-48d8-a01d-3266798cef13/whereabouts-cni/0.log" Jun 11 17:02:54.865349 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.865333 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7gnrb_c2fb0ed4-3a37-4807-b14b-ce18da57fdc7/payload-pre-processing/0.log" Jun 11 17:02:54.914109 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.914086 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2fjzq_e101b922-6aab-4f17-8e69-9c954afdb145/payload-processing/0.log" Jun 11 17:02:54.929175 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:54.929156 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7579d89c77-4lrjr_cfe39a80-a153-45b8-831e-b336d7549017/router/0.log" Jun 11 17:02:55.142336 ip-10-0-131-101 kubenswrapper[2580]: I0611 17:02:55.142268 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wbbwv_c3e454fd-2e6f-47c4-a7dc-9cf03f157670/kube-multus/0.log"