Jun 11 14:47:38.202762 ip-10-0-139-244 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 14:47:38.202777 ip-10-0-139-244 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 14:47:38.202786 ip-10-0-139-244 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 14:47:38.203149 ip-10-0-139-244 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 14:47:47.938591 ip-10-0-139-244 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 11 14:47:47.938607 ip-10-0-139-244 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ab198c03c46642ada85341ca5977c3d0 -- Jun 11 14:50:13.819926 ip-10-0-139-244 systemd[1]: Starting Kubernetes Kubelet... Jun 11 14:50:14.266101 ip-10-0-139-244 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:50:14.266101 ip-10-0-139-244 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 14:50:14.266101 ip-10-0-139-244 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:50:14.266101 ip-10-0-139-244 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 14:50:14.266101 ip-10-0-139-244 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:50:14.268603 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.268499 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 14:50:14.274959 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274927 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:14.274959 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274956 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:14.274959 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274960 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:14.274959 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274964 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274967 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274970 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274973 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274976 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274979 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274981 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274984 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274987 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274995 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.274999 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275002 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275005 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275007 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275010 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275012 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275015 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275018 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275020 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275022 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:14.275088 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275025 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275027 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275030 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275033 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275035 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275038 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275041 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275043 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275046 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275049 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275051 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275053 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275058 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275063 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275068 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275071 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275074 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275077 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275080 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:14.275584 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275082 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275085 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275088 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275092 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275095 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275097 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275100 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275103 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275105 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275108 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275111 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275113 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275116 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275118 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275121 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275125 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275127 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275130 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275132 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:14.276085 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275136 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275140 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275143 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275146 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275148 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275151 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275154 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275157 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275160 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275162 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275165 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275168 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275170 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275173 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275175 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275177 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275180 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275183 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275185 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275188 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:14.276566 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275190 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275193 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275195 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275198 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275200 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275203 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275205 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275207 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275210 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275212 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275215 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275217 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275220 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275222 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275225 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275228 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275230 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275233 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275969 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275977 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:14.277051 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275980 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275983 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275985 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275988 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275990 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275993 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275995 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.275998 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276001 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276004 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276007 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276009 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276012 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276015 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276017 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276019 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276022 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276024 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276027 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276029 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:14.277631 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276032 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276034 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276037 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276039 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276042 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276045 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276047 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276050 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276055 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276058 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276062 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276066 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276069 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276072 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276075 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276078 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276081 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276083 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276086 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:14.278143 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276088 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276091 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276094 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276097 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276100 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276102 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276105 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276107 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276110 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276113 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276115 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276118 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276120 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276122 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276125 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276128 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276130 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276134 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276136 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276139 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:14.278633 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276142 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276145 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276148 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276151 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276154 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276157 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276161 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276164 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276166 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276168 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276171 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276174 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276176 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276179 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276181 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276184 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276186 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276189 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276192 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276194 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:14.279172 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276197 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276200 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276202 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276205 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276210 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276212 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276214 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276218 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276220 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276223 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276225 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276228 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276230 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276234 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276236 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276241 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276244 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276246 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276724 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276730 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:14.279697 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276733 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276736 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276740 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276742 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276745 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276748 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276750 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276753 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276756 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276759 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276761 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276764 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276766 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276769 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276772 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276775 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276777 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276780 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276782 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276785 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:14.280174 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276787 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276790 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276792 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276795 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276797 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276800 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276803 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276806 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276808 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276811 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276813 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276815 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276818 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276820 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276822 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276825 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276827 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276829 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276832 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:14.280665 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276834 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276836 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276839 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276842 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276844 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276846 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276849 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276852 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276854 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276857 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276859 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276861 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276864 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276867 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276870 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276872 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276875 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276877 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276880 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276882 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:14.281134 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276885 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276888 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276892 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276895 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276899 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276902 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276905 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276908 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276910 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276913 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276915 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276918 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276921 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276924 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276926 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276929 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276932 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276934 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276939 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:14.281629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276941 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276944 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276946 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276949 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276952 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276954 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276956 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276961 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276964 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276966 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276969 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276972 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276975 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276977 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276980 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276982 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276985 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276988 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.276990 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277083 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277100 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 14:50:14.282099 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277108 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277113 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277117 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277120 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277124 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277129 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277132 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277135 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277139 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277142 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277146 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277149 2562 flags.go:64] FLAG: --cgroup-root="" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277152 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277155 2562 flags.go:64] FLAG: --client-ca-file="" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277158 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277160 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277164 2562 flags.go:64] FLAG: --cluster-domain="" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277167 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277170 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277173 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277176 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277180 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277182 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 14:50:14.282656 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277186 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277189 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277191 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277194 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277197 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277200 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277203 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277207 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277210 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277212 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277215 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277218 2562 flags.go:64] FLAG: --enable-server="true" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277221 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277226 2562 flags.go:64] FLAG: --event-burst="100" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277229 2562 flags.go:64] FLAG: --event-qps="50" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277231 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277234 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277237 2562 flags.go:64] FLAG: --eviction-hard="" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277241 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277245 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277248 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277251 2562 flags.go:64] FLAG: --eviction-soft="" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277254 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277256 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277259 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 14:50:14.283210 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277262 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277265 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277268 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277271 2562 flags.go:64] FLAG: --feature-gates="" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277277 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277280 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277283 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277286 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277289 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277292 2562 flags.go:64] FLAG: --help="false" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277295 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277298 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277301 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277304 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277307 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277310 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277313 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277316 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277319 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277321 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277324 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277327 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277330 2562 flags.go:64] FLAG: --kube-reserved="" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277333 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 14:50:14.283984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277335 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277338 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277341 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277345 2562 flags.go:64] FLAG: --lock-file="" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277348 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277350 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277353 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277359 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277362 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277365 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277367 2562 flags.go:64] FLAG: --logging-format="text" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277370 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277375 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277378 2562 flags.go:64] FLAG: --manifest-url="" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277381 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277386 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277388 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277393 2562 flags.go:64] FLAG: --max-pods="110" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277396 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277398 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277401 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277404 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277407 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277410 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277413 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 14:50:14.284843 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277420 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277424 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277443 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277446 2562 flags.go:64] FLAG: --pod-cidr="" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277449 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277455 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277458 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277461 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277465 2562 flags.go:64] FLAG: --port="10250" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277467 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277470 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-061b486c418729754" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277474 2562 flags.go:64] FLAG: --qos-reserved="" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277477 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277480 2562 flags.go:64] FLAG: --register-node="true" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277483 2562 flags.go:64] FLAG: --register-with-taints="" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277486 2562 flags.go:64] FLAG: --registry-burst="10" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277489 2562 flags.go:64] FLAG: --registry-qps="5" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277492 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277494 2562 flags.go:64] FLAG: --reserved-memory="" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277498 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277502 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277505 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277509 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277511 2562 flags.go:64] FLAG: --runonce="false" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277514 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 14:50:14.285470 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277517 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277520 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277523 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277526 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277529 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277532 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277535 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277538 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277542 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277545 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277547 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277550 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277553 2562 flags.go:64] FLAG: --system-cgroups="" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277555 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277561 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277564 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277567 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277571 2562 flags.go:64] FLAG: --tls-min-version="" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277574 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277577 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277580 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277583 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277586 2562 flags.go:64] FLAG: --v="2" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277589 2562 flags.go:64] FLAG: --version="false" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277593 2562 flags.go:64] FLAG: --vmodule="" Jun 11 14:50:14.286093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277601 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.277604 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277724 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277728 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277731 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277734 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277736 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277739 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277741 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277744 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277746 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277749 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277751 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277754 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277756 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277761 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277764 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277766 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277770 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277772 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:14.286792 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277774 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277777 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277780 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277782 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277785 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277787 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277789 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277793 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277795 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277798 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277800 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277802 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277805 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277807 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277811 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277814 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277816 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277819 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277821 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277824 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:14.287283 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277826 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277829 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277831 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277834 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277836 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277838 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277841 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277845 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277847 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277850 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277852 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277855 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277858 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277862 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277865 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277869 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277872 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277875 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277878 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:14.287804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277880 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277883 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277886 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277889 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277892 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277894 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277897 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277917 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277922 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277925 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277928 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277930 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277933 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277935 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277938 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277941 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277943 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277945 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277948 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:14.288270 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277951 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277955 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277958 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277960 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277963 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277965 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277968 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277970 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277972 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277975 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277977 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277980 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277982 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277984 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277987 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277990 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277992 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277995 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.277997 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.278000 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:14.288761 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.278004 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.278006 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.278009 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.278015 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.287690 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.287714 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.287734 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.287740 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287802 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287809 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287814 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287817 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287820 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287822 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:14.289254 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287825 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287828 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287830 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287833 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287835 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287838 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287840 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287843 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287845 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287848 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287850 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287853 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287855 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287858 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287860 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287863 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287865 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287867 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287870 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287872 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:14.289630 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287875 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287877 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287881 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287884 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287887 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287890 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287892 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287895 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287897 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287899 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287902 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287904 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287906 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287909 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287911 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287914 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287916 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287918 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287921 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:14.290127 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287923 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287926 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287928 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287930 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287933 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287935 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287938 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287942 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287945 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287948 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287951 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287954 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287957 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287959 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287962 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287964 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287967 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287970 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287972 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287975 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:14.290627 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287977 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287979 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287982 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287984 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287987 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287990 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287994 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.287997 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288000 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288002 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288004 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288007 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288009 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288012 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288015 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288017 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288020 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288022 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288025 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288028 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:14.291112 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288030 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288032 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288035 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288037 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288040 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288042 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288045 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288047 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288050 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288053 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288055 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288058 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288061 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288063 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.288069 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:50:14.291711 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288205 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288211 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288214 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288217 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288219 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288222 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288225 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288228 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288232 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288235 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288238 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288240 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288243 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288245 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288248 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288251 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288253 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288255 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288258 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:50:14.292123 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288260 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288263 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288265 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288267 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288270 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288272 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288276 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288280 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288283 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288285 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288288 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288290 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288293 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288295 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288298 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288300 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288302 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288305 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288307 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288310 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:50:14.292598 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288312 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288315 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288317 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288320 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288322 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288325 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288328 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288331 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288333 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288336 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288338 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288340 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288343 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288345 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288347 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288350 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288352 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288354 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288357 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288360 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:50:14.293095 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288363 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288365 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288368 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288370 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288372 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288375 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288377 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288381 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288384 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288387 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288389 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288392 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288394 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288397 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288399 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288402 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288404 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288406 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288409 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288415 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:50:14.293591 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288418 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288420 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288422 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288424 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288447 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288449 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288452 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288454 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288457 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288459 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288462 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288465 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288481 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288485 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288488 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288491 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288493 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288496 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288500 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:50:14.294073 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:14.288503 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:50:14.294672 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.288508 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:50:14.294672 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.288642 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 14:50:14.294672 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.292469 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 14:50:14.294672 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.293702 2562 server.go:1019] "Starting client certificate rotation" Jun 11 14:50:14.294672 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.293809 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:50:14.294672 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.294357 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:50:14.297093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.297072 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:50:14.300097 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.300073 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:50:14.313309 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.313279 2562 log.go:25] "Validated CRI v1 runtime API" Jun 11 14:50:14.316081 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.316059 2562 log.go:25] "Validated CRI v1 image API" Jun 11 14:50:14.316996 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.316972 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 14:50:14.319523 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.319487 2562 fs.go:135] Filesystem UUIDs: map[2cc422b8-f1a2-4487-b3e1-099c1a1e9239:/dev/nvme0n1p4 2d27a70e-7671-4e14-a5d5-2c8aa8f42cb8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 11 14:50:14.319597 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.319521 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 14:50:14.325137 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.325106 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:50:14.326389 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.326252 2562 manager.go:216] Machine: {Timestamp:2026-06-11 14:50:14.324878073 +0000 UTC m=+0.370265469 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3177912 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26585a85beb2f41fc4f02ae6639335 SystemUUID:ec26585a-85be-b2f4-1fc4-f02ae6639335 BootID:ab198c03-c466-42ad-a853-41ca5977c3d0 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8e:b0:16:24:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8e:b0:16:24:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:b7:7e:b8:d1:ad Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 14:50:14.326389 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.326376 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 14:50:14.326606 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.326536 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 14:50:14.329997 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.329950 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 14:50:14.330149 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.330001 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 14:50:14.330793 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.330780 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 14:50:14.330831 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.330795 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 14:50:14.330831 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.330803 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:50:14.331488 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.331474 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:50:14.332261 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.332249 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 14:50:14.335193 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.335176 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:50:14.335330 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.335320 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 14:50:14.335361 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.335353 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 11 14:50:14.335388 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.335363 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 14:50:14.335388 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.335384 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 14:50:14.335463 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.335394 2562 kubelet.go:398] "Adding apiserver pod source" Jun 11 14:50:14.335463 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.335403 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 14:50:14.335827 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.335813 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:50:14.335964 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.335832 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:50:14.338479 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.338457 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 14:50:14.339862 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.339847 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 14:50:14.339909 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.339879 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 14:50:14.341052 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341039 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 14:50:14.341093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341058 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 14:50:14.341093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341068 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 14:50:14.341093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341078 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 14:50:14.341093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341088 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 14:50:14.341093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341094 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 14:50:14.341223 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341102 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 14:50:14.341223 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341108 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 14:50:14.341223 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341116 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 14:50:14.341223 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341122 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 14:50:14.341223 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341131 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 14:50:14.341223 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.341136 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 14:50:14.343552 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.343534 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 14:50:14.343552 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.343551 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 14:50:14.347317 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.347284 2562 server.go:1268] "Started kubelet" Jun 11 14:50:14.347463 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.347371 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 14:50:14.347518 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.347456 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 14:50:14.347589 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.347544 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 14:50:14.347822 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.347803 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 14:50:14.347874 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.347840 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 14:50:14.347874 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.347868 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 14:50:14.348649 ip-10-0-139-244 systemd[1]: Started Kubernetes Kubelet. Jun 11 14:50:14.349861 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.349848 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 11 14:50:14.353457 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.352252 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 14:50:14.355300 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.355276 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 14:50:14.357155 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.357140 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 14:50:14.357245 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.357154 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 14:50:14.357344 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.357329 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:14.358189 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.357988 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 14:50:14.358189 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.357049 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-244.ec2.internal.18b80e55cfda8e26 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-244.ec2.internal,UID:ip-10-0-139-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-244.ec2.internal,},FirstTimestamp:2026-06-11 14:50:14.347247142 +0000 UTC m=+0.392634590,LastTimestamp:2026-06-11 14:50:14.347247142 +0000 UTC m=+0.392634590,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-244.ec2.internal,}" Jun 11 14:50:14.358189 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.358124 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 14:50:14.358189 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.358140 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 14:50:14.358401 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.358237 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 11 14:50:14.358401 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.358247 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 11 14:50:14.358401 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.358278 2562 factory.go:55] Registering systemd factory Jun 11 14:50:14.358401 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.358318 2562 factory.go:223] Registration of the systemd container factory successfully Jun 11 14:50:14.358666 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.358647 2562 factory.go:153] Registering CRI-O factory Jun 11 14:50:14.358666 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.358666 2562 factory.go:223] Registration of the crio container factory successfully Jun 11 14:50:14.358816 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.358716 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 14:50:14.358816 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.358801 2562 factory.go:103] Registering Raw factory Jun 11 14:50:14.358911 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.358822 2562 manager.go:1196] Started watching for new ooms in manager Jun 11 14:50:14.359146 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.359133 2562 manager.go:349] Starting recovery of all containers Jun 11 14:50:14.362297 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.362260 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 14:50:14.362471 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.362398 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 14:50:14.369380 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.369234 2562 manager.go:354] Recovery completed Jun 11 14:50:14.372103 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.372078 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t67bq" Jun 11 14:50:14.373760 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.373747 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:14.377973 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.377951 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:14.378107 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.377987 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:14.378107 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.377999 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:14.378638 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.378621 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 14:50:14.378638 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.378634 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:14.378638 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.378637 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 14:50:14.378831 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.378658 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:50:14.378916 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.378900 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t67bq" Jun 11 14:50:14.379553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.379533 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:14.379668 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.379566 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:14.379668 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.379580 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:14.380138 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.379652 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-244.ec2.internal.18b80e55d1af648b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-244.ec2.internal,UID:ip-10-0-139-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-244.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-244.ec2.internal,},FirstTimestamp:2026-06-11 14:50:14.377972875 +0000 UTC m=+0.423360269,LastTimestamp:2026-06-11 14:50:14.377972875 +0000 UTC m=+0.423360269,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-244.ec2.internal,}" Jun 11 14:50:14.380245 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.380140 2562 policy_none.go:49] "None policy: Start" Jun 11 14:50:14.380245 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.380156 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 14:50:14.380245 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.380171 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 14:50:14.381237 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.381224 2562 policy_none.go:47] "Start" Jun 11 14:50:14.416116 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.416093 2562 manager.go:337] "Starting Device Plugin manager" Jun 11 14:50:14.423678 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.416143 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 14:50:14.423678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.416155 2562 server.go:87] "Starting device plugin registration server" Jun 11 14:50:14.423678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.416480 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 14:50:14.423678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.416492 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 14:50:14.423678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.416595 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 14:50:14.423678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.416811 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 14:50:14.423678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.416821 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 14:50:14.423678 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.417388 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 14:50:14.423678 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.417460 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:14.423678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.423619 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 14:50:14.425087 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.425058 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 14:50:14.425212 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.425098 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 14:50:14.425212 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.425123 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 14:50:14.425212 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.425204 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 14:50:14.427716 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.427689 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:14.517252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.517105 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:14.518149 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.518128 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:14.518269 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.518165 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:14.518269 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.518177 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:14.518269 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.518202 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.525544 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.525514 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal"] Jun 11 14:50:14.525711 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.525594 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:14.527121 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.527097 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:14.527248 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.527133 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:14.527248 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.527148 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:14.527501 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.527482 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.527569 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.527507 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-244.ec2.internal\": node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:14.528699 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.528683 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:14.528825 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.528811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.528875 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.528841 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:14.529572 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.529555 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:14.529666 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.529582 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:14.529666 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.529593 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:14.529666 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.529558 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:14.529666 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.529662 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:14.529838 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.529676 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:14.531501 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.531483 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.531593 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.531516 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:50:14.532403 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.532384 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:50:14.532507 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.532416 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:50:14.532507 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.532438 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:50:14.559234 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.559202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4942a1001bdf640f5ae6195853ad885b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"4942a1001bdf640f5ae6195853ad885b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.559234 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.559237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4942a1001bdf640f5ae6195853ad885b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"4942a1001bdf640f5ae6195853ad885b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.559441 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.559254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c0bd5da9b4cc155444e674e4daae372-config\") pod \"kube-apiserver-proxy-ip-10-0-139-244.ec2.internal\" (UID: \"9c0bd5da9b4cc155444e674e4daae372\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.563282 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.563261 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-244.ec2.internal\" not found" node="ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.567979 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.567960 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-244.ec2.internal\" not found" node="ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.575184 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.575162 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:14.659471 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.659421 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c0bd5da9b4cc155444e674e4daae372-config\") pod \"kube-apiserver-proxy-ip-10-0-139-244.ec2.internal\" (UID: \"9c0bd5da9b4cc155444e674e4daae372\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.659471 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.659467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4942a1001bdf640f5ae6195853ad885b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"4942a1001bdf640f5ae6195853ad885b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.659678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.659486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4942a1001bdf640f5ae6195853ad885b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"4942a1001bdf640f5ae6195853ad885b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.659678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.659528 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4942a1001bdf640f5ae6195853ad885b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"4942a1001bdf640f5ae6195853ad885b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.659678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.659533 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c0bd5da9b4cc155444e674e4daae372-config\") pod \"kube-apiserver-proxy-ip-10-0-139-244.ec2.internal\" (UID: \"9c0bd5da9b4cc155444e674e4daae372\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.659678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.659533 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4942a1001bdf640f5ae6195853ad885b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"4942a1001bdf640f5ae6195853ad885b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.676282 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.676242 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:14.776787 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.776710 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:14.867579 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.867537 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.872834 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:14.872167 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" Jun 11 14:50:14.876833 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.876812 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:14.977417 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:14.977362 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:15.078083 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:15.077996 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:15.178519 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:15.178481 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:15.279178 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:15.279143 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:15.293345 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.293308 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 14:50:15.293587 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.293489 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:50:15.367392 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:15.367346 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4942a1001bdf640f5ae6195853ad885b.slice/crio-e163a5ac0b874811abf20c1fa0d837bbb10a80127205b61434c84dc15017ed50 WatchSource:0}: Error finding container e163a5ac0b874811abf20c1fa0d837bbb10a80127205b61434c84dc15017ed50: Status 404 returned error can't find the container with id e163a5ac0b874811abf20c1fa0d837bbb10a80127205b61434c84dc15017ed50 Jun 11 14:50:15.367824 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:15.367798 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0bd5da9b4cc155444e674e4daae372.slice/crio-37ef35b6e5988678507c095bfbcb77487ab33b07bf850ab949992a6c7af9bff6 WatchSource:0}: Error finding container 37ef35b6e5988678507c095bfbcb77487ab33b07bf850ab949992a6c7af9bff6: Status 404 returned error can't find the container with id 37ef35b6e5988678507c095bfbcb77487ab33b07bf850ab949992a6c7af9bff6 Jun 11 14:50:15.372795 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.372775 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:50:15.379462 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:15.379417 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:15.381605 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.381573 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 14:45:14 +0000 UTC" deadline="2028-02-24 02:07:30.721213422 +0000 UTC" Jun 11 14:50:15.381605 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.381606 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14939h17m15.339610737s" Jun 11 14:50:15.429185 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.429133 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" event={"ID":"4942a1001bdf640f5ae6195853ad885b","Type":"ContainerStarted","Data":"e163a5ac0b874811abf20c1fa0d837bbb10a80127205b61434c84dc15017ed50"} Jun 11 14:50:15.430117 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.430094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" event={"ID":"9c0bd5da9b4cc155444e674e4daae372","Type":"ContainerStarted","Data":"37ef35b6e5988678507c095bfbcb77487ab33b07bf850ab949992a6c7af9bff6"} Jun 11 14:50:15.479750 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:15.479712 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:15.580396 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:15.580354 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:15.680830 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:15.680728 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found" Jun 11 14:50:15.682582 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.682556 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:15.688845 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.688823 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:15.757835 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.757786 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" Jun 11 14:50:15.769722 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.769687 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:50:15.772716 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.772676 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" Jun 11 14:50:15.782506 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.782480 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:50:15.858393 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:15.858358 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:16.336637 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.336596 2562 apiserver.go:52] "Watching apiserver" Jun 11 14:50:16.347732 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.347703 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:50:16.350563 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.350532 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 14:50:16.351040 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.351011 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-c4qkd","kube-system/konnectivity-agent-lcsm9","kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal","openshift-dns/node-resolver-sq4qw","openshift-multus/multus-nx4z2","openshift-multus/network-metrics-daemon-chz6g","openshift-ovn-kubernetes/ovnkube-node-rqgqt","kube-system/global-pull-secret-syncer-9sm6h","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w","openshift-cluster-node-tuning-operator/tuned-wwcq9","openshift-image-registry/node-ca-m7d55","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal","openshift-multus/multus-additional-cni-plugins-7j6q2","openshift-network-diagnostics/network-check-target-8smqc"] Jun 11 14:50:16.353449 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.353411 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.356545 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.356498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.357844 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.357820 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 14:50:16.358090 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.358073 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 14:50:16.358241 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.358226 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 14:50:16.358594 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.358576 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 14:50:16.358812 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.358796 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 14:50:16.359011 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.358997 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 14:50:16.359189 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.359176 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8kk7g\"" Jun 11 14:50:16.362786 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.362760 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 14:50:16.362955 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.362943 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2r9f5\"" Jun 11 14:50:16.363178 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.363161 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 14:50:16.363383 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.363363 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 14:50:16.363639 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.363613 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 14:50:16.363713 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.363665 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.363713 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.363695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:16.363777 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.363612 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 14:50:16.363826 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.363769 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:16.363936 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.363923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sq4qw" Jun 11 14:50:16.364025 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.364010 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:16.364076 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.364061 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:16.364140 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.364065 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.364413 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.364391 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 14:50:16.364529 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.364412 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c4qkd" Jun 11 14:50:16.365171 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.365149 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:16.366127 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.366106 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 14:50:16.366751 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.366724 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 14:50:16.366854 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.366834 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 14:50:16.367391 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.367372 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 14:50:16.367511 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.367475 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-twht9\"" Jun 11 14:50:16.367684 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.367659 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.367876 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.367859 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 14:50:16.368073 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368050 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p7hzw\"" Jun 11 14:50:16.368147 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368058 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 14:50:16.368147 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368127 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 14:50:16.368251 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368059 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edc13586-9c50-4c1b-87cf-08a030e1adf0-ovnkube-config\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.368251 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-hostroot\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.368251 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d316b1d3-e66c-44c9-abf6-0318431f3082-agent-certs\") pod \"konnectivity-agent-lcsm9\" (UID: \"d316b1d3-e66c-44c9-abf6-0318431f3082\") " pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:16.368462 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edc13586-9c50-4c1b-87cf-08a030e1adf0-ovnkube-script-lib\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.368462 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368294 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/904bf1fa-7b9c-4f76-853a-27c1ff19cb7b-iptables-alerter-script\") pod \"iptables-alerter-c4qkd\" (UID: \"904bf1fa-7b9c-4f76-853a-27c1ff19cb7b\") " pod="openshift-network-operator/iptables-alerter-c4qkd" Jun 11 14:50:16.368462 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-system-cni-dir\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.368462 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-socket-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.368462 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368376 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7nt46\"" Jun 11 14:50:16.368462 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/904bf1fa-7b9c-4f76-853a-27c1ff19cb7b-host-slash\") pod \"iptables-alerter-c4qkd\" (UID: \"904bf1fa-7b9c-4f76-853a-27c1ff19cb7b\") " pod="openshift-network-operator/iptables-alerter-c4qkd" Jun 11 14:50:16.368462 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edc13586-9c50-4c1b-87cf-08a030e1adf0-env-overrides\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-cnibin\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368499 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-var-lib-cni-bin\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368543 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24pd6\" (UniqueName: \"kubernetes.io/projected/1a0598fb-ea78-4888-9928-e431a8d3a74a-kube-api-access-24pd6\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-run-openvswitch\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-node-log\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368596 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-os-release\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-554xr\" (UniqueName: \"kubernetes.io/projected/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-kube-api-access-554xr\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368648 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5m6k9\"" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7btb4\" (UniqueName: \"kubernetes.io/projected/73d14d01-5879-4aa4-96ae-8be3de77b473-kube-api-access-7btb4\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-cni-dir\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-run-netns\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-var-lib-kubelet\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368769 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7f7145-6dd1-4bcd-bc44-acd990a2d517-tmp-dir\") pod \"node-resolver-sq4qw\" (UID: \"8c7f7145-6dd1-4bcd-bc44-acd990a2d517\") " pod="openshift-dns/node-resolver-sq4qw" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368815 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368840 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv8f2\" (UniqueName: \"kubernetes.io/projected/904bf1fa-7b9c-4f76-853a-27c1ff19cb7b-kube-api-access-bv8f2\") pod \"iptables-alerter-c4qkd\" (UID: \"904bf1fa-7b9c-4f76-853a-27c1ff19cb7b\") " pod="openshift-network-operator/iptables-alerter-c4qkd" Jun 11 14:50:16.368851 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-systemd-units\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368598 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6ztg4\"" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-conf-dir\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c7f7145-6dd1-4bcd-bc44-acd990a2d517-hosts-file\") pod \"node-resolver-sq4qw\" (UID: \"8c7f7145-6dd1-4bcd-bc44-acd990a2d517\") " pod="openshift-dns/node-resolver-sq4qw" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.368521 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d316b1d3-e66c-44c9-abf6-0318431f3082-konnectivity-ca\") pod \"konnectivity-agent-lcsm9\" (UID: \"d316b1d3-e66c-44c9-abf6-0318431f3082\") " pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-cni-bin\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-os-release\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-run-multus-certs\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-etc-kubernetes\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369246 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-cnibin\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7d55" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369268 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-socket-dir-parent\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369312 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-run-k8s-cni-cncf-io\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.369826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-daemon-config\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-device-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369369 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqlb5\" (UniqueName: \"kubernetes.io/projected/8c7f7145-6dd1-4bcd-bc44-acd990a2d517-kube-api-access-zqlb5\") pod \"node-resolver-sq4qw\" (UID: \"8c7f7145-6dd1-4bcd-bc44-acd990a2d517\") " pod="openshift-dns/node-resolver-sq4qw" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369384 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-run-netns\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369405 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-run-systemd\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-etc-openvswitch\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-run-ovn\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-sys-fs\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx55r\" (UniqueName: \"kubernetes.io/projected/6c70a562-3b07-482e-bbaa-a285419c369b-kube-api-access-jx55r\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369555 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-kubelet\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-var-lib-openvswitch\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtk49\" (UniqueName: \"kubernetes.io/projected/edc13586-9c50-4c1b-87cf-08a030e1adf0-kube-api-access-rtk49\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-cni-netd\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdp49\" (UniqueName: \"kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49\") pod \"network-check-target-8smqc\" (UID: \"f687b1bc-e135-4896-9e92-da097d66ddee\") " pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:16.370771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-var-lib-cni-multus\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.371553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-slash\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.371553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.371553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369849 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-system-cni-dir\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.371553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.371553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73d14d01-5879-4aa4-96ae-8be3de77b473-cni-binary-copy\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.371553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369928 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-log-socket\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.371553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369950 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edc13586-9c50-4c1b-87cf-08a030e1adf0-ovn-node-metrics-cert\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.371553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.369973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-registration-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.371553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.371288 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:16.371553 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.371373 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:16.373130 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.373105 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 14:50:16.375606 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.373459 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:50:16.375606 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.374019 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pq7jj\"" Jun 11 14:50:16.375606 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.374199 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 14:50:16.375606 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.374377 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 14:50:16.375606 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.374422 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 14:50:16.375606 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.374708 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m9f2x\"" Jun 11 14:50:16.380678 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.380652 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:50:16.404162 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.404132 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mh792" Jun 11 14:50:16.411459 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.411405 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mh792" Jun 11 14:50:16.459969 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.459869 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 14:50:16.470839 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.470802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-var-lib-kubelet\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.471031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.470851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.471031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.470887 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7f7145-6dd1-4bcd-bc44-acd990a2d517-tmp-dir\") pod \"node-resolver-sq4qw\" (UID: \"8c7f7145-6dd1-4bcd-bc44-acd990a2d517\") " pod="openshift-dns/node-resolver-sq4qw" Jun 11 14:50:16.471031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.470904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv8f2\" (UniqueName: \"kubernetes.io/projected/904bf1fa-7b9c-4f76-853a-27c1ff19cb7b-kube-api-access-bv8f2\") pod \"iptables-alerter-c4qkd\" (UID: \"904bf1fa-7b9c-4f76-853a-27c1ff19cb7b\") " pod="openshift-network-operator/iptables-alerter-c4qkd" Jun 11 14:50:16.471031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.470924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-sysctl-conf\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.471031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.470940 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-systemd-units\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.471031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.470961 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.471031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.470985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.471031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-conf-dir\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.471031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471020 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c7f7145-6dd1-4bcd-bc44-acd990a2d517-hosts-file\") pod \"node-resolver-sq4qw\" (UID: \"8c7f7145-6dd1-4bcd-bc44-acd990a2d517\") " pod="openshift-dns/node-resolver-sq4qw" Jun 11 14:50:16.471031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-tuned\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9hg4\" (UniqueName: \"kubernetes.io/projected/a0e8f1d6-7502-4162-8f08-e702ec782a8b-kube-api-access-d9hg4\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d316b1d3-e66c-44c9-abf6-0318431f3082-konnectivity-ca\") pod \"konnectivity-agent-lcsm9\" (UID: \"d316b1d3-e66c-44c9-abf6-0318431f3082\") " pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-cni-bin\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-os-release\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471128 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-run-multus-certs\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-etc-kubernetes\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-modprobe-d\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-sysconfig\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-sys\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-cnibin\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471274 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-systemd\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-run\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-lib-modules\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-host\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c85d9bb0-a0f0-46b3-9c97-58961e603482-dbus\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:16.471468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-socket-dir-parent\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-run-k8s-cni-cncf-io\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-daemon-config\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-device-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqlb5\" (UniqueName: \"kubernetes.io/projected/8c7f7145-6dd1-4bcd-bc44-acd990a2d517-kube-api-access-zqlb5\") pod \"node-resolver-sq4qw\" (UID: \"8c7f7145-6dd1-4bcd-bc44-acd990a2d517\") " pod="openshift-dns/node-resolver-sq4qw" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-run-netns\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471520 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-run-systemd\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-etc-openvswitch\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-run-ovn\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-sys-fs\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471588 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-kubernetes\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx55r\" (UniqueName: \"kubernetes.io/projected/6c70a562-3b07-482e-bbaa-a285419c369b-kube-api-access-jx55r\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-kubelet\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-var-lib-openvswitch\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtk49\" (UniqueName: \"kubernetes.io/projected/edc13586-9c50-4c1b-87cf-08a030e1adf0-kube-api-access-rtk49\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-var-lib-kubelet\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c85d9bb0-a0f0-46b3-9c97-58961e603482-kubelet-config\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-cni-netd\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471774 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdp49\" (UniqueName: \"kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49\") pod \"network-check-target-8smqc\" (UID: \"f687b1bc-e135-4896-9e92-da097d66ddee\") " pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471797 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-var-lib-cni-multus\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471813 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0e8f1d6-7502-4162-8f08-e702ec782a8b-tmp\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471841 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-slash\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-system-cni-dir\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471907 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73d14d01-5879-4aa4-96ae-8be3de77b473-cni-binary-copy\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40ea14c6-cca7-4e29-89e7-12e1a626e0f5-serviceca\") pod \"node-ca-m7d55\" (UID: \"40ea14c6-cca7-4e29-89e7-12e1a626e0f5\") " pod="openshift-image-registry/node-ca-m7d55" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-log-socket\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.471995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edc13586-9c50-4c1b-87cf-08a030e1adf0-ovn-node-metrics-cert\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-registration-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:16.472878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edc13586-9c50-4c1b-87cf-08a030e1adf0-ovnkube-config\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-hostroot\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d316b1d3-e66c-44c9-abf6-0318431f3082-agent-certs\") pod \"konnectivity-agent-lcsm9\" (UID: \"d316b1d3-e66c-44c9-abf6-0318431f3082\") " pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edc13586-9c50-4c1b-87cf-08a030e1adf0-ovnkube-script-lib\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/904bf1fa-7b9c-4f76-853a-27c1ff19cb7b-iptables-alerter-script\") pod \"iptables-alerter-c4qkd\" (UID: \"904bf1fa-7b9c-4f76-853a-27c1ff19cb7b\") " pod="openshift-network-operator/iptables-alerter-c4qkd" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-system-cni-dir\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-socket-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/904bf1fa-7b9c-4f76-853a-27c1ff19cb7b-host-slash\") pod \"iptables-alerter-c4qkd\" (UID: \"904bf1fa-7b9c-4f76-853a-27c1ff19cb7b\") " pod="openshift-network-operator/iptables-alerter-c4qkd" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzx9x\" (UniqueName: \"kubernetes.io/projected/40ea14c6-cca7-4e29-89e7-12e1a626e0f5-kube-api-access-xzx9x\") pod \"node-ca-m7d55\" (UID: \"40ea14c6-cca7-4e29-89e7-12e1a626e0f5\") " pod="openshift-image-registry/node-ca-m7d55" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edc13586-9c50-4c1b-87cf-08a030e1adf0-env-overrides\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-cnibin\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-var-lib-cni-bin\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24pd6\" (UniqueName: \"kubernetes.io/projected/1a0598fb-ea78-4888-9928-e431a8d3a74a-kube-api-access-24pd6\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-sysctl-d\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-run-openvswitch\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-node-log\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-os-release\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.473469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-554xr\" (UniqueName: \"kubernetes.io/projected/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-kube-api-access-554xr\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7btb4\" (UniqueName: \"kubernetes.io/projected/73d14d01-5879-4aa4-96ae-8be3de77b473-kube-api-access-7btb4\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40ea14c6-cca7-4e29-89e7-12e1a626e0f5-host\") pod \"node-ca-m7d55\" (UID: \"40ea14c6-cca7-4e29-89e7-12e1a626e0f5\") " pod="openshift-image-registry/node-ca-m7d55" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472626 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472697 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-kubelet\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472775 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-var-lib-openvswitch\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.472894 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.472986 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs podName:6c70a562-3b07-482e-bbaa-a285419c369b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:16.972941749 +0000 UTC m=+3.018329133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs") pod "network-metrics-daemon-chz6g" (UID: "6c70a562-3b07-482e-bbaa-a285419c369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.472989 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-cni-netd\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473315 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7f7145-6dd1-4bcd-bc44-acd990a2d517-tmp-dir\") pod \"node-resolver-sq4qw\" (UID: \"8c7f7145-6dd1-4bcd-bc44-acd990a2d517\") " pod="openshift-dns/node-resolver-sq4qw" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473477 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-var-lib-cni-multus\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-cni-dir\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-run-netns\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-slash\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473634 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-cni-bin\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473656 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-run-netns\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-os-release\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474236 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473712 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-run-multus-certs\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473748 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-etc-kubernetes\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473814 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473855 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-cnibin\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473921 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-socket-dir-parent\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473949 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-os-release\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473962 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-run-k8s-cni-cncf-io\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.473989 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/904bf1fa-7b9c-4f76-853a-27c1ff19cb7b-host-slash\") pod \"iptables-alerter-c4qkd\" (UID: \"904bf1fa-7b9c-4f76-853a-27c1ff19cb7b\") " pod="openshift-network-operator/iptables-alerter-c4qkd" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.474033 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-socket-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.474107 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-registration-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.474448 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edc13586-9c50-4c1b-87cf-08a030e1adf0-env-overrides\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.474554 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-daemon-config\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.474578 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.474622 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-var-lib-kubelet\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.474651 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edc13586-9c50-4c1b-87cf-08a030e1adf0-ovnkube-config\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.474673 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-system-cni-dir\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.474712 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-hostroot\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.474945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.474748 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-run-openvswitch\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475170 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-device-dir\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475254 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edc13586-9c50-4c1b-87cf-08a030e1adf0-ovnkube-script-lib\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d316b1d3-e66c-44c9-abf6-0318431f3082-konnectivity-ca\") pod \"konnectivity-agent-lcsm9\" (UID: \"d316b1d3-e66c-44c9-abf6-0318431f3082\") " pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475315 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-run-systemd\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-log-socket\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475351 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-etc-openvswitch\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475380 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475387 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-systemd-units\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475444 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-cnibin\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475478 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-host-run-netns\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475523 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-cni-dir\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475558 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-run-ovn\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475591 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-multus-conf-dir\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c7f7145-6dd1-4bcd-bc44-acd990a2d517-hosts-file\") pod \"node-resolver-sq4qw\" (UID: \"8c7f7145-6dd1-4bcd-bc44-acd990a2d517\") " pod="openshift-dns/node-resolver-sq4qw" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475668 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/904bf1fa-7b9c-4f76-853a-27c1ff19cb7b-iptables-alerter-script\") pod \"iptables-alerter-c4qkd\" (UID: \"904bf1fa-7b9c-4f76-853a-27c1ff19cb7b\") " pod="openshift-network-operator/iptables-alerter-c4qkd" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475757 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edc13586-9c50-4c1b-87cf-08a030e1adf0-node-log\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.475778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475790 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.476507 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475833 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a0598fb-ea78-4888-9928-e431a8d3a74a-sys-fs\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.476507 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475839 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-host-var-lib-cni-bin\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.476507 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.475995 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73d14d01-5879-4aa4-96ae-8be3de77b473-system-cni-dir\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.476507 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.476062 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73d14d01-5879-4aa4-96ae-8be3de77b473-cni-binary-copy\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.476507 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.476236 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.479531 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.479499 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:16.479531 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.479537 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:16.479753 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.479546 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edc13586-9c50-4c1b-87cf-08a030e1adf0-ovn-node-metrics-cert\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.479753 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.479552 2562 projected.go:196] Error preparing data for projected volume kube-api-access-vdp49 for pod openshift-network-diagnostics/network-check-target-8smqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:16.479753 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.479664 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49 podName:f687b1bc-e135-4896-9e92-da097d66ddee nodeName:}" failed. No retries permitted until 2026-06-11 14:50:16.979645018 +0000 UTC m=+3.025032402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vdp49" (UniqueName: "kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49") pod "network-check-target-8smqc" (UID: "f687b1bc-e135-4896-9e92-da097d66ddee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:16.479925 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.479799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d316b1d3-e66c-44c9-abf6-0318431f3082-agent-certs\") pod \"konnectivity-agent-lcsm9\" (UID: \"d316b1d3-e66c-44c9-abf6-0318431f3082\") " pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:16.483184 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.483075 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-554xr\" (UniqueName: \"kubernetes.io/projected/e20387c0-94f0-42e5-ba1e-2f234b38c0a9-kube-api-access-554xr\") pod \"multus-additional-cni-plugins-7j6q2\" (UID: \"e20387c0-94f0-42e5-ba1e-2f234b38c0a9\") " pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.483614 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.483584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx55r\" (UniqueName: \"kubernetes.io/projected/6c70a562-3b07-482e-bbaa-a285419c369b-kube-api-access-jx55r\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:16.485101 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.485067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv8f2\" (UniqueName: \"kubernetes.io/projected/904bf1fa-7b9c-4f76-853a-27c1ff19cb7b-kube-api-access-bv8f2\") pod \"iptables-alerter-c4qkd\" (UID: \"904bf1fa-7b9c-4f76-853a-27c1ff19cb7b\") " pod="openshift-network-operator/iptables-alerter-c4qkd" Jun 11 14:50:16.485518 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.485491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqlb5\" (UniqueName: \"kubernetes.io/projected/8c7f7145-6dd1-4bcd-bc44-acd990a2d517-kube-api-access-zqlb5\") pod \"node-resolver-sq4qw\" (UID: \"8c7f7145-6dd1-4bcd-bc44-acd990a2d517\") " pod="openshift-dns/node-resolver-sq4qw" Jun 11 14:50:16.485620 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.485601 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7btb4\" (UniqueName: \"kubernetes.io/projected/73d14d01-5879-4aa4-96ae-8be3de77b473-kube-api-access-7btb4\") pod \"multus-nx4z2\" (UID: \"73d14d01-5879-4aa4-96ae-8be3de77b473\") " pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.488603 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.488445 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtk49\" (UniqueName: \"kubernetes.io/projected/edc13586-9c50-4c1b-87cf-08a030e1adf0-kube-api-access-rtk49\") pod \"ovnkube-node-rqgqt\" (UID: \"edc13586-9c50-4c1b-87cf-08a030e1adf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.488850 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.488832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24pd6\" (UniqueName: \"kubernetes.io/projected/1a0598fb-ea78-4888-9928-e431a8d3a74a-kube-api-access-24pd6\") pod \"aws-ebs-csi-driver-node-hc76w\" (UID: \"1a0598fb-ea78-4888-9928-e431a8d3a74a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.574032 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.573990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-sysctl-conf\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574218 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-tuned\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574218 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9hg4\" (UniqueName: \"kubernetes.io/projected/a0e8f1d6-7502-4162-8f08-e702ec782a8b-kube-api-access-d9hg4\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574218 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-modprobe-d\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574218 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574104 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-sysconfig\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574218 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-sys\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574218 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-sys\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574214 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-sysconfig\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-modprobe-d\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-systemd\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574299 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-sysctl-conf\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-run\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-lib-modules\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-host\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574389 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-systemd\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-run\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574452 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-host\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574453 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c85d9bb0-a0f0-46b3-9c97-58961e603482-dbus\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-kubernetes\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.574502 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574502 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c85d9bb0-a0f0-46b3-9c97-58961e603482-dbus\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574521 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-lib-modules\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-var-lib-kubelet\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c85d9bb0-a0f0-46b3-9c97-58961e603482-kubelet-config\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574571 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-kubernetes\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574594 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0e8f1d6-7502-4162-8f08-e702ec782a8b-tmp\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574629 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40ea14c6-cca7-4e29-89e7-12e1a626e0f5-serviceca\") pod \"node-ca-m7d55\" (UID: \"40ea14c6-cca7-4e29-89e7-12e1a626e0f5\") " pod="openshift-image-registry/node-ca-m7d55" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-var-lib-kubelet\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574645 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c85d9bb0-a0f0-46b3-9c97-58961e603482-kubelet-config\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.574739 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzx9x\" (UniqueName: \"kubernetes.io/projected/40ea14c6-cca7-4e29-89e7-12e1a626e0f5-kube-api-access-xzx9x\") pod \"node-ca-m7d55\" (UID: \"40ea14c6-cca7-4e29-89e7-12e1a626e0f5\") " pod="openshift-image-registry/node-ca-m7d55" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.574798 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret podName:c85d9bb0-a0f0-46b3-9c97-58961e603482 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:17.074777854 +0000 UTC m=+3.120165250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret") pod "global-pull-secret-syncer-9sm6h" (UID: "c85d9bb0-a0f0-46b3-9c97-58961e603482") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-sysctl-d\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40ea14c6-cca7-4e29-89e7-12e1a626e0f5-host\") pod \"node-ca-m7d55\" (UID: \"40ea14c6-cca7-4e29-89e7-12e1a626e0f5\") " pod="openshift-image-registry/node-ca-m7d55" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.574932 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40ea14c6-cca7-4e29-89e7-12e1a626e0f5-host\") pod \"node-ca-m7d55\" (UID: \"40ea14c6-cca7-4e29-89e7-12e1a626e0f5\") " pod="openshift-image-registry/node-ca-m7d55" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.575045 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40ea14c6-cca7-4e29-89e7-12e1a626e0f5-serviceca\") pod \"node-ca-m7d55\" (UID: \"40ea14c6-cca7-4e29-89e7-12e1a626e0f5\") " pod="openshift-image-registry/node-ca-m7d55" Jun 11 14:50:16.575060 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.575059 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-sysctl-d\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.577852 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.577815 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0e8f1d6-7502-4162-8f08-e702ec782a8b-etc-tuned\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.577852 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.577847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0e8f1d6-7502-4162-8f08-e702ec782a8b-tmp\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.582163 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.582129 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9hg4\" (UniqueName: \"kubernetes.io/projected/a0e8f1d6-7502-4162-8f08-e702ec782a8b-kube-api-access-d9hg4\") pod \"tuned-wwcq9\" (UID: \"a0e8f1d6-7502-4162-8f08-e702ec782a8b\") " pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.583382 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.583353 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzx9x\" (UniqueName: \"kubernetes.io/projected/40ea14c6-cca7-4e29-89e7-12e1a626e0f5-kube-api-access-xzx9x\") pod \"node-ca-m7d55\" (UID: \"40ea14c6-cca7-4e29-89e7-12e1a626e0f5\") " pod="openshift-image-registry/node-ca-m7d55" Jun 11 14:50:16.678559 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.678465 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:16.687563 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.687527 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7j6q2" Jun 11 14:50:16.696660 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.696622 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nx4z2" Jun 11 14:50:16.704413 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.704382 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sq4qw" Jun 11 14:50:16.713390 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.713354 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" Jun 11 14:50:16.721132 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.721100 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c4qkd" Jun 11 14:50:16.727965 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.727931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:16.736950 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.736921 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" Jun 11 14:50:16.742024 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.741990 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7d55" Jun 11 14:50:16.977725 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:16.977684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:16.977939 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.977822 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:16.977939 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:16.977893 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs podName:6c70a562-3b07-482e-bbaa-a285419c369b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:17.977878188 +0000 UTC m=+4.023265570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs") pod "network-metrics-daemon-chz6g" (UID: "6c70a562-3b07-482e-bbaa-a285419c369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:17.078356 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.078314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:17.078553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.078398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdp49\" (UniqueName: \"kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49\") pod \"network-check-target-8smqc\" (UID: \"f687b1bc-e135-4896-9e92-da097d66ddee\") " pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:17.078553 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:17.078492 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:17.078553 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:17.078521 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:17.078553 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:17.078540 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:17.078553 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:17.078551 2562 projected.go:196] Error preparing data for projected volume kube-api-access-vdp49 for pod openshift-network-diagnostics/network-check-target-8smqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:17.078769 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:17.078566 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret podName:c85d9bb0-a0f0-46b3-9c97-58961e603482 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:18.078544315 +0000 UTC m=+4.123931697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret") pod "global-pull-secret-syncer-9sm6h" (UID: "c85d9bb0-a0f0-46b3-9c97-58961e603482") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:17.078769 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:17.078593 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49 podName:f687b1bc-e135-4896-9e92-da097d66ddee nodeName:}" failed. No retries permitted until 2026-06-11 14:50:18.078582018 +0000 UTC m=+4.123969400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdp49" (UniqueName: "kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49") pod "network-check-target-8smqc" (UID: "f687b1bc-e135-4896-9e92-da097d66ddee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:17.277392 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:17.277357 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a0598fb_ea78_4888_9928_e431a8d3a74a.slice/crio-dee89ca4d5c6118d27f206ed80b5fee1f7e02aa6962c41ec661b2b0b39cd876b WatchSource:0}: Error finding container dee89ca4d5c6118d27f206ed80b5fee1f7e02aa6962c41ec661b2b0b39cd876b: Status 404 returned error can't find the container with id dee89ca4d5c6118d27f206ed80b5fee1f7e02aa6962c41ec661b2b0b39cd876b Jun 11 14:50:17.277810 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:17.277772 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e8f1d6_7502_4162_8f08_e702ec782a8b.slice/crio-6ffa17a008cbae4cce33c5cd09a8a6c9bb59ddd2b1444ec17389cde18cc926aa WatchSource:0}: Error finding container 6ffa17a008cbae4cce33c5cd09a8a6c9bb59ddd2b1444ec17389cde18cc926aa: Status 404 returned error can't find the container with id 6ffa17a008cbae4cce33c5cd09a8a6c9bb59ddd2b1444ec17389cde18cc926aa Jun 11 14:50:17.280492 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:17.280465 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc13586_9c50_4c1b_87cf_08a030e1adf0.slice/crio-a244cfa49b2d8ad7bc94a4e15bb293e5b87e0c29233d8f1d1159043cbdd6bc21 WatchSource:0}: Error finding container a244cfa49b2d8ad7bc94a4e15bb293e5b87e0c29233d8f1d1159043cbdd6bc21: Status 404 returned error can't find the container with id a244cfa49b2d8ad7bc94a4e15bb293e5b87e0c29233d8f1d1159043cbdd6bc21 Jun 11 14:50:17.281876 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:17.281848 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d14d01_5879_4aa4_96ae_8be3de77b473.slice/crio-db75bb83c0ff7fe280796d324301b63ce995b539302f0ec723cc0514af317ce7 WatchSource:0}: Error finding container db75bb83c0ff7fe280796d324301b63ce995b539302f0ec723cc0514af317ce7: Status 404 returned error can't find the container with id db75bb83c0ff7fe280796d324301b63ce995b539302f0ec723cc0514af317ce7 Jun 11 14:50:17.283804 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:17.283288 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904bf1fa_7b9c_4f76_853a_27c1ff19cb7b.slice/crio-f870a205550f2be094cc7e8c76ae6313ee99888271bffd006a1ad9e6111d5aff WatchSource:0}: Error finding container f870a205550f2be094cc7e8c76ae6313ee99888271bffd006a1ad9e6111d5aff: Status 404 returned error can't find the container with id f870a205550f2be094cc7e8c76ae6313ee99888271bffd006a1ad9e6111d5aff Jun 11 14:50:17.284776 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:17.284741 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7f7145_6dd1_4bcd_bc44_acd990a2d517.slice/crio-250117ec4d7fd78b673c89d75c697d52ccf6a055849749f0525b1b5ee67acc49 WatchSource:0}: Error finding container 250117ec4d7fd78b673c89d75c697d52ccf6a055849749f0525b1b5ee67acc49: Status 404 returned error can't find the container with id 250117ec4d7fd78b673c89d75c697d52ccf6a055849749f0525b1b5ee67acc49 Jun 11 14:50:17.285237 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:17.285211 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd316b1d3_e66c_44c9_abf6_0318431f3082.slice/crio-81267804a9b19e9843139068f225a8a0e6a8f70d85fceedcff9a7e0f01bd2e54 WatchSource:0}: Error finding container 81267804a9b19e9843139068f225a8a0e6a8f70d85fceedcff9a7e0f01bd2e54: Status 404 returned error can't find the container with id 81267804a9b19e9843139068f225a8a0e6a8f70d85fceedcff9a7e0f01bd2e54 Jun 11 14:50:17.286802 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:17.286027 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20387c0_94f0_42e5_ba1e_2f234b38c0a9.slice/crio-521edeb689ab687b4a7138bbe35fa910ede9381de51bc287b498e7fe6af75c05 WatchSource:0}: Error finding container 521edeb689ab687b4a7138bbe35fa910ede9381de51bc287b498e7fe6af75c05: Status 404 returned error can't find the container with id 521edeb689ab687b4a7138bbe35fa910ede9381de51bc287b498e7fe6af75c05 Jun 11 14:50:17.286802 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:17.286671 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ea14c6_cca7_4e29_89e7_12e1a626e0f5.slice/crio-ca7ac8e4f91025f6935655e952e6b256f84f0f42298e3f29f63d8a8b6a1548e5 WatchSource:0}: Error finding container ca7ac8e4f91025f6935655e952e6b256f84f0f42298e3f29f63d8a8b6a1548e5: Status 404 returned error can't find the container with id ca7ac8e4f91025f6935655e952e6b256f84f0f42298e3f29f63d8a8b6a1548e5 Jun 11 14:50:17.414009 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.413972 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:45:16 +0000 UTC" deadline="2028-02-26 21:05:44.220312098 +0000 UTC" Jun 11 14:50:17.414009 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.414000 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15006h15m26.806315046s" Jun 11 14:50:17.434844 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.434804 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sq4qw" event={"ID":"8c7f7145-6dd1-4bcd-bc44-acd990a2d517","Type":"ContainerStarted","Data":"250117ec4d7fd78b673c89d75c697d52ccf6a055849749f0525b1b5ee67acc49"} Jun 11 14:50:17.435736 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.435693 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c4qkd" event={"ID":"904bf1fa-7b9c-4f76-853a-27c1ff19cb7b","Type":"ContainerStarted","Data":"f870a205550f2be094cc7e8c76ae6313ee99888271bffd006a1ad9e6111d5aff"} Jun 11 14:50:17.436691 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.436670 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nx4z2" event={"ID":"73d14d01-5879-4aa4-96ae-8be3de77b473","Type":"ContainerStarted","Data":"db75bb83c0ff7fe280796d324301b63ce995b539302f0ec723cc0514af317ce7"} Jun 11 14:50:17.437721 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.437702 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" event={"ID":"edc13586-9c50-4c1b-87cf-08a030e1adf0","Type":"ContainerStarted","Data":"a244cfa49b2d8ad7bc94a4e15bb293e5b87e0c29233d8f1d1159043cbdd6bc21"} Jun 11 14:50:17.438692 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.438661 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" event={"ID":"a0e8f1d6-7502-4162-8f08-e702ec782a8b","Type":"ContainerStarted","Data":"6ffa17a008cbae4cce33c5cd09a8a6c9bb59ddd2b1444ec17389cde18cc926aa"} Jun 11 14:50:17.439672 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.439644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" event={"ID":"1a0598fb-ea78-4888-9928-e431a8d3a74a","Type":"ContainerStarted","Data":"dee89ca4d5c6118d27f206ed80b5fee1f7e02aa6962c41ec661b2b0b39cd876b"} Jun 11 14:50:17.441330 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.441298 2562 generic.go:356] "Generic (PLEG): container finished" podID="4942a1001bdf640f5ae6195853ad885b" containerID="b786182a8f9ae94f92fbddde44d84edd95f7871514e86364a7a22a07cc60ab75" exitCode=0 Jun 11 14:50:17.441450 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.441334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" event={"ID":"4942a1001bdf640f5ae6195853ad885b","Type":"ContainerDied","Data":"b786182a8f9ae94f92fbddde44d84edd95f7871514e86364a7a22a07cc60ab75"} Jun 11 14:50:17.442918 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.442895 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" event={"ID":"9c0bd5da9b4cc155444e674e4daae372","Type":"ContainerStarted","Data":"66743e422abfb542137525a3d25a61e05774ef7bfde7d2b965098b79637b29a9"} Jun 11 14:50:17.443991 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.443966 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lcsm9" event={"ID":"d316b1d3-e66c-44c9-abf6-0318431f3082","Type":"ContainerStarted","Data":"81267804a9b19e9843139068f225a8a0e6a8f70d85fceedcff9a7e0f01bd2e54"} Jun 11 14:50:17.445135 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.445113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j6q2" event={"ID":"e20387c0-94f0-42e5-ba1e-2f234b38c0a9","Type":"ContainerStarted","Data":"521edeb689ab687b4a7138bbe35fa910ede9381de51bc287b498e7fe6af75c05"} Jun 11 14:50:17.448343 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.446970 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7d55" event={"ID":"40ea14c6-cca7-4e29-89e7-12e1a626e0f5","Type":"ContainerStarted","Data":"ca7ac8e4f91025f6935655e952e6b256f84f0f42298e3f29f63d8a8b6a1548e5"} Jun 11 14:50:17.986994 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:17.986952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:17.987197 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:17.987160 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:17.987259 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:17.987243 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs podName:6c70a562-3b07-482e-bbaa-a285419c369b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:19.987221122 +0000 UTC m=+6.032608521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs") pod "network-metrics-daemon-chz6g" (UID: "6c70a562-3b07-482e-bbaa-a285419c369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:18.088921 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:18.088054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdp49\" (UniqueName: \"kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49\") pod \"network-check-target-8smqc\" (UID: \"f687b1bc-e135-4896-9e92-da097d66ddee\") " pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:18.088921 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:18.088116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:18.088921 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:18.088275 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:18.088921 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:18.088347 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret podName:c85d9bb0-a0f0-46b3-9c97-58961e603482 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:20.088327467 +0000 UTC m=+6.133714866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret") pod "global-pull-secret-syncer-9sm6h" (UID: "c85d9bb0-a0f0-46b3-9c97-58961e603482") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:18.088921 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:18.088796 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:18.088921 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:18.088816 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:18.088921 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:18.088828 2562 projected.go:196] Error preparing data for projected volume kube-api-access-vdp49 for pod openshift-network-diagnostics/network-check-target-8smqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:18.088921 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:18.088881 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49 podName:f687b1bc-e135-4896-9e92-da097d66ddee nodeName:}" failed. No retries permitted until 2026-06-11 14:50:20.088864623 +0000 UTC m=+6.134252011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdp49" (UniqueName: "kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49") pod "network-check-target-8smqc" (UID: "f687b1bc-e135-4896-9e92-da097d66ddee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:18.415107 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:18.414956 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:45:16 +0000 UTC" deadline="2028-02-07 14:43:43.367197571 +0000 UTC" Jun 11 14:50:18.415107 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:18.415018 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14543h53m24.952183752s" Jun 11 14:50:18.426459 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:18.426182 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:18.426459 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:18.426310 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:18.426696 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:18.426619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:18.426749 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:18.426726 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:18.426800 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:18.426788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:18.428670 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:18.426876 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:18.472109 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:18.472061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" event={"ID":"4942a1001bdf640f5ae6195853ad885b","Type":"ContainerStarted","Data":"fcd7915b43b11ca1e5cf010f39b1859fcc361275d360dadedf1a1bc993f352be"} Jun 11 14:50:18.488171 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:18.487008 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" podStartSLOduration=3.486982793 podStartE2EDuration="3.486982793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:17.476502172 +0000 UTC m=+3.521889576" watchObservedRunningTime="2026-06-11 14:50:18.486982793 +0000 UTC m=+4.532370197" Jun 11 14:50:20.004704 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:20.004664 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:20.005157 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:20.004800 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:20.005157 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:20.004879 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs podName:6c70a562-3b07-482e-bbaa-a285419c369b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:24.004856341 +0000 UTC m=+10.050243734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs") pod "network-metrics-daemon-chz6g" (UID: "6c70a562-3b07-482e-bbaa-a285419c369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:20.105871 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:20.105813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdp49\" (UniqueName: \"kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49\") pod \"network-check-target-8smqc\" (UID: \"f687b1bc-e135-4896-9e92-da097d66ddee\") " pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:20.105871 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:20.105874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:20.106114 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:20.105999 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:20.106114 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:20.106060 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret podName:c85d9bb0-a0f0-46b3-9c97-58961e603482 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:24.106043767 +0000 UTC m=+10.151431152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret") pod "global-pull-secret-syncer-9sm6h" (UID: "c85d9bb0-a0f0-46b3-9c97-58961e603482") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:20.106739 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:20.106531 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:20.106739 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:20.106559 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:20.106739 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:20.106572 2562 projected.go:196] Error preparing data for projected volume kube-api-access-vdp49 for pod openshift-network-diagnostics/network-check-target-8smqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:20.106739 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:20.106622 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49 podName:f687b1bc-e135-4896-9e92-da097d66ddee nodeName:}" failed. No retries permitted until 2026-06-11 14:50:24.106606173 +0000 UTC m=+10.151993556 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdp49" (UniqueName: "kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49") pod "network-check-target-8smqc" (UID: "f687b1bc-e135-4896-9e92-da097d66ddee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:20.425873 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:20.425724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:20.425873 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:20.425757 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:20.425873 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:20.425790 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:20.426092 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:20.425898 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:20.426356 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:20.426332 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:20.426462 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:20.426413 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:22.426501 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:22.426412 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:22.426995 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:22.426417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:22.426995 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:22.426561 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:22.426995 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:22.426558 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:22.426995 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:22.426633 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:22.426995 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:22.426690 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:24.042272 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:24.042229 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:24.042725 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:24.042380 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:24.042725 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:24.042483 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs podName:6c70a562-3b07-482e-bbaa-a285419c369b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:32.042460945 +0000 UTC m=+18.087848333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs") pod "network-metrics-daemon-chz6g" (UID: "6c70a562-3b07-482e-bbaa-a285419c369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:24.144828 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:24.144786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdp49\" (UniqueName: \"kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49\") pod \"network-check-target-8smqc\" (UID: \"f687b1bc-e135-4896-9e92-da097d66ddee\") " pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:24.145000 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:24.144837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:24.145000 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:24.144944 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:24.145000 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:24.144969 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:24.145000 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:24.144995 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:24.145000 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:24.145005 2562 projected.go:196] Error preparing data for projected volume kube-api-access-vdp49 for pod openshift-network-diagnostics/network-check-target-8smqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:24.145236 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:24.145011 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret podName:c85d9bb0-a0f0-46b3-9c97-58961e603482 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:32.14499308 +0000 UTC m=+18.190380479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret") pod "global-pull-secret-syncer-9sm6h" (UID: "c85d9bb0-a0f0-46b3-9c97-58961e603482") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:24.145236 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:24.145056 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49 podName:f687b1bc-e135-4896-9e92-da097d66ddee nodeName:}" failed. No retries permitted until 2026-06-11 14:50:32.145043364 +0000 UTC m=+18.190430750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdp49" (UniqueName: "kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49") pod "network-check-target-8smqc" (UID: "f687b1bc-e135-4896-9e92-da097d66ddee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:24.426510 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:24.426058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:24.426510 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:24.426141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:24.426510 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:24.426152 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:24.426510 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:24.426254 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:24.426510 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:24.426287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:24.426510 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:24.426373 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:26.426156 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:26.426121 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:26.426767 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:26.426121 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:26.426767 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:26.426255 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:26.426767 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:26.426296 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:26.426767 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:26.426124 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:26.426767 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:26.426424 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:28.429673 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:28.429640 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:28.430125 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:28.429768 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:28.430187 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:28.430159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:28.430236 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:28.430220 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:28.430268 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:28.430258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:28.430332 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:28.430315 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:30.425491 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:30.425449 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:30.425931 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:30.425595 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:30.425931 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:30.425447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:30.425931 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:30.425704 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:30.425931 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:30.425449 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:30.425931 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:30.425789 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:32.107212 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:32.107003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:32.107680 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:32.107159 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:32.107680 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:32.107344 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs podName:6c70a562-3b07-482e-bbaa-a285419c369b nodeName:}" failed. No retries permitted until 2026-06-11 14:50:48.107324743 +0000 UTC m=+34.152712127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs") pod "network-metrics-daemon-chz6g" (UID: "6c70a562-3b07-482e-bbaa-a285419c369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:32.207770 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:32.207731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdp49\" (UniqueName: \"kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49\") pod \"network-check-target-8smqc\" (UID: \"f687b1bc-e135-4896-9e92-da097d66ddee\") " pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:32.207948 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:32.207782 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:32.207948 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:32.207900 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:32.207948 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:32.207935 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:32.208120 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:32.207963 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret podName:c85d9bb0-a0f0-46b3-9c97-58961e603482 nodeName:}" failed. No retries permitted until 2026-06-11 14:50:48.207946074 +0000 UTC m=+34.253333457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret") pod "global-pull-secret-syncer-9sm6h" (UID: "c85d9bb0-a0f0-46b3-9c97-58961e603482") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:32.208120 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:32.207965 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:32.208120 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:32.207985 2562 projected.go:196] Error preparing data for projected volume kube-api-access-vdp49 for pod openshift-network-diagnostics/network-check-target-8smqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:32.208120 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:32.208050 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49 podName:f687b1bc-e135-4896-9e92-da097d66ddee nodeName:}" failed. No retries permitted until 2026-06-11 14:50:48.208033838 +0000 UTC m=+34.253421242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdp49" (UniqueName: "kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49") pod "network-check-target-8smqc" (UID: "f687b1bc-e135-4896-9e92-da097d66ddee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:32.425918 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:32.425845 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:32.426062 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:32.425856 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:32.426062 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:32.425957 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:32.426155 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:32.426068 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:32.426155 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:32.425862 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:32.426222 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:32.426170 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:34.426184 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:34.426145 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:34.426671 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:34.426227 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:34.426671 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:34.426235 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:34.426671 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:34.426364 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:34.426671 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:34.426397 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:34.426671 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:34.426483 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:36.426162 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.425976 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:36.426941 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.425975 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:36.426941 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:36.426248 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:36.426941 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:36.426302 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:36.426941 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.426006 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:36.426941 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:36.426404 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:36.523884 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.523814 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 14:50:36.524194 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.524163 2562 generic.go:356] "Generic (PLEG): container finished" podID="edc13586-9c50-4c1b-87cf-08a030e1adf0" containerID="609c1f598db251ebb676c1015c29d56e03b27f110ca49aa37401f3c83f2896cc" exitCode=1 Jun 11 14:50:36.524266 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.524241 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" event={"ID":"edc13586-9c50-4c1b-87cf-08a030e1adf0","Type":"ContainerStarted","Data":"e25cf5b169da268994f01007e183a7c3c0c71a412835c592f8ee904481c4d671"} Jun 11 14:50:36.524321 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.524310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" event={"ID":"edc13586-9c50-4c1b-87cf-08a030e1adf0","Type":"ContainerStarted","Data":"dffb0ba50421943bad1062ab9c3afba21487f69a58b3182d4282e8af5c9247be"} Jun 11 14:50:36.524373 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.524361 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" event={"ID":"edc13586-9c50-4c1b-87cf-08a030e1adf0","Type":"ContainerStarted","Data":"f2199d1a6b4f8cf8c6306336efa8c935970fe0f7ad9cf270aced2d12f416afad"} Jun 11 14:50:36.524416 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.524394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" event={"ID":"edc13586-9c50-4c1b-87cf-08a030e1adf0","Type":"ContainerDied","Data":"609c1f598db251ebb676c1015c29d56e03b27f110ca49aa37401f3c83f2896cc"} Jun 11 14:50:36.524527 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.524423 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" event={"ID":"edc13586-9c50-4c1b-87cf-08a030e1adf0","Type":"ContainerStarted","Data":"7159b31a52dcb316c3028e468847470f3a051db70a34e12057899c5d37881e11"} Jun 11 14:50:36.525817 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.525707 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" event={"ID":"a0e8f1d6-7502-4162-8f08-e702ec782a8b","Type":"ContainerStarted","Data":"4e8165b27638f147ac8dd58648e662dc9064b85f2b5a8df527874ae18a6b0612"} Jun 11 14:50:36.527214 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.527189 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" event={"ID":"1a0598fb-ea78-4888-9928-e431a8d3a74a","Type":"ContainerStarted","Data":"4923f3dce5aa356382ab2892f4ff41a27fed78b1d63ebc8abe2d8a80ca499458"} Jun 11 14:50:36.528668 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.528609 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lcsm9" event={"ID":"d316b1d3-e66c-44c9-abf6-0318431f3082","Type":"ContainerStarted","Data":"999369ce00ee8b5826a8f46459169a7e05eba3c45bdd2b5a8561fa6ca50ef742"} Jun 11 14:50:36.530359 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.530334 2562 generic.go:356] "Generic (PLEG): container finished" podID="e20387c0-94f0-42e5-ba1e-2f234b38c0a9" containerID="21c21df3ce0a1f8b40a124df1e7b249bac0abeec39a32cba775961bdc7aaec81" exitCode=0 Jun 11 14:50:36.530494 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.530365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j6q2" event={"ID":"e20387c0-94f0-42e5-ba1e-2f234b38c0a9","Type":"ContainerDied","Data":"21c21df3ce0a1f8b40a124df1e7b249bac0abeec39a32cba775961bdc7aaec81"} Jun 11 14:50:36.531934 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.531875 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7d55" event={"ID":"40ea14c6-cca7-4e29-89e7-12e1a626e0f5","Type":"ContainerStarted","Data":"c107c3271e57707ebfa498b5c714d2ce0100a3da03e3a6b214608e1b796b661b"} Jun 11 14:50:36.533711 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.533339 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sq4qw" event={"ID":"8c7f7145-6dd1-4bcd-bc44-acd990a2d517","Type":"ContainerStarted","Data":"b7126652c1b80bc3a7d617c640ff5e5c86fc03762361844c5199bf64e3cc4942"} Jun 11 14:50:36.535075 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.535042 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nx4z2" event={"ID":"73d14d01-5879-4aa4-96ae-8be3de77b473","Type":"ContainerStarted","Data":"11d562a452853b385b018ff6e8b605d15f7adbc5aa8fd94f2d4a7b493adff38b"} Jun 11 14:50:36.540361 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.540309 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wwcq9" podStartSLOduration=4.120683463 podStartE2EDuration="22.540265079s" totalImagesPullingTime="18.419581616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:36.540163665 +0000 UTC m=+22.585551069" watchObservedRunningTime="2026-06-11 14:50:36.540265079 +0000 UTC m=+22.585652465" Jun 11 14:50:36.540606 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.540573 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" podStartSLOduration=21.540561403 podStartE2EDuration="21.540561403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:18.488142503 +0000 UTC m=+4.533529908" watchObservedRunningTime="2026-06-11 14:50:36.540561403 +0000 UTC m=+22.585948808" Jun 11 14:50:36.580277 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.580208 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lcsm9" podStartSLOduration=8.596184664 podStartE2EDuration="22.580191509s" totalImagesPullingTime="13.984006845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:36.553826293 +0000 UTC m=+22.599213693" watchObservedRunningTime="2026-06-11 14:50:36.580191509 +0000 UTC m=+22.625578912" Jun 11 14:50:36.606667 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.606617 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m7d55" podStartSLOduration=4.223778569 podStartE2EDuration="22.606600989s" totalImagesPullingTime="18.38282242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:36.606281779 +0000 UTC m=+22.651669180" watchObservedRunningTime="2026-06-11 14:50:36.606600989 +0000 UTC m=+22.651988392" Jun 11 14:50:36.634583 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.634529 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nx4z2" podStartSLOduration=4.206236604 podStartE2EDuration="22.634512703s" totalImagesPullingTime="18.428276099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:36.634387642 +0000 UTC m=+22.679775048" watchObservedRunningTime="2026-06-11 14:50:36.634512703 +0000 UTC m=+22.679900106" Jun 11 14:50:36.654838 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:36.654774 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sq4qw" podStartSLOduration=4.43203953 podStartE2EDuration="22.654757688s" totalImagesPullingTime="18.222718158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:36.6543268 +0000 UTC m=+22.699714205" watchObservedRunningTime="2026-06-11 14:50:36.654757688 +0000 UTC m=+22.700145091" Jun 11 14:50:37.271029 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:37.270869 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 14:50:37.428262 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:37.428074 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T14:50:37.271020956Z","UUID":"61390fa8-17e0-4f28-a089-490316320918","Handler":null,"Name":"","Endpoint":""} Jun 11 14:50:37.429896 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:37.429868 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 14:50:37.430051 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:37.429909 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 14:50:37.539831 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:37.539802 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 14:50:37.540157 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:37.540132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" event={"ID":"edc13586-9c50-4c1b-87cf-08a030e1adf0","Type":"ContainerStarted","Data":"22dcd320bda679c60ff3728eca43d750bd1138239bb26bef94b190595e94e7a7"} Jun 11 14:50:37.541651 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:37.541621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" event={"ID":"1a0598fb-ea78-4888-9928-e431a8d3a74a","Type":"ContainerStarted","Data":"62a6a2209da42183b534972806e02ba24a3b8160776f009b5fcd7e6c82316bf6"} Jun 11 14:50:37.543086 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:37.543059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c4qkd" event={"ID":"904bf1fa-7b9c-4f76-853a-27c1ff19cb7b","Type":"ContainerStarted","Data":"6447541b8b54d2c5ed0b939657f347588cc21c6812f071ef026dd062fcfa51e8"} Jun 11 14:50:37.558071 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:37.558020 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c4qkd" podStartSLOduration=5.333439202 podStartE2EDuration="23.558001495s" totalImagesPullingTime="18.224562293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:37.557459534 +0000 UTC m=+23.602846940" watchObservedRunningTime="2026-06-11 14:50:37.558001495 +0000 UTC m=+23.603388897" Jun 11 14:50:38.426007 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:38.425970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:38.426204 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:38.425970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:38.426204 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:38.426113 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:38.426204 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:38.425970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:38.426204 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:38.426185 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:38.426403 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:38.426251 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:38.548304 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:38.548263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" event={"ID":"1a0598fb-ea78-4888-9928-e431a8d3a74a","Type":"ContainerStarted","Data":"acfbfd52f73a3c0d8640bda405a6ce8b24c9534debb3d639b7bce45563e063bb"} Jun 11 14:50:38.565787 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:38.565718 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc76w" podStartSLOduration=3.967828683 podStartE2EDuration="24.565701975s" totalImagesPullingTime="20.597873292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:38.565457548 +0000 UTC m=+24.610844949" watchObservedRunningTime="2026-06-11 14:50:38.565701975 +0000 UTC m=+24.611089379" Jun 11 14:50:39.554466 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:39.554411 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 14:50:39.555489 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:39.555419 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" event={"ID":"edc13586-9c50-4c1b-87cf-08a030e1adf0","Type":"ContainerStarted","Data":"b045ff151caa949b05adde783bffe9b560a4c56ccb0b64d350b52918c8af5fef"} Jun 11 14:50:39.927051 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:39.926961 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:39.928165 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:39.928139 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:40.425878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:40.425847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:40.426107 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:40.425847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:40.426107 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:40.425995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:40.426107 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:40.425991 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:40.426107 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:40.426096 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:40.426301 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:40.426162 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:40.557855 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:40.557825 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:40.558363 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:40.558344 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lcsm9" Jun 11 14:50:41.561836 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:41.561639 2562 generic.go:356] "Generic (PLEG): container finished" podID="e20387c0-94f0-42e5-ba1e-2f234b38c0a9" containerID="3b563ecd59c520ec751c48a8c0f6eb9961ee1471247aad927edd0f0a4f8242ee" exitCode=0 Jun 11 14:50:41.562576 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:41.561726 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j6q2" event={"ID":"e20387c0-94f0-42e5-ba1e-2f234b38c0a9","Type":"ContainerDied","Data":"3b563ecd59c520ec751c48a8c0f6eb9961ee1471247aad927edd0f0a4f8242ee"} Jun 11 14:50:41.565457 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:41.565417 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 14:50:41.565860 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:41.565835 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" event={"ID":"edc13586-9c50-4c1b-87cf-08a030e1adf0","Type":"ContainerStarted","Data":"d07d302d56ce3b5e75dc049523765db71ae4552d1fc16ae16682bf8a63a8edc7"} Jun 11 14:50:41.566308 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:41.566286 2562 scope.go:117] "RemoveContainer" containerID="609c1f598db251ebb676c1015c29d56e03b27f110ca49aa37401f3c83f2896cc" Jun 11 14:50:42.425414 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.425377 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:42.425631 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.425377 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:42.425631 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.425531 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:42.425631 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:42.425559 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:42.425631 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:42.425613 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:42.425824 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:42.425667 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:42.571707 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.571674 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 14:50:42.572255 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.572043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" event={"ID":"edc13586-9c50-4c1b-87cf-08a030e1adf0","Type":"ContainerStarted","Data":"6e2ae3355847f38c41475b2b3f906612581b9ef39fc355f4cc2beee5649460bc"} Jun 11 14:50:42.572467 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.572446 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:42.572564 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.572519 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:42.572624 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.572566 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:42.590965 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.590936 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:42.591137 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.591048 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:50:42.599213 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.599159 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" podStartSLOduration=10.126375701 podStartE2EDuration="28.599142834s" totalImagesPullingTime="18.472767133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:42.597728967 +0000 UTC m=+28.643116373" watchObservedRunningTime="2026-06-11 14:50:42.599142834 +0000 UTC m=+28.644530256" Jun 11 14:50:42.984446 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.984388 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8smqc"] Jun 11 14:50:42.984618 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.984551 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:42.984698 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:42.984659 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:42.987861 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.987812 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9sm6h"] Jun 11 14:50:42.988015 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.987960 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:42.988094 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:42.988072 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:42.988348 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.988328 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-chz6g"] Jun 11 14:50:42.988484 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:42.988454 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:42.988607 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:42.988570 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:43.575773 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:43.575737 2562 generic.go:356] "Generic (PLEG): container finished" podID="e20387c0-94f0-42e5-ba1e-2f234b38c0a9" containerID="e055e21bd28bb0841ab7c72e88d780318963d4709984d79a1628586d3035ed61" exitCode=0 Jun 11 14:50:43.576215 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:43.575815 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j6q2" event={"ID":"e20387c0-94f0-42e5-ba1e-2f234b38c0a9","Type":"ContainerDied","Data":"e055e21bd28bb0841ab7c72e88d780318963d4709984d79a1628586d3035ed61"} Jun 11 14:50:44.426418 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:44.426202 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:44.426614 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:44.426265 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:44.426614 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:44.426519 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:44.426614 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:44.426298 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:44.426614 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:44.426580 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:44.426831 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:44.426629 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:45.583288 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:45.583252 2562 generic.go:356] "Generic (PLEG): container finished" podID="e20387c0-94f0-42e5-ba1e-2f234b38c0a9" containerID="e359e9f3513c380486283d09eb609961a4b7318a17f90d527b231dc1e2b1945a" exitCode=0 Jun 11 14:50:45.583702 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:45.583310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j6q2" event={"ID":"e20387c0-94f0-42e5-ba1e-2f234b38c0a9","Type":"ContainerDied","Data":"e359e9f3513c380486283d09eb609961a4b7318a17f90d527b231dc1e2b1945a"} Jun 11 14:50:46.425796 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:46.425765 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:46.425971 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:46.425764 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:46.425971 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:46.425892 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:46.425971 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:46.425777 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:46.426107 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:46.425980 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:46.426107 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:46.426050 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:48.125314 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.125268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:48.125851 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:48.125453 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:48.125851 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:48.125519 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs podName:6c70a562-3b07-482e-bbaa-a285419c369b nodeName:}" failed. No retries permitted until 2026-06-11 14:51:20.125504745 +0000 UTC m=+66.170892128 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs") pod "network-metrics-daemon-chz6g" (UID: "6c70a562-3b07-482e-bbaa-a285419c369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:50:48.226149 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.226106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdp49\" (UniqueName: \"kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49\") pod \"network-check-target-8smqc\" (UID: \"f687b1bc-e135-4896-9e92-da097d66ddee\") " pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:48.226149 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.226157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:48.226412 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:48.226271 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:48.226412 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:48.226301 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:50:48.226412 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:48.226326 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:50:48.226412 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:48.226337 2562 projected.go:196] Error preparing data for projected volume kube-api-access-vdp49 for pod openshift-network-diagnostics/network-check-target-8smqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:48.226412 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:48.226339 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret podName:c85d9bb0-a0f0-46b3-9c97-58961e603482 nodeName:}" failed. No retries permitted until 2026-06-11 14:51:20.226320401 +0000 UTC m=+66.271707790 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret") pod "global-pull-secret-syncer-9sm6h" (UID: "c85d9bb0-a0f0-46b3-9c97-58961e603482") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:50:48.226412 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:48.226378 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49 podName:f687b1bc-e135-4896-9e92-da097d66ddee nodeName:}" failed. No retries permitted until 2026-06-11 14:51:20.226366589 +0000 UTC m=+66.271753971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdp49" (UniqueName: "kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49") pod "network-check-target-8smqc" (UID: "f687b1bc-e135-4896-9e92-da097d66ddee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:50:48.426074 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.426037 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:48.426251 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.426037 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:48.426251 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:48.426154 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sm6h" podUID="c85d9bb0-a0f0-46b3-9c97-58961e603482" Jun 11 14:50:48.426328 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.426038 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:48.426328 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:48.426280 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:50:48.426391 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:48.426351 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8smqc" podUID="f687b1bc-e135-4896-9e92-da097d66ddee" Jun 11 14:50:48.754961 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.754926 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeReady" Jun 11 14:50:48.755144 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.755107 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 14:50:48.793021 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.792983 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-858c5d4694-6j4x4"] Jun 11 14:50:48.820804 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.820769 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7wn45"] Jun 11 14:50:48.820995 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.820884 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:48.823296 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.823269 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 14:50:48.823507 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.823423 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 14:50:48.823703 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.823684 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zx6z7\"" Jun 11 14:50:48.823817 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.823723 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 14:50:48.830824 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.830787 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 14:50:48.836734 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.836703 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-858c5d4694-6j4x4"] Jun 11 14:50:48.836896 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.836753 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hk7zh"] Jun 11 14:50:48.836896 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.836847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:48.840734 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.840701 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 14:50:48.840882 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.840849 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5zf7p\"" Jun 11 14:50:48.845093 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.844689 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 14:50:48.854198 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.854156 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7wn45"] Jun 11 14:50:48.854366 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.854208 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hk7zh"] Jun 11 14:50:48.854366 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.854278 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hk7zh" Jun 11 14:50:48.857197 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.857151 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 14:50:48.857462 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.857271 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 14:50:48.857462 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.857365 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zgb64\"" Jun 11 14:50:48.857462 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.857456 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 14:50:48.932567 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932527 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmsjp\" (UniqueName: \"kubernetes.io/projected/36b795d5-21e0-40ca-a94e-e268fca1e2a5-kube-api-access-rmsjp\") pod \"ingress-canary-hk7zh\" (UID: \"36b795d5-21e0-40ca-a94e-e268fca1e2a5\") " pod="openshift-ingress-canary/ingress-canary-hk7zh" Jun 11 14:50:48.932567 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-image-registry-private-configuration\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:48.932790 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932604 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/493f3b97-15ec-48bb-98ee-418ade520c8f-ca-trust-extracted\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:48.932790 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:48.932790 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv6f6\" (UniqueName: \"kubernetes.io/projected/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-kube-api-access-qv6f6\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:48.932790 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-trusted-ca\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:48.932790 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36b795d5-21e0-40ca-a94e-e268fca1e2a5-cert\") pod \"ingress-canary-hk7zh\" (UID: \"36b795d5-21e0-40ca-a94e-e268fca1e2a5\") " pod="openshift-ingress-canary/ingress-canary-hk7zh" Jun 11 14:50:48.932790 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-certificates\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:48.933156 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932836 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-installation-pull-secrets\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:48.933156 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:48.933156 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932884 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-tmp-dir\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:48.933156 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.932904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jqn9\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-kube-api-access-7jqn9\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:48.933156 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.933013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-config-volume\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:48.933156 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.933065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-bound-sa-token\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:48.938793 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:48.938752 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lcsm9_d316b1d3-e66c-44c9-abf6-0318431f3082/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:49.034163 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-tmp-dir\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:49.034163 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jqn9\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-kube-api-access-7jqn9\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.034163 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034139 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-config-volume\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:49.034163 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-bound-sa-token\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.034553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmsjp\" (UniqueName: \"kubernetes.io/projected/36b795d5-21e0-40ca-a94e-e268fca1e2a5-kube-api-access-rmsjp\") pod \"ingress-canary-hk7zh\" (UID: \"36b795d5-21e0-40ca-a94e-e268fca1e2a5\") " pod="openshift-ingress-canary/ingress-canary-hk7zh" Jun 11 14:50:49.034553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-image-registry-private-configuration\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.034553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034378 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/493f3b97-15ec-48bb-98ee-418ade520c8f-ca-trust-extracted\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.034553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:49.034553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv6f6\" (UniqueName: \"kubernetes.io/projected/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-kube-api-access-qv6f6\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:49.034553 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-trusted-ca\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36b795d5-21e0-40ca-a94e-e268fca1e2a5-cert\") pod \"ingress-canary-hk7zh\" (UID: \"36b795d5-21e0-40ca-a94e-e268fca1e2a5\") " pod="openshift-ingress-canary/ingress-canary-hk7zh" Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-certificates\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-installation-pull-secrets\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-tmp-dir\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:49.034760 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:49.034774 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858c5d4694-6j4x4: secret "image-registry-tls" not found Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:49.034790 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034814 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/493f3b97-15ec-48bb-98ee-418ade520c8f-ca-trust-extracted\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:49.034834 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls podName:493f3b97-15ec-48bb-98ee-418ade520c8f nodeName:}" failed. No retries permitted until 2026-06-11 14:50:49.53481819 +0000 UTC m=+35.580205572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls") pod "image-registry-858c5d4694-6j4x4" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f") : secret "image-registry-tls" not found Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.034829 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-config-volume\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:49.034859 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:49.034864 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls podName:baa10ca3-dc20-47bd-a6b3-38e10bac1b3e nodeName:}" failed. No retries permitted until 2026-06-11 14:50:49.534844662 +0000 UTC m=+35.580232046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls") pod "dns-default-7wn45" (UID: "baa10ca3-dc20-47bd-a6b3-38e10bac1b3e") : secret "dns-default-metrics-tls" not found Jun 11 14:50:49.035424 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.035300 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-certificates\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.035878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.035838 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-trusted-ca\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.037641 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.037564 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lcsm9_d316b1d3-e66c-44c9-abf6-0318431f3082/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:49.039296 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.039269 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-image-registry-private-configuration\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.039296 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.039295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36b795d5-21e0-40ca-a94e-e268fca1e2a5-cert\") pod \"ingress-canary-hk7zh\" (UID: \"36b795d5-21e0-40ca-a94e-e268fca1e2a5\") " pod="openshift-ingress-canary/ingress-canary-hk7zh" Jun 11 14:50:49.039465 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.039278 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-installation-pull-secrets\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.043942 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.043910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jqn9\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-kube-api-access-7jqn9\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.044118 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.044068 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmsjp\" (UniqueName: \"kubernetes.io/projected/36b795d5-21e0-40ca-a94e-e268fca1e2a5-kube-api-access-rmsjp\") pod \"ingress-canary-hk7zh\" (UID: \"36b795d5-21e0-40ca-a94e-e268fca1e2a5\") " pod="openshift-ingress-canary/ingress-canary-hk7zh" Jun 11 14:50:49.044185 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.044146 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv6f6\" (UniqueName: \"kubernetes.io/projected/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-kube-api-access-qv6f6\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:49.044932 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.044909 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-bound-sa-token\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.164487 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.164421 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hk7zh" Jun 11 14:50:49.538972 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.538921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:49.539143 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.538987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:49.539143 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:49.539057 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:50:49.539143 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:49.539128 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:50:49.539532 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:49.539148 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858c5d4694-6j4x4: secret "image-registry-tls" not found Jun 11 14:50:49.539532 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:49.539136 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls podName:baa10ca3-dc20-47bd-a6b3-38e10bac1b3e nodeName:}" failed. No retries permitted until 2026-06-11 14:50:50.539114132 +0000 UTC m=+36.584501514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls") pod "dns-default-7wn45" (UID: "baa10ca3-dc20-47bd-a6b3-38e10bac1b3e") : secret "dns-default-metrics-tls" not found Jun 11 14:50:49.539532 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:49.539222 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls podName:493f3b97-15ec-48bb-98ee-418ade520c8f nodeName:}" failed. No retries permitted until 2026-06-11 14:50:50.539207965 +0000 UTC m=+36.584595347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls") pod "image-registry-858c5d4694-6j4x4" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f") : secret "image-registry-tls" not found Jun 11 14:50:49.624514 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:49.624236 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hk7zh"] Jun 11 14:50:49.664786 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:50:49.664755 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b795d5_21e0_40ca_a94e_e268fca1e2a5.slice/crio-e5adb0d394a312853c71888728b2f62d249b0b7a04af6b102b9a7bf4f474041e WatchSource:0}: Error finding container e5adb0d394a312853c71888728b2f62d249b0b7a04af6b102b9a7bf4f474041e: Status 404 returned error can't find the container with id e5adb0d394a312853c71888728b2f62d249b0b7a04af6b102b9a7bf4f474041e Jun 11 14:50:50.425617 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.425580 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:50:50.426255 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.425580 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:50:50.426255 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.425593 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:50:50.429065 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.428589 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:50:50.430069 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.429935 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:50:50.430069 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.430033 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:50:50.430378 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.430160 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fhnff\"" Jun 11 14:50:50.430378 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.430267 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rtqf6\"" Jun 11 14:50:50.430522 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.430513 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:50:50.545077 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.545043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:50.545276 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.545095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:50.545276 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:50.545218 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:50:50.545276 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:50.545230 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858c5d4694-6j4x4: secret "image-registry-tls" not found Jun 11 14:50:50.545276 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:50.545238 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:50:50.545506 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:50.545286 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls podName:493f3b97-15ec-48bb-98ee-418ade520c8f nodeName:}" failed. No retries permitted until 2026-06-11 14:50:52.545267132 +0000 UTC m=+38.590654533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls") pod "image-registry-858c5d4694-6j4x4" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f") : secret "image-registry-tls" not found Jun 11 14:50:50.545506 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:50.545298 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls podName:baa10ca3-dc20-47bd-a6b3-38e10bac1b3e nodeName:}" failed. No retries permitted until 2026-06-11 14:50:52.545292917 +0000 UTC m=+38.590680299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls") pod "dns-default-7wn45" (UID: "baa10ca3-dc20-47bd-a6b3-38e10bac1b3e") : secret "dns-default-metrics-tls" not found Jun 11 14:50:50.600501 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.600458 2562 generic.go:356] "Generic (PLEG): container finished" podID="e20387c0-94f0-42e5-ba1e-2f234b38c0a9" containerID="15b439ce12f9a409f4e6ee123b50b292de76fca2dabdd063ec8be002b5cf2c25" exitCode=0 Jun 11 14:50:50.600675 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.600535 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j6q2" event={"ID":"e20387c0-94f0-42e5-ba1e-2f234b38c0a9","Type":"ContainerDied","Data":"15b439ce12f9a409f4e6ee123b50b292de76fca2dabdd063ec8be002b5cf2c25"} Jun 11 14:50:50.606010 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.605918 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hk7zh" event={"ID":"36b795d5-21e0-40ca-a94e-e268fca1e2a5","Type":"ContainerStarted","Data":"e5adb0d394a312853c71888728b2f62d249b0b7a04af6b102b9a7bf4f474041e"} Jun 11 14:50:50.976484 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:50.976450 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lcsm9_d316b1d3-e66c-44c9-abf6-0318431f3082/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:51.611580 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:51.611546 2562 generic.go:356] "Generic (PLEG): container finished" podID="e20387c0-94f0-42e5-ba1e-2f234b38c0a9" containerID="5e9a5d627266f8c64ac8ca540d5fa826d17bf4eb0f36f31545c8b0e7d83cf2e0" exitCode=0 Jun 11 14:50:51.612258 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:51.611617 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j6q2" event={"ID":"e20387c0-94f0-42e5-ba1e-2f234b38c0a9","Type":"ContainerDied","Data":"5e9a5d627266f8c64ac8ca540d5fa826d17bf4eb0f36f31545c8b0e7d83cf2e0"} Jun 11 14:50:52.001192 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:52.001150 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lcsm9_d316b1d3-e66c-44c9-abf6-0318431f3082/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:52.103298 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:52.103110 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lcsm9_d316b1d3-e66c-44c9-abf6-0318431f3082/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:52.559339 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:52.559307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:52.559488 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:52.559354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:52.559488 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:52.559459 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:50:52.559488 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:52.559467 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:50:52.559585 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:52.559522 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls podName:baa10ca3-dc20-47bd-a6b3-38e10bac1b3e nodeName:}" failed. No retries permitted until 2026-06-11 14:50:56.559508532 +0000 UTC m=+42.604895914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls") pod "dns-default-7wn45" (UID: "baa10ca3-dc20-47bd-a6b3-38e10bac1b3e") : secret "dns-default-metrics-tls" not found Jun 11 14:50:52.559585 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:52.559469 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858c5d4694-6j4x4: secret "image-registry-tls" not found Jun 11 14:50:52.559654 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:52.559599 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls podName:493f3b97-15ec-48bb-98ee-418ade520c8f nodeName:}" failed. No retries permitted until 2026-06-11 14:50:56.559584664 +0000 UTC m=+42.604972046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls") pod "image-registry-858c5d4694-6j4x4" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f") : secret "image-registry-tls" not found Jun 11 14:50:52.617860 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:52.617820 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j6q2" event={"ID":"e20387c0-94f0-42e5-ba1e-2f234b38c0a9","Type":"ContainerStarted","Data":"49a1947731bceb0df6891f5b408710fee0e6c35ee78e9d0d0127452c7790c709"} Jun 11 14:50:52.619271 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:52.619247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hk7zh" event={"ID":"36b795d5-21e0-40ca-a94e-e268fca1e2a5","Type":"ContainerStarted","Data":"58fbc3f1664f01a5fbc475903c081d1699e6577820ed0447ac69b2a424676811"} Jun 11 14:50:52.646826 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:52.646774 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7j6q2" podStartSLOduration=9.531148566 podStartE2EDuration="38.646755404s" totalImagesPullingTime="29.115606838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:52.645534667 +0000 UTC m=+38.690922071" watchObservedRunningTime="2026-06-11 14:50:52.646755404 +0000 UTC m=+38.692142810" Jun 11 14:50:52.667000 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:52.666944 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hk7zh" podStartSLOduration=2.240064833 podStartE2EDuration="4.666927904s" totalImagesPullingTime="2.426863071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:50:52.666055919 +0000 UTC m=+38.711443325" watchObservedRunningTime="2026-06-11 14:50:52.666927904 +0000 UTC m=+38.712315307" Jun 11 14:50:56.589317 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:56.589274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:50:56.589817 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:50:56.589369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:50:56.589817 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:56.589453 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:50:56.589817 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:56.589473 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858c5d4694-6j4x4: secret "image-registry-tls" not found Jun 11 14:50:56.589817 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:56.589482 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:50:56.589817 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:56.589528 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls podName:493f3b97-15ec-48bb-98ee-418ade520c8f nodeName:}" failed. No retries permitted until 2026-06-11 14:51:04.589512472 +0000 UTC m=+50.634899857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls") pod "image-registry-858c5d4694-6j4x4" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f") : secret "image-registry-tls" not found Jun 11 14:50:56.589817 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:50:56.589541 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls podName:baa10ca3-dc20-47bd-a6b3-38e10bac1b3e nodeName:}" failed. No retries permitted until 2026-06-11 14:51:04.589535084 +0000 UTC m=+50.634922469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls") pod "dns-default-7wn45" (UID: "baa10ca3-dc20-47bd-a6b3-38e10bac1b3e") : secret "dns-default-metrics-tls" not found Jun 11 14:51:04.648965 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:04.648924 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:51:04.649421 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:04.648977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:51:04.649421 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:04.649084 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:51:04.649421 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:04.649081 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:51:04.649421 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:04.649097 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858c5d4694-6j4x4: secret "image-registry-tls" not found Jun 11 14:51:04.649421 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:04.649166 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls podName:493f3b97-15ec-48bb-98ee-418ade520c8f nodeName:}" failed. No retries permitted until 2026-06-11 14:51:20.64915139 +0000 UTC m=+66.694538785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls") pod "image-registry-858c5d4694-6j4x4" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f") : secret "image-registry-tls" not found Jun 11 14:51:04.649421 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:04.649179 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls podName:baa10ca3-dc20-47bd-a6b3-38e10bac1b3e nodeName:}" failed. No retries permitted until 2026-06-11 14:51:20.649174075 +0000 UTC m=+66.694561457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls") pod "dns-default-7wn45" (UID: "baa10ca3-dc20-47bd-a6b3-38e10bac1b3e") : secret "dns-default-metrics-tls" not found Jun 11 14:51:14.589509 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:14.589478 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rqgqt" Jun 11 14:51:20.163359 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.163312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:51:20.166286 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.166262 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:51:20.174488 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:20.174455 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:51:20.174561 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:20.174551 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs podName:6c70a562-3b07-482e-bbaa-a285419c369b nodeName:}" failed. No retries permitted until 2026-06-11 14:52:24.174530278 +0000 UTC m=+130.219917664 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs") pod "network-metrics-daemon-chz6g" (UID: "6c70a562-3b07-482e-bbaa-a285419c369b") : secret "metrics-daemon-secret" not found Jun 11 14:51:20.264667 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.264630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdp49\" (UniqueName: \"kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49\") pod \"network-check-target-8smqc\" (UID: \"f687b1bc-e135-4896-9e92-da097d66ddee\") " pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:51:20.264750 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.264682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:51:20.267326 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.267302 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:51:20.267385 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.267302 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:51:20.277117 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.277085 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:51:20.278796 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.278765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c85d9bb0-a0f0-46b3-9c97-58961e603482-original-pull-secret\") pod \"global-pull-secret-syncer-9sm6h\" (UID: \"c85d9bb0-a0f0-46b3-9c97-58961e603482\") " pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:51:20.287571 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.287544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdp49\" (UniqueName: \"kubernetes.io/projected/f687b1bc-e135-4896-9e92-da097d66ddee-kube-api-access-vdp49\") pod \"network-check-target-8smqc\" (UID: \"f687b1bc-e135-4896-9e92-da097d66ddee\") " pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:51:20.441935 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.441852 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rtqf6\"" Jun 11 14:51:20.443817 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.443796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sm6h" Jun 11 14:51:20.449120 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.449088 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:51:20.599926 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.599890 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9sm6h"] Jun 11 14:51:20.604682 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:51:20.604645 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85d9bb0_a0f0_46b3_9c97_58961e603482.slice/crio-2ca8b48da56cb3f592014307149461c4d4daa15e233936f59b9a75563811504a WatchSource:0}: Error finding container 2ca8b48da56cb3f592014307149461c4d4daa15e233936f59b9a75563811504a: Status 404 returned error can't find the container with id 2ca8b48da56cb3f592014307149461c4d4daa15e233936f59b9a75563811504a Jun 11 14:51:20.615386 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.615348 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8smqc"] Jun 11 14:51:20.619318 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:51:20.619284 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf687b1bc_e135_4896_9e92_da097d66ddee.slice/crio-6fb7b2539545039b744b79b45c2e66d34378aadeff33f0b77dfef80cd3e56d84 WatchSource:0}: Error finding container 6fb7b2539545039b744b79b45c2e66d34378aadeff33f0b77dfef80cd3e56d84: Status 404 returned error can't find the container with id 6fb7b2539545039b744b79b45c2e66d34378aadeff33f0b77dfef80cd3e56d84 Jun 11 14:51:20.667673 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.667635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:51:20.667867 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.667681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:51:20.667867 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:20.667777 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:51:20.667867 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:20.667784 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:51:20.667867 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:20.667846 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls podName:baa10ca3-dc20-47bd-a6b3-38e10bac1b3e nodeName:}" failed. No retries permitted until 2026-06-11 14:51:52.667831493 +0000 UTC m=+98.713218875 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls") pod "dns-default-7wn45" (UID: "baa10ca3-dc20-47bd-a6b3-38e10bac1b3e") : secret "dns-default-metrics-tls" not found Jun 11 14:51:20.668024 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:20.667788 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858c5d4694-6j4x4: secret "image-registry-tls" not found Jun 11 14:51:20.668024 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:20.667915 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls podName:493f3b97-15ec-48bb-98ee-418ade520c8f nodeName:}" failed. No retries permitted until 2026-06-11 14:51:52.667903095 +0000 UTC m=+98.713290478 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls") pod "image-registry-858c5d4694-6j4x4" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f") : secret "image-registry-tls" not found Jun 11 14:51:20.686130 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.686094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9sm6h" event={"ID":"c85d9bb0-a0f0-46b3-9c97-58961e603482","Type":"ContainerStarted","Data":"2ca8b48da56cb3f592014307149461c4d4daa15e233936f59b9a75563811504a"} Jun 11 14:51:20.687200 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:20.687167 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8smqc" event={"ID":"f687b1bc-e135-4896-9e92-da097d66ddee","Type":"ContainerStarted","Data":"6fb7b2539545039b744b79b45c2e66d34378aadeff33f0b77dfef80cd3e56d84"} Jun 11 14:51:23.696611 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:23.696481 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8smqc" event={"ID":"f687b1bc-e135-4896-9e92-da097d66ddee","Type":"ContainerStarted","Data":"5318ac5f084a8e2ba2840a307550df31926d4f8d2985027b4d3f750822f75a40"} Jun 11 14:51:23.696611 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:23.696606 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:51:23.710089 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:23.710023 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8smqc" podStartSLOduration=66.82879559 podStartE2EDuration="1m9.709997595s" totalImagesPullingTime="2.881202005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:51:23.709670141 +0000 UTC m=+69.755057563" watchObservedRunningTime="2026-06-11 14:51:23.709997595 +0000 UTC m=+69.755385000" Jun 11 14:51:25.703269 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:25.703234 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9sm6h" event={"ID":"c85d9bb0-a0f0-46b3-9c97-58961e603482","Type":"ContainerStarted","Data":"6aa7cbdb5ada0c56102e253c51946be20bd02dcd82310962dd3736a5597792b4"} Jun 11 14:51:25.719156 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:25.719106 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9sm6h" podStartSLOduration=67.400541423 podStartE2EDuration="1m11.71908788s" totalImagesPullingTime="4.318546457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:51:25.718545573 +0000 UTC m=+71.763932979" watchObservedRunningTime="2026-06-11 14:51:25.71908788 +0000 UTC m=+71.764475284" Jun 11 14:51:52.705971 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:52.705902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:51:52.705971 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:52.705971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:51:52.706531 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:52.706071 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:51:52.706531 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:52.706075 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:51:52.706531 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:52.706163 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls podName:baa10ca3-dc20-47bd-a6b3-38e10bac1b3e nodeName:}" failed. No retries permitted until 2026-06-11 14:52:56.706144318 +0000 UTC m=+162.751531700 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls") pod "dns-default-7wn45" (UID: "baa10ca3-dc20-47bd-a6b3-38e10bac1b3e") : secret "dns-default-metrics-tls" not found Jun 11 14:51:52.706531 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:52.706083 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858c5d4694-6j4x4: secret "image-registry-tls" not found Jun 11 14:51:52.706531 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:51:52.706225 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls podName:493f3b97-15ec-48bb-98ee-418ade520c8f nodeName:}" failed. No retries permitted until 2026-06-11 14:52:56.706213435 +0000 UTC m=+162.751600820 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls") pod "image-registry-858c5d4694-6j4x4" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f") : secret "image-registry-tls" not found Jun 11 14:51:54.701879 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:51:54.701848 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8smqc" Jun 11 14:52:24.223193 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:52:24.223136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:52:24.223769 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:52:24.223278 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:52:24.223769 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:52:24.223345 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs podName:6c70a562-3b07-482e-bbaa-a285419c369b nodeName:}" failed. No retries permitted until 2026-06-11 14:54:26.223325955 +0000 UTC m=+252.268713341 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs") pod "network-metrics-daemon-chz6g" (UID: "6c70a562-3b07-482e-bbaa-a285419c369b") : secret "metrics-daemon-secret" not found Jun 11 14:52:51.833408 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:52:51.833353 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" podUID="493f3b97-15ec-48bb-98ee-418ade520c8f" Jun 11 14:52:51.849740 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:52:51.849686 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7wn45" podUID="baa10ca3-dc20-47bd-a6b3-38e10bac1b3e" Jun 11 14:52:51.907571 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:52:51.907543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7wn45" Jun 11 14:52:51.907710 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:52:51.907543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:52:53.448469 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:52:53.448390 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-chz6g" podUID="6c70a562-3b07-482e-bbaa-a285419c369b" Jun 11 14:52:56.769082 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:52:56.769015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:52:56.769082 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:52:56.769085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:52:56.769589 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:52:56.769176 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:52:56.769589 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:52:56.769176 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:52:56.769589 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:52:56.769187 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858c5d4694-6j4x4: secret "image-registry-tls" not found Jun 11 14:52:56.769589 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:52:56.769242 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls podName:493f3b97-15ec-48bb-98ee-418ade520c8f nodeName:}" failed. No retries permitted until 2026-06-11 14:54:58.769228139 +0000 UTC m=+284.814615522 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls") pod "image-registry-858c5d4694-6j4x4" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f") : secret "image-registry-tls" not found Jun 11 14:52:56.769589 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:52:56.769254 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls podName:baa10ca3-dc20-47bd-a6b3-38e10bac1b3e nodeName:}" failed. No retries permitted until 2026-06-11 14:54:58.769248174 +0000 UTC m=+284.814635557 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls") pod "dns-default-7wn45" (UID: "baa10ca3-dc20-47bd-a6b3-38e10bac1b3e") : secret "dns-default-metrics-tls" not found Jun 11 14:53:04.426339 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:04.426297 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:53:29.021688 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.021648 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk"] Jun 11 14:53:29.023364 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.023344 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:29.026097 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.026064 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 14:53:29.026263 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.026076 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 14:53:29.026592 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.026572 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-8jp5g"] Jun 11 14:53:29.028113 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.028093 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8bdbc75df-j55tt"] Jun 11 14:53:29.028247 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.028185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.028547 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.028513 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bnfs6\"" Jun 11 14:53:29.029697 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.029672 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 14:53:29.029791 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.029729 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 14:53:29.030037 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.030021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.030831 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.030813 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 14:53:29.031264 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.031044 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 14:53:29.031264 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.031115 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4bpsr\"" Jun 11 14:53:29.031412 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.031393 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 14:53:29.031645 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.031627 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 14:53:29.033673 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.033652 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cfk95\"" Jun 11 14:53:29.033786 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.033652 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 14:53:29.033878 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.033665 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 14:53:29.033942 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.033666 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 14:53:29.033942 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.033683 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 14:53:29.033942 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.033698 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 14:53:29.034091 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.033762 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 14:53:29.036973 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.036950 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk"] Jun 11 14:53:29.037264 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.037244 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 14:53:29.042300 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.042269 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-8jp5g"] Jun 11 14:53:29.062464 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.062389 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8bdbc75df-j55tt"] Jun 11 14:53:29.100686 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.100636 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-service-ca-bundle\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.100686 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.100693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-serving-cert\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.100956 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.100717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbkf7\" (UniqueName: \"kubernetes.io/projected/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-kube-api-access-jbkf7\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.100956 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.100759 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvxvd\" (UniqueName: \"kubernetes.io/projected/41629d05-8b07-4ceb-acf5-228f076da1a4-kube-api-access-jvxvd\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.100956 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.100789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:29.100956 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.100814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-trusted-ca-bundle\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.100956 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.100830 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-default-certificate\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.100956 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.100925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:29.101217 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.100966 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-snapshots\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.101217 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.101009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-tmp\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.101217 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.101034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.101217 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.101069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.101217 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.101097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psmgp\" (UniqueName: \"kubernetes.io/projected/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-kube-api-access-psmgp\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:29.101217 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.101128 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-stats-auth\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.121819 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.121783 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j"] Jun 11 14:53:29.123677 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.123658 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" Jun 11 14:53:29.126419 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.126395 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 14:53:29.126672 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.126656 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vnqlr\"" Jun 11 14:53:29.126763 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.126688 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:53:29.126763 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.126730 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 14:53:29.127033 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.127016 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 14:53:29.136894 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.136863 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j"] Jun 11 14:53:29.201918 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.201869 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkf7\" (UniqueName: \"kubernetes.io/projected/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-kube-api-access-jbkf7\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.202136 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.201929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvxvd\" (UniqueName: \"kubernetes.io/projected/41629d05-8b07-4ceb-acf5-228f076da1a4-kube-api-access-jvxvd\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.202136 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/433fc2e0-5ffb-406b-989f-96ce70213829-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xc45j\" (UID: \"433fc2e0-5ffb-406b-989f-96ce70213829\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" Jun 11 14:53:29.202250 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:29.202250 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-trusted-ca-bundle\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.202250 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-default-certificate\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.202385 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:29.202385 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-snapshots\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.202385 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:29.202329 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:29.202385 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:29.202382 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls podName:8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c nodeName:}" failed. No retries permitted until 2026-06-11 14:53:29.702364107 +0000 UTC m=+195.747751489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fpnqk" (UID: "8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:29.202633 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-tmp\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.202633 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.202633 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.202633 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psmgp\" (UniqueName: \"kubernetes.io/projected/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-kube-api-access-psmgp\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:29.202633 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-stats-auth\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.202633 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:29.202544 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 14:53:29.202633 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw8ww\" (UniqueName: \"kubernetes.io/projected/433fc2e0-5ffb-406b-989f-96ce70213829-kube-api-access-gw8ww\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xc45j\" (UID: \"433fc2e0-5ffb-406b-989f-96ce70213829\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" Jun 11 14:53:29.202633 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:29.202614 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs podName:41629d05-8b07-4ceb-acf5-228f076da1a4 nodeName:}" failed. No retries permitted until 2026-06-11 14:53:29.702597045 +0000 UTC m=+195.747984433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs") pod "router-default-8bdbc75df-j55tt" (UID: "41629d05-8b07-4ceb-acf5-228f076da1a4") : secret "router-metrics-certs-default" not found Jun 11 14:53:29.203031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-service-ca-bundle\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.203031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/433fc2e0-5ffb-406b-989f-96ce70213829-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xc45j\" (UID: \"433fc2e0-5ffb-406b-989f-96ce70213829\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" Jun 11 14:53:29.203031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-serving-cert\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.203031 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.202781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-tmp\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.203031 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:29.202891 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle podName:41629d05-8b07-4ceb-acf5-228f076da1a4 nodeName:}" failed. No retries permitted until 2026-06-11 14:53:29.702875016 +0000 UTC m=+195.748262420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle") pod "router-default-8bdbc75df-j55tt" (UID: "41629d05-8b07-4ceb-acf5-228f076da1a4") : configmap references non-existent config key: service-ca.crt Jun 11 14:53:29.203248 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.203097 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:29.203248 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.203215 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-service-ca-bundle\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.203630 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.203603 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-snapshots\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.203741 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.203717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-trusted-ca-bundle\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.205182 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.205154 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-default-certificate\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.205182 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.205175 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-stats-auth\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.205350 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.205309 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-serving-cert\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.214518 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.214485 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x"] Jun 11 14:53:29.216824 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.216795 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" Jun 11 14:53:29.217647 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.217621 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbkf7\" (UniqueName: \"kubernetes.io/projected/72613a71-d9bd-4b3f-80c7-5ca7982b8db6-kube-api-access-jbkf7\") pod \"insights-operator-896549976-8jp5g\" (UID: \"72613a71-d9bd-4b3f-80c7-5ca7982b8db6\") " pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.219915 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.219891 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 14:53:29.220303 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.220287 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 14:53:29.220399 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.220369 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:53:29.220654 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.220634 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 14:53:29.220740 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.220636 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kq4q5\"" Jun 11 14:53:29.223101 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.223075 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvxvd\" (UniqueName: \"kubernetes.io/projected/41629d05-8b07-4ceb-acf5-228f076da1a4-kube-api-access-jvxvd\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.223341 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.223321 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psmgp\" (UniqueName: \"kubernetes.io/projected/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-kube-api-access-psmgp\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:29.225054 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.225029 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x"] Jun 11 14:53:29.303564 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.303466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/433fc2e0-5ffb-406b-989f-96ce70213829-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xc45j\" (UID: \"433fc2e0-5ffb-406b-989f-96ce70213829\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" Jun 11 14:53:29.303564 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.303517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxmld\" (UniqueName: \"kubernetes.io/projected/626dba83-f084-4110-881c-6a195a681010-kube-api-access-qxmld\") pod \"service-ca-operator-6bc5ff68f5-rlk4x\" (UID: \"626dba83-f084-4110-881c-6a195a681010\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" Jun 11 14:53:29.303564 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.303542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/433fc2e0-5ffb-406b-989f-96ce70213829-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xc45j\" (UID: \"433fc2e0-5ffb-406b-989f-96ce70213829\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" Jun 11 14:53:29.303822 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.303615 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/626dba83-f084-4110-881c-6a195a681010-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-rlk4x\" (UID: \"626dba83-f084-4110-881c-6a195a681010\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" Jun 11 14:53:29.303822 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.303707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/626dba83-f084-4110-881c-6a195a681010-config\") pod \"service-ca-operator-6bc5ff68f5-rlk4x\" (UID: \"626dba83-f084-4110-881c-6a195a681010\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" Jun 11 14:53:29.303822 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.303736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw8ww\" (UniqueName: \"kubernetes.io/projected/433fc2e0-5ffb-406b-989f-96ce70213829-kube-api-access-gw8ww\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xc45j\" (UID: \"433fc2e0-5ffb-406b-989f-96ce70213829\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" Jun 11 14:53:29.304127 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.304102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/433fc2e0-5ffb-406b-989f-96ce70213829-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xc45j\" (UID: \"433fc2e0-5ffb-406b-989f-96ce70213829\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" Jun 11 14:53:29.306188 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.306157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/433fc2e0-5ffb-406b-989f-96ce70213829-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xc45j\" (UID: \"433fc2e0-5ffb-406b-989f-96ce70213829\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" Jun 11 14:53:29.325868 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.325827 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw8ww\" (UniqueName: \"kubernetes.io/projected/433fc2e0-5ffb-406b-989f-96ce70213829-kube-api-access-gw8ww\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xc45j\" (UID: \"433fc2e0-5ffb-406b-989f-96ce70213829\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" Jun 11 14:53:29.342121 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.342081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-8jp5g" Jun 11 14:53:29.405252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.405130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/626dba83-f084-4110-881c-6a195a681010-config\") pod \"service-ca-operator-6bc5ff68f5-rlk4x\" (UID: \"626dba83-f084-4110-881c-6a195a681010\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" Jun 11 14:53:29.405252 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.405208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxmld\" (UniqueName: \"kubernetes.io/projected/626dba83-f084-4110-881c-6a195a681010-kube-api-access-qxmld\") pod \"service-ca-operator-6bc5ff68f5-rlk4x\" (UID: \"626dba83-f084-4110-881c-6a195a681010\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" Jun 11 14:53:29.405518 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.405267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/626dba83-f084-4110-881c-6a195a681010-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-rlk4x\" (UID: \"626dba83-f084-4110-881c-6a195a681010\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" Jun 11 14:53:29.406269 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.406230 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/626dba83-f084-4110-881c-6a195a681010-config\") pod \"service-ca-operator-6bc5ff68f5-rlk4x\" (UID: \"626dba83-f084-4110-881c-6a195a681010\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" Jun 11 14:53:29.408255 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.408203 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/626dba83-f084-4110-881c-6a195a681010-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-rlk4x\" (UID: \"626dba83-f084-4110-881c-6a195a681010\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" Jun 11 14:53:29.414021 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.413996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxmld\" (UniqueName: \"kubernetes.io/projected/626dba83-f084-4110-881c-6a195a681010-kube-api-access-qxmld\") pod \"service-ca-operator-6bc5ff68f5-rlk4x\" (UID: \"626dba83-f084-4110-881c-6a195a681010\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" Jun 11 14:53:29.433965 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.433919 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" Jun 11 14:53:29.473413 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.473376 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-8jp5g"] Jun 11 14:53:29.480846 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:53:29.480812 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72613a71_d9bd_4b3f_80c7_5ca7982b8db6.slice/crio-661ddbc2e84a50bed48206704e03548023c8ac1659a882b5d33644670fdfcd76 WatchSource:0}: Error finding container 661ddbc2e84a50bed48206704e03548023c8ac1659a882b5d33644670fdfcd76: Status 404 returned error can't find the container with id 661ddbc2e84a50bed48206704e03548023c8ac1659a882b5d33644670fdfcd76 Jun 11 14:53:29.535963 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.535916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" Jun 11 14:53:29.575948 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.575800 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j"] Jun 11 14:53:29.581234 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:53:29.581204 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433fc2e0_5ffb_406b_989f_96ce70213829.slice/crio-d6415463df291e4e096d927ebf0163e6d497c4bb7d0193804182059742434f04 WatchSource:0}: Error finding container d6415463df291e4e096d927ebf0163e6d497c4bb7d0193804182059742434f04: Status 404 returned error can't find the container with id d6415463df291e4e096d927ebf0163e6d497c4bb7d0193804182059742434f04 Jun 11 14:53:29.672340 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.672308 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x"] Jun 11 14:53:29.675413 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:53:29.675377 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626dba83_f084_4110_881c_6a195a681010.slice/crio-959e66a061e96d3d344e2ff9103956a4455a1b6df4b17207cfdf04d6de2d580b WatchSource:0}: Error finding container 959e66a061e96d3d344e2ff9103956a4455a1b6df4b17207cfdf04d6de2d580b: Status 404 returned error can't find the container with id 959e66a061e96d3d344e2ff9103956a4455a1b6df4b17207cfdf04d6de2d580b Jun 11 14:53:29.708486 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.708419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.708486 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.708487 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:29.708749 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:29.708538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:29.708749 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:29.708579 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 14:53:29.708749 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:29.708627 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:29.708749 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:29.708650 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs podName:41629d05-8b07-4ceb-acf5-228f076da1a4 nodeName:}" failed. No retries permitted until 2026-06-11 14:53:30.708629314 +0000 UTC m=+196.754016698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs") pod "router-default-8bdbc75df-j55tt" (UID: "41629d05-8b07-4ceb-acf5-228f076da1a4") : secret "router-metrics-certs-default" not found Jun 11 14:53:29.708749 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:29.708669 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle podName:41629d05-8b07-4ceb-acf5-228f076da1a4 nodeName:}" failed. No retries permitted until 2026-06-11 14:53:30.708660709 +0000 UTC m=+196.754048098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle") pod "router-default-8bdbc75df-j55tt" (UID: "41629d05-8b07-4ceb-acf5-228f076da1a4") : configmap references non-existent config key: service-ca.crt Jun 11 14:53:29.708749 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:29.708684 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls podName:8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c nodeName:}" failed. No retries permitted until 2026-06-11 14:53:30.708676489 +0000 UTC m=+196.754063873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fpnqk" (UID: "8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:30.000840 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:30.000803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" event={"ID":"626dba83-f084-4110-881c-6a195a681010","Type":"ContainerStarted","Data":"959e66a061e96d3d344e2ff9103956a4455a1b6df4b17207cfdf04d6de2d580b"} Jun 11 14:53:30.001888 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:30.001851 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" event={"ID":"433fc2e0-5ffb-406b-989f-96ce70213829","Type":"ContainerStarted","Data":"d6415463df291e4e096d927ebf0163e6d497c4bb7d0193804182059742434f04"} Jun 11 14:53:30.002967 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:30.002943 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8jp5g" event={"ID":"72613a71-d9bd-4b3f-80c7-5ca7982b8db6","Type":"ContainerStarted","Data":"661ddbc2e84a50bed48206704e03548023c8ac1659a882b5d33644670fdfcd76"} Jun 11 14:53:30.719641 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:30.719596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:30.720149 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:30.719655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:30.720149 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:30.719751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:30.720149 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:30.719911 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:30.720149 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:30.719979 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls podName:8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c nodeName:}" failed. No retries permitted until 2026-06-11 14:53:32.719958521 +0000 UTC m=+198.765345910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fpnqk" (UID: "8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:30.720658 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:30.720396 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 14:53:30.720658 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:30.720472 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs podName:41629d05-8b07-4ceb-acf5-228f076da1a4 nodeName:}" failed. No retries permitted until 2026-06-11 14:53:32.720456203 +0000 UTC m=+198.765843591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs") pod "router-default-8bdbc75df-j55tt" (UID: "41629d05-8b07-4ceb-acf5-228f076da1a4") : secret "router-metrics-certs-default" not found Jun 11 14:53:30.720658 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:30.720578 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle podName:41629d05-8b07-4ceb-acf5-228f076da1a4 nodeName:}" failed. No retries permitted until 2026-06-11 14:53:32.72054998 +0000 UTC m=+198.765937368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle") pod "router-default-8bdbc75df-j55tt" (UID: "41629d05-8b07-4ceb-acf5-228f076da1a4") : configmap references non-existent config key: service-ca.crt Jun 11 14:53:32.740607 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:32.740565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:32.741045 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:32.740623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:32.741045 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:32.740707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:32.741045 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:32.740738 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 14:53:32.746343 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:32.741486 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:32.746343 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:32.742093 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls podName:8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c nodeName:}" failed. No retries permitted until 2026-06-11 14:53:36.74206773 +0000 UTC m=+202.787455116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fpnqk" (UID: "8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:32.746343 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:32.742118 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs podName:41629d05-8b07-4ceb-acf5-228f076da1a4 nodeName:}" failed. No retries permitted until 2026-06-11 14:53:36.74210854 +0000 UTC m=+202.787495927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs") pod "router-default-8bdbc75df-j55tt" (UID: "41629d05-8b07-4ceb-acf5-228f076da1a4") : secret "router-metrics-certs-default" not found Jun 11 14:53:32.746343 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:32.742256 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle podName:41629d05-8b07-4ceb-acf5-228f076da1a4 nodeName:}" failed. No retries permitted until 2026-06-11 14:53:36.742231204 +0000 UTC m=+202.787618595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle") pod "router-default-8bdbc75df-j55tt" (UID: "41629d05-8b07-4ceb-acf5-228f076da1a4") : configmap references non-existent config key: service-ca.crt Jun 11 14:53:33.015176 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:33.015053 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" event={"ID":"626dba83-f084-4110-881c-6a195a681010","Type":"ContainerStarted","Data":"46714dd9278bfafbc99accb04488c1f7dac41ff43f5d2478e0a634b3b832d529"} Jun 11 14:53:33.016622 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:33.016588 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" event={"ID":"433fc2e0-5ffb-406b-989f-96ce70213829","Type":"ContainerStarted","Data":"321075bdc1f6f14527f654a2635d6da289459dc6fbe4df3d7e044cce52f8dd7b"} Jun 11 14:53:33.018116 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:33.018087 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8jp5g" event={"ID":"72613a71-d9bd-4b3f-80c7-5ca7982b8db6","Type":"ContainerStarted","Data":"d8532286519587ca821d11a0640059b62ad2c2f94f2362cf00f5c333da895f01"} Jun 11 14:53:33.030469 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:33.030390 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" podStartSLOduration=1.297921381 podStartE2EDuration="4.030372907s" totalImagesPullingTime="2.732451526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:53:33.029367153 +0000 UTC m=+199.074754559" watchObservedRunningTime="2026-06-11 14:53:33.030372907 +0000 UTC m=+199.075760289" Jun 11 14:53:33.044112 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:33.044056 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" podStartSLOduration=1.223982262 podStartE2EDuration="4.04404136s" totalImagesPullingTime="2.820059098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:53:33.043205829 +0000 UTC m=+199.088593238" watchObservedRunningTime="2026-06-11 14:53:33.04404136 +0000 UTC m=+199.089428766" Jun 11 14:53:33.061305 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:33.061239 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-8jp5g" podStartSLOduration=1.135513249 podStartE2EDuration="4.061222395s" totalImagesPullingTime="2.925709146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:53:33.059731398 +0000 UTC m=+199.105118794" watchObservedRunningTime="2026-06-11 14:53:33.061222395 +0000 UTC m=+199.106609804" Jun 11 14:53:36.068916 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.068873 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-9tnj4"] Jun 11 14:53:36.072964 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.072939 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" Jun 11 14:53:36.075714 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.075687 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 14:53:36.075714 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.075692 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 14:53:36.075906 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.075753 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 14:53:36.076934 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.076912 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 14:53:36.077080 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.077066 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bs2tf\"" Jun 11 14:53:36.081290 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.081266 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-9tnj4"] Jun 11 14:53:36.171534 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.171495 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9702fb93-d3ca-4937-810d-4b4cbed1804f-signing-cabundle\") pod \"service-ca-7d74d578b8-9tnj4\" (UID: \"9702fb93-d3ca-4937-810d-4b4cbed1804f\") " pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" Jun 11 14:53:36.171534 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.171542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9702fb93-d3ca-4937-810d-4b4cbed1804f-signing-key\") pod \"service-ca-7d74d578b8-9tnj4\" (UID: \"9702fb93-d3ca-4937-810d-4b4cbed1804f\") " pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" Jun 11 14:53:36.171766 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.171574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2qxf\" (UniqueName: \"kubernetes.io/projected/9702fb93-d3ca-4937-810d-4b4cbed1804f-kube-api-access-f2qxf\") pod \"service-ca-7d74d578b8-9tnj4\" (UID: \"9702fb93-d3ca-4937-810d-4b4cbed1804f\") " pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" Jun 11 14:53:36.272351 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.272306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9702fb93-d3ca-4937-810d-4b4cbed1804f-signing-cabundle\") pod \"service-ca-7d74d578b8-9tnj4\" (UID: \"9702fb93-d3ca-4937-810d-4b4cbed1804f\") " pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" Jun 11 14:53:36.272351 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.272351 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9702fb93-d3ca-4937-810d-4b4cbed1804f-signing-key\") pod \"service-ca-7d74d578b8-9tnj4\" (UID: \"9702fb93-d3ca-4937-810d-4b4cbed1804f\") " pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" Jun 11 14:53:36.272641 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.272377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2qxf\" (UniqueName: \"kubernetes.io/projected/9702fb93-d3ca-4937-810d-4b4cbed1804f-kube-api-access-f2qxf\") pod \"service-ca-7d74d578b8-9tnj4\" (UID: \"9702fb93-d3ca-4937-810d-4b4cbed1804f\") " pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" Jun 11 14:53:36.273077 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.273055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9702fb93-d3ca-4937-810d-4b4cbed1804f-signing-cabundle\") pod \"service-ca-7d74d578b8-9tnj4\" (UID: \"9702fb93-d3ca-4937-810d-4b4cbed1804f\") " pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" Jun 11 14:53:36.275085 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.275058 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9702fb93-d3ca-4937-810d-4b4cbed1804f-signing-key\") pod \"service-ca-7d74d578b8-9tnj4\" (UID: \"9702fb93-d3ca-4937-810d-4b4cbed1804f\") " pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" Jun 11 14:53:36.280409 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.280380 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2qxf\" (UniqueName: \"kubernetes.io/projected/9702fb93-d3ca-4937-810d-4b4cbed1804f-kube-api-access-f2qxf\") pod \"service-ca-7d74d578b8-9tnj4\" (UID: \"9702fb93-d3ca-4937-810d-4b4cbed1804f\") " pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" Jun 11 14:53:36.368266 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.368192 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sq4qw_8c7f7145-6dd1-4bcd-bc44-acd990a2d517/dns-node-resolver/0.log" Jun 11 14:53:36.382548 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.382508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" Jun 11 14:53:36.521094 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.521062 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-9tnj4"] Jun 11 14:53:36.524177 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:53:36.524144 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9702fb93_d3ca_4937_810d_4b4cbed1804f.slice/crio-9e6f81d458388ef77bfd4de0926210834e584d18bf1386ee74e3813211863da4 WatchSource:0}: Error finding container 9e6f81d458388ef77bfd4de0926210834e584d18bf1386ee74e3813211863da4: Status 404 returned error can't find the container with id 9e6f81d458388ef77bfd4de0926210834e584d18bf1386ee74e3813211863da4 Jun 11 14:53:36.778651 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.778602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:36.778883 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.778689 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:36.778883 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:36.778715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:36.778883 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:36.778787 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:36.778883 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:36.778825 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 14:53:36.778883 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:36.778862 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls podName:8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c nodeName:}" failed. No retries permitted until 2026-06-11 14:53:44.778842752 +0000 UTC m=+210.824230150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fpnqk" (UID: "8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:36.778883 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:36.778880 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle podName:41629d05-8b07-4ceb-acf5-228f076da1a4 nodeName:}" failed. No retries permitted until 2026-06-11 14:53:44.778872149 +0000 UTC m=+210.824259532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle") pod "router-default-8bdbc75df-j55tt" (UID: "41629d05-8b07-4ceb-acf5-228f076da1a4") : configmap references non-existent config key: service-ca.crt Jun 11 14:53:36.779099 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:36.778894 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs podName:41629d05-8b07-4ceb-acf5-228f076da1a4 nodeName:}" failed. No retries permitted until 2026-06-11 14:53:44.778886514 +0000 UTC m=+210.824273898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs") pod "router-default-8bdbc75df-j55tt" (UID: "41629d05-8b07-4ceb-acf5-228f076da1a4") : secret "router-metrics-certs-default" not found Jun 11 14:53:37.035662 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:37.035567 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" event={"ID":"9702fb93-d3ca-4937-810d-4b4cbed1804f","Type":"ContainerStarted","Data":"98fb79eaf056a1a86bb7746cc0c8a9416dc32370efcdd6b586bb4aa0659928b2"} Jun 11 14:53:37.035662 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:37.035623 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" event={"ID":"9702fb93-d3ca-4937-810d-4b4cbed1804f","Type":"ContainerStarted","Data":"9e6f81d458388ef77bfd4de0926210834e584d18bf1386ee74e3813211863da4"} Jun 11 14:53:37.057304 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:37.057249 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-9tnj4" podStartSLOduration=1.057233276 podStartE2EDuration="1.057233276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:53:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:53:37.056776135 +0000 UTC m=+203.102163541" watchObservedRunningTime="2026-06-11 14:53:37.057233276 +0000 UTC m=+203.102620732" Jun 11 14:53:37.368978 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:37.368898 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7d55_40ea14c6-cca7-4e29-89e7-12e1a626e0f5/node-ca/0.log" Jun 11 14:53:38.368785 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:38.368752 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hk7zh_36b795d5-21e0-40ca-a94e-e268fca1e2a5/serve-healthcheck-canary/0.log" Jun 11 14:53:44.850629 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:44.850573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:53:44.851026 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:44.850676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:44.851026 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:44.850735 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:44.851026 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:53:44.850806 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls podName:8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c nodeName:}" failed. No retries permitted until 2026-06-11 14:54:00.850790407 +0000 UTC m=+226.896177791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fpnqk" (UID: "8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:53:44.851026 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:44.850738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:44.851464 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:44.851415 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41629d05-8b07-4ceb-acf5-228f076da1a4-service-ca-bundle\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:44.853409 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:44.853387 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41629d05-8b07-4ceb-acf5-228f076da1a4-metrics-certs\") pod \"router-default-8bdbc75df-j55tt\" (UID: \"41629d05-8b07-4ceb-acf5-228f076da1a4\") " pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:44.948588 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:44.948547 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:45.099465 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:45.099409 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8bdbc75df-j55tt"] Jun 11 14:53:45.102999 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:53:45.102918 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41629d05_8b07_4ceb_acf5_228f076da1a4.slice/crio-88279a94650e50c64074468a0729676d56ae7130fe85bf4de346636118920efa WatchSource:0}: Error finding container 88279a94650e50c64074468a0729676d56ae7130fe85bf4de346636118920efa: Status 404 returned error can't find the container with id 88279a94650e50c64074468a0729676d56ae7130fe85bf4de346636118920efa Jun 11 14:53:46.066831 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:46.066786 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8bdbc75df-j55tt" event={"ID":"41629d05-8b07-4ceb-acf5-228f076da1a4","Type":"ContainerStarted","Data":"c7fe38cf19ec3ada2126fc3ce37373f492af2c8200a190061845d420e93f308c"} Jun 11 14:53:46.067233 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:46.066848 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8bdbc75df-j55tt" event={"ID":"41629d05-8b07-4ceb-acf5-228f076da1a4","Type":"ContainerStarted","Data":"88279a94650e50c64074468a0729676d56ae7130fe85bf4de346636118920efa"} Jun 11 14:53:46.083821 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:46.083764 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8bdbc75df-j55tt" podStartSLOduration=17.083746627 podStartE2EDuration="17.083746627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:53:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:53:46.082981044 +0000 UTC m=+212.128368448" watchObservedRunningTime="2026-06-11 14:53:46.083746627 +0000 UTC m=+212.129134031" Jun 11 14:53:46.949543 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:46.949489 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:46.952096 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:46.952067 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:47.069810 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:47.069780 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:47.071162 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:47.071137 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8bdbc75df-j55tt" Jun 11 14:53:56.770808 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.770772 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jpr6g"] Jun 11 14:53:56.773941 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.773914 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.778055 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.778030 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 14:53:56.778189 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.778030 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4697f\"" Jun 11 14:53:56.778189 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.778117 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 14:53:56.788349 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.788317 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpr6g"] Jun 11 14:53:56.836497 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.836463 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/630375c6-7f9a-463e-817b-eab421059c7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.836677 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.836549 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/630375c6-7f9a-463e-817b-eab421059c7d-data-volume\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.836677 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.836575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/630375c6-7f9a-463e-817b-eab421059c7d-crio-socket\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.836677 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.836597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/630375c6-7f9a-463e-817b-eab421059c7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.836677 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.836638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcgzw\" (UniqueName: \"kubernetes.io/projected/630375c6-7f9a-463e-817b-eab421059c7d-kube-api-access-bcgzw\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.937830 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.937784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcgzw\" (UniqueName: \"kubernetes.io/projected/630375c6-7f9a-463e-817b-eab421059c7d-kube-api-access-bcgzw\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.937830 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.937826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/630375c6-7f9a-463e-817b-eab421059c7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.938079 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.937894 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/630375c6-7f9a-463e-817b-eab421059c7d-data-volume\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.938079 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.937917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/630375c6-7f9a-463e-817b-eab421059c7d-crio-socket\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.938079 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.937939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/630375c6-7f9a-463e-817b-eab421059c7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.938079 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.938022 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/630375c6-7f9a-463e-817b-eab421059c7d-crio-socket\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.938319 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.938294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/630375c6-7f9a-463e-817b-eab421059c7d-data-volume\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.938540 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.938524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/630375c6-7f9a-463e-817b-eab421059c7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.940569 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.940547 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/630375c6-7f9a-463e-817b-eab421059c7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:56.946376 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:56.946342 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcgzw\" (UniqueName: \"kubernetes.io/projected/630375c6-7f9a-463e-817b-eab421059c7d-kube-api-access-bcgzw\") pod \"insights-runtime-extractor-jpr6g\" (UID: \"630375c6-7f9a-463e-817b-eab421059c7d\") " pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:57.083173 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:57.083081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpr6g" Jun 11 14:53:57.221294 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:57.221258 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpr6g"] Jun 11 14:53:57.224618 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:53:57.224583 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630375c6_7f9a_463e_817b_eab421059c7d.slice/crio-4c4c18d11a17705c4a143784a90f67df558d8c839002fbd4397c977d440e5d2c WatchSource:0}: Error finding container 4c4c18d11a17705c4a143784a90f67df558d8c839002fbd4397c977d440e5d2c: Status 404 returned error can't find the container with id 4c4c18d11a17705c4a143784a90f67df558d8c839002fbd4397c977d440e5d2c Jun 11 14:53:58.105414 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:58.105377 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpr6g" event={"ID":"630375c6-7f9a-463e-817b-eab421059c7d","Type":"ContainerStarted","Data":"fc9b10a8fd8cbea8bca0fd02b437292c29142bbd99b1dcc241398ef0510c57df"} Jun 11 14:53:58.105817 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:58.105453 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpr6g" event={"ID":"630375c6-7f9a-463e-817b-eab421059c7d","Type":"ContainerStarted","Data":"0f98dbc56a3fbdaa609b4e18fb33ffada8a0d192d45b5d163f6b00f6eb770ca8"} Jun 11 14:53:58.105817 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:53:58.105472 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpr6g" event={"ID":"630375c6-7f9a-463e-817b-eab421059c7d","Type":"ContainerStarted","Data":"4c4c18d11a17705c4a143784a90f67df558d8c839002fbd4397c977d440e5d2c"} Jun 11 14:54:00.115038 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:00.114999 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpr6g" event={"ID":"630375c6-7f9a-463e-817b-eab421059c7d","Type":"ContainerStarted","Data":"6578ed9b2ebf27cfc49e8a9b96af603101bf99db8464851da9d154525b73daea"} Jun 11 14:54:00.872655 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:00.872613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:54:00.875329 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:00.875297 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fpnqk\" (UID: \"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:54:01.135378 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:01.135274 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" Jun 11 14:54:01.273160 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:01.273093 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jpr6g" podStartSLOduration=3.1499077189999998 podStartE2EDuration="5.273076545s" totalImagesPullingTime="2.123168826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:53:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:00.133802023 +0000 UTC m=+226.179189439" watchObservedRunningTime="2026-06-11 14:54:01.273076545 +0000 UTC m=+227.318463950" Jun 11 14:54:01.274270 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:01.274242 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk"] Jun 11 14:54:01.278252 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:54:01.278226 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb5e2b7_4d4e_4f0a_a1d2_60e69cf6ba3c.slice/crio-4ea2e8676ac7a6901b722665bd77f551971493295062230e036e99b740134e2b WatchSource:0}: Error finding container 4ea2e8676ac7a6901b722665bd77f551971493295062230e036e99b740134e2b: Status 404 returned error can't find the container with id 4ea2e8676ac7a6901b722665bd77f551971493295062230e036e99b740134e2b Jun 11 14:54:02.122084 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:02.122049 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" event={"ID":"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c","Type":"ContainerStarted","Data":"4ea2e8676ac7a6901b722665bd77f551971493295062230e036e99b740134e2b"} Jun 11 14:54:04.129191 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:04.129149 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" event={"ID":"8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c","Type":"ContainerStarted","Data":"a0ad49b97314f95f6b908821512331d1b94aa5b61244a856d1d67e7409e5e170"} Jun 11 14:54:04.146778 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:04.146715 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fpnqk" podStartSLOduration=33.361465456 podStartE2EDuration="35.146694837s" totalImagesPullingTime="1.785229381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:04.145379482 +0000 UTC m=+230.190766880" watchObservedRunningTime="2026-06-11 14:54:04.146694837 +0000 UTC m=+230.192082246" Jun 11 14:54:05.600183 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.600146 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9"] Jun 11 14:54:05.607320 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.607292 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.611639 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.611483 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 14:54:05.611639 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.611561 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 14:54:05.611639 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.611613 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jc9js\"" Jun 11 14:54:05.611908 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.611671 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 14:54:05.613289 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.613259 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9"] Jun 11 14:54:05.713116 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.713068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.713279 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.713188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.713279 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.713222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l57q9\" (UniqueName: \"kubernetes.io/projected/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-kube-api-access-l57q9\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.713279 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.713257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.813597 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.813559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.813762 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.813622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.813762 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.813674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.813762 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.813698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l57q9\" (UniqueName: \"kubernetes.io/projected/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-kube-api-access-l57q9\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.814307 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.814272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.816126 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.816104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.816222 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.816108 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.821101 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.821056 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l57q9\" (UniqueName: \"kubernetes.io/projected/e4435c00-db25-4ae3-a406-3c2cda3ae8e0-kube-api-access-l57q9\") pod \"prometheus-operator-7f7d445d84-7pkj9\" (UID: \"e4435c00-db25-4ae3-a406-3c2cda3ae8e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:05.917867 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:05.917773 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" Jun 11 14:54:06.079254 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:06.079220 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9"] Jun 11 14:54:06.082494 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:54:06.082463 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4435c00_db25_4ae3_a406_3c2cda3ae8e0.slice/crio-e8db67b17c318e76310f172e095076f88f36522b4c4d13babfbb39942338bdbd WatchSource:0}: Error finding container e8db67b17c318e76310f172e095076f88f36522b4c4d13babfbb39942338bdbd: Status 404 returned error can't find the container with id e8db67b17c318e76310f172e095076f88f36522b4c4d13babfbb39942338bdbd Jun 11 14:54:06.137217 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:06.137176 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" event={"ID":"e4435c00-db25-4ae3-a406-3c2cda3ae8e0","Type":"ContainerStarted","Data":"e8db67b17c318e76310f172e095076f88f36522b4c4d13babfbb39942338bdbd"} Jun 11 14:54:08.145610 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:08.145571 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" event={"ID":"e4435c00-db25-4ae3-a406-3c2cda3ae8e0","Type":"ContainerStarted","Data":"6f864060c6f8144a12687d29c7daae8d7f164024fa9c9894927710c575acf1dd"} Jun 11 14:54:08.146034 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:08.145625 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" event={"ID":"e4435c00-db25-4ae3-a406-3c2cda3ae8e0","Type":"ContainerStarted","Data":"797fa0eeec5ed5cd561a5200cc5fd4ea0cf4021d22f8f3734c2687f7cdd6d48c"} Jun 11 14:54:08.162601 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:08.162548 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7pkj9" podStartSLOduration=1.832358729 podStartE2EDuration="3.16253053s" totalImagesPullingTime="1.330171801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:08.162222255 +0000 UTC m=+234.207609660" watchObservedRunningTime="2026-06-11 14:54:08.16253053 +0000 UTC m=+234.207917934" Jun 11 14:54:09.945332 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.945293 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn"] Jun 11 14:54:09.949633 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.949602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:09.952565 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.952536 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 14:54:09.952810 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.952781 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 14:54:09.953076 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.952572 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4lhfb\"" Jun 11 14:54:09.957676 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.957637 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn"] Jun 11 14:54:09.967640 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.967468 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j"] Jun 11 14:54:09.971090 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.971067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:09.973834 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.973808 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 14:54:09.974082 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.973843 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 14:54:09.974157 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.973842 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vn9c2\"" Jun 11 14:54:09.974157 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.973940 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 14:54:09.976724 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.976696 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hkvzm"] Jun 11 14:54:09.979813 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.979789 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:09.982977 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.982952 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t8gvg\"" Jun 11 14:54:09.983145 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.983123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 14:54:09.983288 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.983076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 14:54:09.983419 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.983399 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 14:54:09.983625 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:09.983600 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j"] Jun 11 14:54:10.048608 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14469488-91de-4f5a-9d3c-eb992bb9a453-sys\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.048608 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-textfile\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.048873 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.048873 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-tls\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.048873 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048771 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8fb46ef-3dce-41f5-aac8-73c6539c2604-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.048873 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67v7z\" (UniqueName: \"kubernetes.io/projected/32486209-d218-4855-a26b-0d7018374857-kube-api-access-67v7z\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.048873 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048865 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-wtmp\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.049119 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.049119 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/32486209-d218-4855-a26b-0d7018374857-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.049119 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.049119 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14469488-91de-4f5a-9d3c-eb992bb9a453-metrics-client-ca\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.049119 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.048998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxsdg\" (UniqueName: \"kubernetes.io/projected/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-api-access-wxsdg\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.049119 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.049088 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.049406 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.049118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-accelerators-collector-config\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.049406 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.049146 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32486209-d218-4855-a26b-0d7018374857-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.049406 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.049176 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8fb46ef-3dce-41f5-aac8-73c6539c2604-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.049406 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.049224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czpjz\" (UniqueName: \"kubernetes.io/projected/14469488-91de-4f5a-9d3c-eb992bb9a453-kube-api-access-czpjz\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.049406 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.049250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14469488-91de-4f5a-9d3c-eb992bb9a453-root\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.049406 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.049275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32486209-d218-4855-a26b-0d7018374857-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.149721 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.149678 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.149721 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.149732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-accelerators-collector-config\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.149999 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.149763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32486209-d218-4855-a26b-0d7018374857-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.149999 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.149790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8fb46ef-3dce-41f5-aac8-73c6539c2604-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.149999 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.149834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czpjz\" (UniqueName: \"kubernetes.io/projected/14469488-91de-4f5a-9d3c-eb992bb9a453-kube-api-access-czpjz\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.149999 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.149859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14469488-91de-4f5a-9d3c-eb992bb9a453-root\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.149999 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.149883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32486209-d218-4855-a26b-0d7018374857-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.149999 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.149923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14469488-91de-4f5a-9d3c-eb992bb9a453-sys\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.149999 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.149951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-textfile\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.149999 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.149977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.150374 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.150014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-tls\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.150374 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.150044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8fb46ef-3dce-41f5-aac8-73c6539c2604-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.150374 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.150072 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67v7z\" (UniqueName: \"kubernetes.io/projected/32486209-d218-4855-a26b-0d7018374857-kube-api-access-67v7z\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.150374 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.150132 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-wtmp\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.150374 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.150157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.150374 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.150183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/32486209-d218-4855-a26b-0d7018374857-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.150374 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.150208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.150374 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.150243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14469488-91de-4f5a-9d3c-eb992bb9a453-metrics-client-ca\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.150374 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.150268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxsdg\" (UniqueName: \"kubernetes.io/projected/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-api-access-wxsdg\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.150862 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.150836 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-wtmp\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.151043 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.151017 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-textfile\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.151365 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.151345 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8fb46ef-3dce-41f5-aac8-73c6539c2604-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.151775 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.151751 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14469488-91de-4f5a-9d3c-eb992bb9a453-root\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.151895 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.151773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14469488-91de-4f5a-9d3c-eb992bb9a453-sys\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.152066 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:54:10.152046 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 14:54:10.152459 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:54:10.152421 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32486209-d218-4855-a26b-0d7018374857-openshift-state-metrics-tls podName:32486209-d218-4855-a26b-0d7018374857 nodeName:}" failed. No retries permitted until 2026-06-11 14:54:10.652381385 +0000 UTC m=+236.697768769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/32486209-d218-4855-a26b-0d7018374857-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-jqpnn" (UID: "32486209-d218-4855-a26b-0d7018374857") : secret "openshift-state-metrics-tls" not found Jun 11 14:54:10.152761 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.152629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-accelerators-collector-config\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.152761 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:54:10.152144 2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 14:54:10.152761 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:54:10.152713 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-tls podName:a8fb46ef-3dce-41f5-aac8-73c6539c2604 nodeName:}" failed. No retries permitted until 2026-06-11 14:54:10.652694711 +0000 UTC m=+236.698082101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-7z45j" (UID: "a8fb46ef-3dce-41f5-aac8-73c6539c2604") : secret "kube-state-metrics-tls" not found Jun 11 14:54:10.152761 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.152163 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14469488-91de-4f5a-9d3c-eb992bb9a453-metrics-client-ca\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.153994 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.153703 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8fb46ef-3dce-41f5-aac8-73c6539c2604-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.153994 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.153950 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32486209-d218-4855-a26b-0d7018374857-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.154308 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:54:10.154226 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 14:54:10.154308 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:54:10.154279 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-tls podName:14469488-91de-4f5a-9d3c-eb992bb9a453 nodeName:}" failed. No retries permitted until 2026-06-11 14:54:10.65426292 +0000 UTC m=+236.699650309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-tls") pod "node-exporter-hkvzm" (UID: "14469488-91de-4f5a-9d3c-eb992bb9a453") : secret "node-exporter-tls" not found Jun 11 14:54:10.154308 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.154294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.155294 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.155248 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.157373 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.157227 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32486209-d218-4855-a26b-0d7018374857-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.157373 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.157294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.160187 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.160157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxsdg\" (UniqueName: \"kubernetes.io/projected/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-api-access-wxsdg\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.163694 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.163141 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67v7z\" (UniqueName: \"kubernetes.io/projected/32486209-d218-4855-a26b-0d7018374857-kube-api-access-67v7z\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.164544 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.164519 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czpjz\" (UniqueName: \"kubernetes.io/projected/14469488-91de-4f5a-9d3c-eb992bb9a453-kube-api-access-czpjz\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.655379 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.655338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/32486209-d218-4855-a26b-0d7018374857-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.655379 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.655380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.655643 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.655475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-tls\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.657938 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.657903 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14469488-91de-4f5a-9d3c-eb992bb9a453-node-exporter-tls\") pod \"node-exporter-hkvzm\" (UID: \"14469488-91de-4f5a-9d3c-eb992bb9a453\") " pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.658096 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.658077 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fb46ef-3dce-41f5-aac8-73c6539c2604-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7z45j\" (UID: \"a8fb46ef-3dce-41f5-aac8-73c6539c2604\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.658186 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.658162 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/32486209-d218-4855-a26b-0d7018374857-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-jqpnn\" (UID: \"32486209-d218-4855-a26b-0d7018374857\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.862716 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.862683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" Jun 11 14:54:10.884127 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.884086 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" Jun 11 14:54:10.894516 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:10.894255 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hkvzm" Jun 11 14:54:10.910933 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:54:10.910868 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14469488_91de_4f5a_9d3c_eb992bb9a453.slice/crio-542a07ce88a3c92f66b9218a3d9c5d45f80c58ff33ff95c835a0510452d7a350 WatchSource:0}: Error finding container 542a07ce88a3c92f66b9218a3d9c5d45f80c58ff33ff95c835a0510452d7a350: Status 404 returned error can't find the container with id 542a07ce88a3c92f66b9218a3d9c5d45f80c58ff33ff95c835a0510452d7a350 Jun 11 14:54:11.077527 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:11.077262 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn"] Jun 11 14:54:11.080213 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:54:11.080181 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32486209_d218_4855_a26b_0d7018374857.slice/crio-9f774f858eece0d3291c00c643e0d39fd421eef5c348a6e2a1b838b01af2ea01 WatchSource:0}: Error finding container 9f774f858eece0d3291c00c643e0d39fd421eef5c348a6e2a1b838b01af2ea01: Status 404 returned error can't find the container with id 9f774f858eece0d3291c00c643e0d39fd421eef5c348a6e2a1b838b01af2ea01 Jun 11 14:54:11.103083 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:11.102898 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j"] Jun 11 14:54:11.116008 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:54:11.115960 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fb46ef_3dce_41f5_aac8_73c6539c2604.slice/crio-8dd5a2ec92c356498410dd8fb92dcd084bc812c9733603bfb6cb0d6796959bc2 WatchSource:0}: Error finding container 8dd5a2ec92c356498410dd8fb92dcd084bc812c9733603bfb6cb0d6796959bc2: Status 404 returned error can't find the container with id 8dd5a2ec92c356498410dd8fb92dcd084bc812c9733603bfb6cb0d6796959bc2 Jun 11 14:54:11.162395 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:11.162264 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkvzm" event={"ID":"14469488-91de-4f5a-9d3c-eb992bb9a453","Type":"ContainerStarted","Data":"542a07ce88a3c92f66b9218a3d9c5d45f80c58ff33ff95c835a0510452d7a350"} Jun 11 14:54:11.163700 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:11.163665 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" event={"ID":"a8fb46ef-3dce-41f5-aac8-73c6539c2604","Type":"ContainerStarted","Data":"8dd5a2ec92c356498410dd8fb92dcd084bc812c9733603bfb6cb0d6796959bc2"} Jun 11 14:54:11.165679 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:11.165617 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" event={"ID":"32486209-d218-4855-a26b-0d7018374857","Type":"ContainerStarted","Data":"9f774f858eece0d3291c00c643e0d39fd421eef5c348a6e2a1b838b01af2ea01"} Jun 11 14:54:12.172653 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:12.172608 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" event={"ID":"32486209-d218-4855-a26b-0d7018374857","Type":"ContainerStarted","Data":"b9259bf792895d810bb938ded553b103eac51e50e18883f28700ce64dbb2123b"} Jun 11 14:54:12.173101 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:12.172692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" event={"ID":"32486209-d218-4855-a26b-0d7018374857","Type":"ContainerStarted","Data":"e7cbbff7faebe02e3e07017ef4f9c17681de2d64e9d8be2809363b6453864f5f"} Jun 11 14:54:13.177780 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:13.177660 2562 generic.go:356] "Generic (PLEG): container finished" podID="14469488-91de-4f5a-9d3c-eb992bb9a453" containerID="f4e1f1b0fdf1f0c78e2020966e04e3e13d83d8ca39489ec281571a10ca70904e" exitCode=0 Jun 11 14:54:13.177780 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:13.177748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkvzm" event={"ID":"14469488-91de-4f5a-9d3c-eb992bb9a453","Type":"ContainerDied","Data":"f4e1f1b0fdf1f0c78e2020966e04e3e13d83d8ca39489ec281571a10ca70904e"} Jun 11 14:54:13.180040 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:13.180009 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" event={"ID":"a8fb46ef-3dce-41f5-aac8-73c6539c2604","Type":"ContainerStarted","Data":"79b4621bb482079c73741fe2aa179e7d0716815ce31f76ffcec42cc4dd841579"} Jun 11 14:54:13.180191 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:13.180069 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" event={"ID":"a8fb46ef-3dce-41f5-aac8-73c6539c2604","Type":"ContainerStarted","Data":"66ea81d452be381ac6b302e3b101b6e1b720e85bbcaca03e24ecdf46afe7d81b"} Jun 11 14:54:13.180191 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:13.180097 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" event={"ID":"a8fb46ef-3dce-41f5-aac8-73c6539c2604","Type":"ContainerStarted","Data":"b1ff477c38bdce36bf8dd388c8f413554390572e012e748b0f74461d5f06befd"} Jun 11 14:54:13.182544 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:13.182459 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" event={"ID":"32486209-d218-4855-a26b-0d7018374857","Type":"ContainerStarted","Data":"cf4201a25c5b9a890bb881800ae9594754ed12b9e3c960a1474ce29b8b40416c"} Jun 11 14:54:13.211979 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:13.211921 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-jqpnn" podStartSLOduration=2.82953321 podStartE2EDuration="4.211902418s" totalImagesPullingTime="1.382369208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:13.210236791 +0000 UTC m=+239.255624196" watchObservedRunningTime="2026-06-11 14:54:13.211902418 +0000 UTC m=+239.257289824" Jun 11 14:54:13.232547 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:13.232486 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7z45j" podStartSLOduration=3.010912024 podStartE2EDuration="4.232461176s" totalImagesPullingTime="1.221549152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:13.230998572 +0000 UTC m=+239.276385974" watchObservedRunningTime="2026-06-11 14:54:13.232461176 +0000 UTC m=+239.277848582" Jun 11 14:54:14.188646 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.188606 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkvzm" event={"ID":"14469488-91de-4f5a-9d3c-eb992bb9a453","Type":"ContainerStarted","Data":"98d1fb3479df3eddab0e548f95273555207ec32412099b760bc5fbaca307be5a"} Jun 11 14:54:14.189104 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.188669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hkvzm" event={"ID":"14469488-91de-4f5a-9d3c-eb992bb9a453","Type":"ContainerStarted","Data":"2513969befb8a841448f5c21ee60304ce10348416efa3a60c683f82b2e123b60"} Jun 11 14:54:14.209494 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.209410 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hkvzm" podStartSLOduration=3.740094677 podStartE2EDuration="5.209391094s" totalImagesPullingTime="1.379362759s" totalInitContainerRuntime="89.933658ms" isStatefulPod=true podCreationTimestamp="2026-06-11 14:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:14.207421498 +0000 UTC m=+240.252808929" watchObservedRunningTime="2026-06-11 14:54:14.209391094 +0000 UTC m=+240.254778499" Jun 11 14:54:14.715724 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.715686 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-49mw7"] Jun 11 14:54:14.719982 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.719955 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" Jun 11 14:54:14.722354 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.722318 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 14:54:14.722525 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.722485 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-shwz8\"" Jun 11 14:54:14.726171 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.726133 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-49mw7"] Jun 11 14:54:14.807941 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.807896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d538102-4200-44ab-b996-74050d37eba4-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-49mw7\" (UID: \"8d538102-4200-44ab-b996-74050d37eba4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" Jun 11 14:54:14.808150 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.808031 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vmvh\" (UniqueName: \"kubernetes.io/projected/8d538102-4200-44ab-b996-74050d37eba4-kube-api-access-4vmvh\") pod \"monitoring-plugin-76b68cc874-49mw7\" (UID: \"8d538102-4200-44ab-b996-74050d37eba4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" Jun 11 14:54:14.908529 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.908462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vmvh\" (UniqueName: \"kubernetes.io/projected/8d538102-4200-44ab-b996-74050d37eba4-kube-api-access-4vmvh\") pod \"monitoring-plugin-76b68cc874-49mw7\" (UID: \"8d538102-4200-44ab-b996-74050d37eba4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" Jun 11 14:54:14.908718 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.908546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d538102-4200-44ab-b996-74050d37eba4-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-49mw7\" (UID: \"8d538102-4200-44ab-b996-74050d37eba4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" Jun 11 14:54:14.911307 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.911275 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d538102-4200-44ab-b996-74050d37eba4-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-49mw7\" (UID: \"8d538102-4200-44ab-b996-74050d37eba4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" Jun 11 14:54:14.916615 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:14.916577 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vmvh\" (UniqueName: \"kubernetes.io/projected/8d538102-4200-44ab-b996-74050d37eba4-kube-api-access-4vmvh\") pod \"monitoring-plugin-76b68cc874-49mw7\" (UID: \"8d538102-4200-44ab-b996-74050d37eba4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" Jun 11 14:54:15.032831 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.032784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" Jun 11 14:54:15.138726 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.138658 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k"] Jun 11 14:54:15.143284 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.143253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.147413 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.147368 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-v6tjr\"" Jun 11 14:54:15.147713 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.147553 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 14:54:15.147713 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.147668 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 14:54:15.147713 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.147368 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 14:54:15.147899 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.147723 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 14:54:15.147899 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.147868 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 14:54:15.153509 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.153278 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 14:54:15.155918 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.155809 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k"] Jun 11 14:54:15.184964 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.184928 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-49mw7"] Jun 11 14:54:15.187985 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:54:15.187953 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d538102_4200_44ab_b996_74050d37eba4.slice/crio-d08a5dd5afa39a9ae969d981fa533a48afcd8529765cce18e848cb3c2dd5cb28 WatchSource:0}: Error finding container d08a5dd5afa39a9ae969d981fa533a48afcd8529765cce18e848cb3c2dd5cb28: Status 404 returned error can't find the container with id d08a5dd5afa39a9ae969d981fa533a48afcd8529765cce18e848cb3c2dd5cb28 Jun 11 14:54:15.193015 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.192981 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" event={"ID":"8d538102-4200-44ab-b996-74050d37eba4","Type":"ContainerStarted","Data":"d08a5dd5afa39a9ae969d981fa533a48afcd8529765cce18e848cb3c2dd5cb28"} Jun 11 14:54:15.211333 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.211284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-telemeter-client-tls\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.211533 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.211340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/697ecff3-1654-416a-978c-e96762bc92d9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.211533 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.211394 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-secret-telemeter-client\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.211533 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.211449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-federate-client-tls\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.211533 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.211476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/697ecff3-1654-416a-978c-e96762bc92d9-metrics-client-ca\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.211533 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.211526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.211692 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.211565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/697ecff3-1654-416a-978c-e96762bc92d9-serving-certs-ca-bundle\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.211692 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.211618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2jt8\" (UniqueName: \"kubernetes.io/projected/697ecff3-1654-416a-978c-e96762bc92d9-kube-api-access-n2jt8\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.312135 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.312052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2jt8\" (UniqueName: \"kubernetes.io/projected/697ecff3-1654-416a-978c-e96762bc92d9-kube-api-access-n2jt8\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.312135 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.312128 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-telemeter-client-tls\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.312314 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.312149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/697ecff3-1654-416a-978c-e96762bc92d9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.312314 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.312165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-secret-telemeter-client\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.312314 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.312184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-federate-client-tls\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.312314 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.312211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/697ecff3-1654-416a-978c-e96762bc92d9-metrics-client-ca\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.312535 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.312340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.312535 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.312413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/697ecff3-1654-416a-978c-e96762bc92d9-serving-certs-ca-bundle\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.313160 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.313132 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/697ecff3-1654-416a-978c-e96762bc92d9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.313468 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.313416 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/697ecff3-1654-416a-978c-e96762bc92d9-metrics-client-ca\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.313566 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.313541 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/697ecff3-1654-416a-978c-e96762bc92d9-serving-certs-ca-bundle\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.315096 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.315071 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.315180 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.315165 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-federate-client-tls\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.315484 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.315465 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-secret-telemeter-client\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.315522 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.315462 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/697ecff3-1654-416a-978c-e96762bc92d9-telemeter-client-tls\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.319971 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.319948 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2jt8\" (UniqueName: \"kubernetes.io/projected/697ecff3-1654-416a-978c-e96762bc92d9-kube-api-access-n2jt8\") pod \"telemeter-client-5bd9ff6b64-56b5k\" (UID: \"697ecff3-1654-416a-978c-e96762bc92d9\") " pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.457474 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.457410 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" Jun 11 14:54:15.602034 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:15.601944 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k"] Jun 11 14:54:15.606629 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:54:15.606591 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697ecff3_1654_416a_978c_e96762bc92d9.slice/crio-e6b6716ccb8243afe659c386873dc0e84b858a44e1481baaf9778195e55a429e WatchSource:0}: Error finding container e6b6716ccb8243afe659c386873dc0e84b858a44e1481baaf9778195e55a429e: Status 404 returned error can't find the container with id e6b6716ccb8243afe659c386873dc0e84b858a44e1481baaf9778195e55a429e Jun 11 14:54:16.199651 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:16.199597 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" event={"ID":"697ecff3-1654-416a-978c-e96762bc92d9","Type":"ContainerStarted","Data":"e6b6716ccb8243afe659c386873dc0e84b858a44e1481baaf9778195e55a429e"} Jun 11 14:54:17.205051 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:17.205015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" event={"ID":"8d538102-4200-44ab-b996-74050d37eba4","Type":"ContainerStarted","Data":"823353dec6dd7895c0d61858e7195c51dd01516362551b1250a0d4fbf8267ea1"} Jun 11 14:54:17.205495 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:17.205217 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" Jun 11 14:54:17.210766 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:17.210736 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" Jun 11 14:54:17.220546 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:17.220494 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-49mw7" podStartSLOduration=1.901654454 podStartE2EDuration="3.220470863s" totalImagesPullingTime="1.318816409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:54:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:17.219384109 +0000 UTC m=+243.264771516" watchObservedRunningTime="2026-06-11 14:54:17.220470863 +0000 UTC m=+243.265858267" Jun 11 14:54:18.210816 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:18.210720 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" event={"ID":"697ecff3-1654-416a-978c-e96762bc92d9","Type":"ContainerStarted","Data":"0c383c92b947dc828c2c9e9562fd5a7490bf8cd794a61ce4723d8df1e00de668"} Jun 11 14:54:19.216915 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:19.216816 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" event={"ID":"697ecff3-1654-416a-978c-e96762bc92d9","Type":"ContainerStarted","Data":"487968b5169d7495c86b88d88aec7102ebb1d9b2bf7cc92e9af862c60e862731"} Jun 11 14:54:19.216915 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:19.216877 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" event={"ID":"697ecff3-1654-416a-978c-e96762bc92d9","Type":"ContainerStarted","Data":"407be0620134b4524250182d0d4e373a05385ad4f19bd81c560c50896091ad70"} Jun 11 14:54:26.313982 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:26.313850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:54:26.316747 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:26.316714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c70a562-3b07-482e-bbaa-a285419c369b-metrics-certs\") pod \"network-metrics-daemon-chz6g\" (UID: \"6c70a562-3b07-482e-bbaa-a285419c369b\") " pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:54:26.330047 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:26.330013 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fhnff\"" Jun 11 14:54:26.338830 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:26.338499 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chz6g" Jun 11 14:54:26.483483 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:26.483389 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5bd9ff6b64-56b5k" podStartSLOduration=8.319198702 podStartE2EDuration="11.483364965s" totalImagesPullingTime="3.164166263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:54:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:19.238065844 +0000 UTC m=+245.283453249" watchObservedRunningTime="2026-06-11 14:54:26.483364965 +0000 UTC m=+252.528752372" Jun 11 14:54:26.484629 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:26.484598 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-chz6g"] Jun 11 14:54:26.487696 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:54:26.487666 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c70a562_3b07_482e_bbaa_a285419c369b.slice/crio-1a710db7a0699075edc880b29b0858519cb795529a1810621b89b63f9cd3525f WatchSource:0}: Error finding container 1a710db7a0699075edc880b29b0858519cb795529a1810621b89b63f9cd3525f: Status 404 returned error can't find the container with id 1a710db7a0699075edc880b29b0858519cb795529a1810621b89b63f9cd3525f Jun 11 14:54:27.249688 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:27.249641 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chz6g" event={"ID":"6c70a562-3b07-482e-bbaa-a285419c369b","Type":"ContainerStarted","Data":"1a710db7a0699075edc880b29b0858519cb795529a1810621b89b63f9cd3525f"} Jun 11 14:54:28.255602 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:28.255563 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chz6g" event={"ID":"6c70a562-3b07-482e-bbaa-a285419c369b","Type":"ContainerStarted","Data":"4e370edf7d94d288c70265f54cf798285fe04606d1c3b1dd2c6d8bf33ee46ce3"} Jun 11 14:54:28.256090 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:28.255616 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chz6g" event={"ID":"6c70a562-3b07-482e-bbaa-a285419c369b","Type":"ContainerStarted","Data":"7791a924a91f07f724598463c2120ac0a61527c9b67ac091f9a3642141d60a7f"} Jun 11 14:54:28.271260 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:28.271203 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-chz6g" podStartSLOduration=253.395456254 podStartE2EDuration="4m14.271188361s" totalImagesPullingTime="875.732107ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:28.269365206 +0000 UTC m=+254.314752621" watchObservedRunningTime="2026-06-11 14:54:28.271188361 +0000 UTC m=+254.316575820" Jun 11 14:54:38.293785 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:38.293751 2562 generic.go:356] "Generic (PLEG): container finished" podID="626dba83-f084-4110-881c-6a195a681010" containerID="46714dd9278bfafbc99accb04488c1f7dac41ff43f5d2478e0a634b3b832d529" exitCode=0 Jun 11 14:54:38.294403 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:38.293824 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" event={"ID":"626dba83-f084-4110-881c-6a195a681010","Type":"ContainerDied","Data":"46714dd9278bfafbc99accb04488c1f7dac41ff43f5d2478e0a634b3b832d529"} Jun 11 14:54:38.294403 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:38.294218 2562 scope.go:117] "RemoveContainer" containerID="46714dd9278bfafbc99accb04488c1f7dac41ff43f5d2478e0a634b3b832d529" Jun 11 14:54:38.295608 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:38.295582 2562 generic.go:356] "Generic (PLEG): container finished" podID="433fc2e0-5ffb-406b-989f-96ce70213829" containerID="321075bdc1f6f14527f654a2635d6da289459dc6fbe4df3d7e044cce52f8dd7b" exitCode=0 Jun 11 14:54:38.295726 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:38.295624 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" event={"ID":"433fc2e0-5ffb-406b-989f-96ce70213829","Type":"ContainerDied","Data":"321075bdc1f6f14527f654a2635d6da289459dc6fbe4df3d7e044cce52f8dd7b"} Jun 11 14:54:38.295922 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:38.295906 2562 scope.go:117] "RemoveContainer" containerID="321075bdc1f6f14527f654a2635d6da289459dc6fbe4df3d7e044cce52f8dd7b" Jun 11 14:54:39.302209 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:39.302166 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-rlk4x" event={"ID":"626dba83-f084-4110-881c-6a195a681010","Type":"ContainerStarted","Data":"a23455aa62efed58d197be8816694073a241202491331c9c9ede0e76ce3ff0ab"} Jun 11 14:54:39.304152 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:39.304120 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xc45j" event={"ID":"433fc2e0-5ffb-406b-989f-96ce70213829","Type":"ContainerStarted","Data":"c09486d450526da44927cb8a5865308ca2e5b795ad1028cdf698f12366efb892"} Jun 11 14:54:43.875854 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.875814 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c6f89cc57-8xczv"] Jun 11 14:54:43.880836 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.880807 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:43.883481 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.883452 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 14:54:43.883481 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.883465 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 14:54:43.883673 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.883452 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 14:54:43.883673 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.883452 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 14:54:43.884768 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.884746 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x2z78\"" Jun 11 14:54:43.884768 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.884767 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 14:54:43.884949 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.884783 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 14:54:43.884949 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.884858 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 14:54:43.890305 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.890276 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 14:54:43.890866 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.890843 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6f89cc57-8xczv"] Jun 11 14:54:43.969575 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.969534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-oauth-serving-cert\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:43.969782 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.969593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-serving-cert\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:43.969782 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.969630 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-oauth-config\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:43.969782 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.969682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfwdt\" (UniqueName: \"kubernetes.io/projected/b0996cb9-794f-46a4-85db-bdd02468cd09-kube-api-access-sfwdt\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:43.969782 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.969700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-console-config\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:43.969782 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.969717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-service-ca\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:43.969969 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:43.969793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-trusted-ca-bundle\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.070847 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.070807 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-serving-cert\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.070847 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.070845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-oauth-config\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.071053 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.070908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfwdt\" (UniqueName: \"kubernetes.io/projected/b0996cb9-794f-46a4-85db-bdd02468cd09-kube-api-access-sfwdt\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.071053 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.070926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-console-config\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.071053 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.070943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-service-ca\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.071053 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.070982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-trusted-ca-bundle\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.071053 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.071012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-oauth-serving-cert\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.071836 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.071759 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-console-config\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.071836 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.071821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-service-ca\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.071836 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.071824 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-oauth-serving-cert\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.072066 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.071876 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-trusted-ca-bundle\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.073627 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.073592 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-oauth-config\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.073746 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.073688 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-serving-cert\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.079713 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.079687 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfwdt\" (UniqueName: \"kubernetes.io/projected/b0996cb9-794f-46a4-85db-bdd02468cd09-kube-api-access-sfwdt\") pod \"console-c6f89cc57-8xczv\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.191937 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.191839 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:44.329752 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:44.329716 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6f89cc57-8xczv"] Jun 11 14:54:44.333037 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:54:44.333005 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0996cb9_794f_46a4_85db_bdd02468cd09.slice/crio-a4e3b53fb9abf1dc6e98070cf885a25c5d17695393c14a2ce4f757b8f44396cf WatchSource:0}: Error finding container a4e3b53fb9abf1dc6e98070cf885a25c5d17695393c14a2ce4f757b8f44396cf: Status 404 returned error can't find the container with id a4e3b53fb9abf1dc6e98070cf885a25c5d17695393c14a2ce4f757b8f44396cf Jun 11 14:54:45.327476 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:45.327413 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6f89cc57-8xczv" event={"ID":"b0996cb9-794f-46a4-85db-bdd02468cd09","Type":"ContainerStarted","Data":"a4e3b53fb9abf1dc6e98070cf885a25c5d17695393c14a2ce4f757b8f44396cf"} Jun 11 14:54:47.336587 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:47.336487 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6f89cc57-8xczv" event={"ID":"b0996cb9-794f-46a4-85db-bdd02468cd09","Type":"ContainerStarted","Data":"c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294"} Jun 11 14:54:47.356464 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:47.355638 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c6f89cc57-8xczv" podStartSLOduration=1.6061024640000001 podStartE2EDuration="4.355614078s" totalImagesPullingTime="2.749511614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:47.352327496 +0000 UTC m=+273.397714901" watchObservedRunningTime="2026-06-11 14:54:47.355614078 +0000 UTC m=+273.401001482" Jun 11 14:54:54.192834 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:54.192789 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:54.193254 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:54.192897 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:54:54.194285 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:54.194255 2562 patch_prober.go:28] interesting pod/console-c6f89cc57-8xczv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 11 14:54:54.194411 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:54.194319 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c6f89cc57-8xczv" podUID="b0996cb9-794f-46a4-85db-bdd02468cd09" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 11 14:54:54.908968 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:54:54.908911 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7wn45" podUID="baa10ca3-dc20-47bd-a6b3-38e10bac1b3e" Jun 11 14:54:54.908968 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:54:54.908929 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" podUID="493f3b97-15ec-48bb-98ee-418ade520c8f" Jun 11 14:54:55.367615 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:55.367582 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:54:55.368074 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:55.367589 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7wn45" Jun 11 14:54:58.810362 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:58.810318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:54:58.810362 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:58.810370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:54:58.812897 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:58.812868 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/baa10ca3-dc20-47bd-a6b3-38e10bac1b3e-metrics-tls\") pod \"dns-default-7wn45\" (UID: \"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e\") " pod="openshift-dns/dns-default-7wn45" Jun 11 14:54:58.813119 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:58.813096 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"image-registry-858c5d4694-6j4x4\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:54:58.971674 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:58.971642 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5zf7p\"" Jun 11 14:54:58.971859 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:58.971642 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zx6z7\"" Jun 11 14:54:58.978807 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:58.978777 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7wn45" Jun 11 14:54:58.978948 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:58.978931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:54:59.139726 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:59.139701 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-858c5d4694-6j4x4"] Jun 11 14:54:59.142039 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:54:59.142012 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493f3b97_15ec_48bb_98ee_418ade520c8f.slice/crio-43b14f8b6dbf74c0742ca862690b6d6acc515c22c2dd8b3b65d4e845fbe84f44 WatchSource:0}: Error finding container 43b14f8b6dbf74c0742ca862690b6d6acc515c22c2dd8b3b65d4e845fbe84f44: Status 404 returned error can't find the container with id 43b14f8b6dbf74c0742ca862690b6d6acc515c22c2dd8b3b65d4e845fbe84f44 Jun 11 14:54:59.153312 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:59.153289 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7wn45"] Jun 11 14:54:59.156046 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:54:59.156015 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa10ca3_dc20_47bd_a6b3_38e10bac1b3e.slice/crio-5c6d7c556ddbc4b359a1b125b6bcc31f002af275394ea4552950ba7cd16feb1a WatchSource:0}: Error finding container 5c6d7c556ddbc4b359a1b125b6bcc31f002af275394ea4552950ba7cd16feb1a: Status 404 returned error can't find the container with id 5c6d7c556ddbc4b359a1b125b6bcc31f002af275394ea4552950ba7cd16feb1a Jun 11 14:54:59.385248 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:59.385161 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" event={"ID":"493f3b97-15ec-48bb-98ee-418ade520c8f","Type":"ContainerStarted","Data":"6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d"} Jun 11 14:54:59.385248 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:59.385255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" event={"ID":"493f3b97-15ec-48bb-98ee-418ade520c8f","Type":"ContainerStarted","Data":"43b14f8b6dbf74c0742ca862690b6d6acc515c22c2dd8b3b65d4e845fbe84f44"} Jun 11 14:54:59.385602 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:59.385297 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:54:59.386410 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:59.386385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7wn45" event={"ID":"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e","Type":"ContainerStarted","Data":"5c6d7c556ddbc4b359a1b125b6bcc31f002af275394ea4552950ba7cd16feb1a"} Jun 11 14:54:59.406925 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:54:59.406867 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" podStartSLOduration=285.406849903 podStartE2EDuration="4m45.406849903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:54:59.404471485 +0000 UTC m=+285.449858890" watchObservedRunningTime="2026-06-11 14:54:59.406849903 +0000 UTC m=+285.452237303" Jun 11 14:55:01.397321 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:01.397282 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7wn45" event={"ID":"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e","Type":"ContainerStarted","Data":"9b6e585b0289ec77b8b11d961dac8bf4b261a09d3987643f0992f72df2d84e16"} Jun 11 14:55:01.397797 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:01.397334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7wn45" event={"ID":"baa10ca3-dc20-47bd-a6b3-38e10bac1b3e","Type":"ContainerStarted","Data":"fb84bc1586ba07583060dfc81447ecdbffdc09ae1e29329148313ea1f5293116"} Jun 11 14:55:01.397797 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:01.397398 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7wn45" Jun 11 14:55:01.413797 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:01.413745 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7wn45" podStartSLOduration=251.870542749 podStartE2EDuration="4m13.41372573s" totalImagesPullingTime="1.543182981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:55:01.412730184 +0000 UTC m=+287.458117588" watchObservedRunningTime="2026-06-11 14:55:01.41372573 +0000 UTC m=+287.459113133" Jun 11 14:55:03.406135 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:03.406097 2562 generic.go:356] "Generic (PLEG): container finished" podID="72613a71-d9bd-4b3f-80c7-5ca7982b8db6" containerID="d8532286519587ca821d11a0640059b62ad2c2f94f2362cf00f5c333da895f01" exitCode=0 Jun 11 14:55:03.406563 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:03.406157 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8jp5g" event={"ID":"72613a71-d9bd-4b3f-80c7-5ca7982b8db6","Type":"ContainerDied","Data":"d8532286519587ca821d11a0640059b62ad2c2f94f2362cf00f5c333da895f01"} Jun 11 14:55:03.406563 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:03.406495 2562 scope.go:117] "RemoveContainer" containerID="d8532286519587ca821d11a0640059b62ad2c2f94f2362cf00f5c333da895f01" Jun 11 14:55:04.192335 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:04.192293 2562 patch_prober.go:28] interesting pod/console-c6f89cc57-8xczv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 11 14:55:04.192560 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:04.192357 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c6f89cc57-8xczv" podUID="b0996cb9-794f-46a4-85db-bdd02468cd09" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 11 14:55:04.414403 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:04.414366 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8jp5g" event={"ID":"72613a71-d9bd-4b3f-80c7-5ca7982b8db6","Type":"ContainerStarted","Data":"325d0de44841983fa308525537429f3ab2c0c6b349800311efdcf14bb922de7c"} Jun 11 14:55:07.928754 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:07.928720 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-fpnqk_8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c/cluster-monitoring-operator/0.log" Jun 11 14:55:08.127728 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:08.127698 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7z45j_a8fb46ef-3dce-41f5-aac8-73c6539c2604/kube-state-metrics/0.log" Jun 11 14:55:08.326863 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:08.326830 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7z45j_a8fb46ef-3dce-41f5-aac8-73c6539c2604/kube-rbac-proxy-main/0.log" Jun 11 14:55:08.527800 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:08.527767 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7z45j_a8fb46ef-3dce-41f5-aac8-73c6539c2604/kube-rbac-proxy-self/0.log" Jun 11 14:55:08.928622 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:08.928588 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-49mw7_8d538102-4200-44ab-b996-74050d37eba4/monitoring-plugin/0.log" Jun 11 14:55:10.328295 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:10.328269 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkvzm_14469488-91de-4f5a-9d3c-eb992bb9a453/init-textfile/0.log" Jun 11 14:55:10.527989 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:10.527926 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkvzm_14469488-91de-4f5a-9d3c-eb992bb9a453/node-exporter/0.log" Jun 11 14:55:10.730229 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:10.730201 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkvzm_14469488-91de-4f5a-9d3c-eb992bb9a453/kube-rbac-proxy/0.log" Jun 11 14:55:10.929921 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:10.929887 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jqpnn_32486209-d218-4855-a26b-0d7018374857/kube-rbac-proxy-main/0.log" Jun 11 14:55:11.127486 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:11.127412 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jqpnn_32486209-d218-4855-a26b-0d7018374857/kube-rbac-proxy-self/0.log" Jun 11 14:55:11.327202 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:11.327173 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jqpnn_32486209-d218-4855-a26b-0d7018374857/openshift-state-metrics/0.log" Jun 11 14:55:11.403255 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:11.403178 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7wn45" Jun 11 14:55:12.927752 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:12.927717 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7pkj9_e4435c00-db25-4ae3-a406-3c2cda3ae8e0/prometheus-operator/0.log" Jun 11 14:55:13.126712 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:13.126683 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7pkj9_e4435c00-db25-4ae3-a406-3c2cda3ae8e0/kube-rbac-proxy/0.log" Jun 11 14:55:13.527667 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:13.527640 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bd9ff6b64-56b5k_697ecff3-1654-416a-978c-e96762bc92d9/telemeter-client/0.log" Jun 11 14:55:13.726680 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:13.726649 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bd9ff6b64-56b5k_697ecff3-1654-416a-978c-e96762bc92d9/reload/0.log" Jun 11 14:55:13.927718 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:13.927638 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bd9ff6b64-56b5k_697ecff3-1654-416a-978c-e96762bc92d9/kube-rbac-proxy/0.log" Jun 11 14:55:14.196767 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:14.196680 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:55:14.200671 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:14.200641 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:55:14.384218 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:14.384186 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 14:55:14.391086 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:14.391059 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 14:55:14.391268 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:14.391258 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 14:55:16.127881 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:16.127845 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c6f89cc57-8xczv_b0996cb9-794f-46a4-85db-bdd02468cd09/console/0.log" Jun 11 14:55:16.528183 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:16.528147 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7wn45_baa10ca3-dc20-47bd-a6b3-38e10bac1b3e/dns/0.log" Jun 11 14:55:16.726787 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:16.726757 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7wn45_baa10ca3-dc20-47bd-a6b3-38e10bac1b3e/kube-rbac-proxy/0.log" Jun 11 14:55:17.927128 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:17.927098 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sq4qw_8c7f7145-6dd1-4bcd-bc44-acd990a2d517/dns-node-resolver/0.log" Jun 11 14:55:18.728194 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:18.728161 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-858c5d4694-6j4x4_493f3b97-15ec-48bb-98ee-418ade520c8f/registry/0.log" Jun 11 14:55:18.983477 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:18.983356 2562 patch_prober.go:28] interesting pod/image-registry-858c5d4694-6j4x4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:55:18.983477 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:18.983425 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" podUID="493f3b97-15ec-48bb-98ee-418ade520c8f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:55:19.127378 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:19.127348 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7d55_40ea14c6-cca7-4e29-89e7-12e1a626e0f5/node-ca/0.log" Jun 11 14:55:19.528724 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:19.528691 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdbc75df-j55tt_41629d05-8b07-4ceb-acf5-228f076da1a4/router/0.log" Jun 11 14:55:20.127589 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:20.127556 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hk7zh_36b795d5-21e0-40ca-a94e-e268fca1e2a5/serve-healthcheck-canary/0.log" Jun 11 14:55:20.396135 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:20.396060 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:55:25.273003 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:25.272964 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-858c5d4694-6j4x4"] Jun 11 14:55:28.480637 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.480592 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5755d49cbc-5ssdg"] Jun 11 14:55:28.485571 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.485539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.496651 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.496614 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5755d49cbc-5ssdg"] Jun 11 14:55:28.568074 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.568031 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-trusted-ca-bundle\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.568074 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.568077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-oauth-serving-cert\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.568298 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.568120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kvtr\" (UniqueName: \"kubernetes.io/projected/c55a5c06-0e12-45d1-8144-1c364edfddab-kube-api-access-8kvtr\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.568298 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.568145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-service-ca\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.568298 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.568164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-serving-cert\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.568298 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.568179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-oauth-config\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.568298 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.568215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-console-config\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.669322 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.669279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kvtr\" (UniqueName: \"kubernetes.io/projected/c55a5c06-0e12-45d1-8144-1c364edfddab-kube-api-access-8kvtr\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.669495 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.669330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-service-ca\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.669495 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.669349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-serving-cert\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.669495 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.669367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-oauth-config\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.669495 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.669407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-console-config\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.669735 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.669510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-trusted-ca-bundle\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.669735 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.669534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-oauth-serving-cert\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.670144 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.670120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-console-config\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.670243 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.670118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-service-ca\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.670243 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.670228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-oauth-serving-cert\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.670346 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.670328 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-trusted-ca-bundle\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.672069 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.672039 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-oauth-config\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.672158 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.672130 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-serving-cert\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.677119 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.677093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kvtr\" (UniqueName: \"kubernetes.io/projected/c55a5c06-0e12-45d1-8144-1c364edfddab-kube-api-access-8kvtr\") pod \"console-5755d49cbc-5ssdg\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.796365 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.796260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:28.963959 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:28.963918 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5755d49cbc-5ssdg"] Jun 11 14:55:29.526445 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:29.526389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755d49cbc-5ssdg" event={"ID":"c55a5c06-0e12-45d1-8144-1c364edfddab","Type":"ContainerStarted","Data":"07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241"} Jun 11 14:55:29.526951 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:29.526482 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755d49cbc-5ssdg" event={"ID":"c55a5c06-0e12-45d1-8144-1c364edfddab","Type":"ContainerStarted","Data":"cdb552cab340aa4b7ea8cc12966ae3d642ef6931b696a7f9ecaa6403a1c28f61"} Jun 11 14:55:29.546130 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:29.546070 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5755d49cbc-5ssdg" podStartSLOduration=1.5460529520000001 podStartE2EDuration="1.546052952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:55:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:55:29.544528824 +0000 UTC m=+315.589916228" watchObservedRunningTime="2026-06-11 14:55:29.546052952 +0000 UTC m=+315.591440355" Jun 11 14:55:38.797292 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:38.797244 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:38.797745 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:38.797325 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:38.802171 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:38.802144 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:39.575482 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:39.575453 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 14:55:39.625626 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:39.625593 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6f89cc57-8xczv"] Jun 11 14:55:50.293541 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.293492 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" podUID="493f3b97-15ec-48bb-98ee-418ade520c8f" containerName="registry" containerID="cri-o://6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d" gracePeriod=30 Jun 11 14:55:50.392376 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.392333 2562 patch_prober.go:28] interesting pod/image-registry-858c5d4694-6j4x4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jun 11 14:55:50.392589 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.392400 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" podUID="493f3b97-15ec-48bb-98ee-418ade520c8f" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jun 11 14:55:50.554275 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.554188 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:55:50.617544 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.617508 2562 generic.go:356] "Generic (PLEG): container finished" podID="493f3b97-15ec-48bb-98ee-418ade520c8f" containerID="6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d" exitCode=0 Jun 11 14:55:50.617738 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.617555 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" Jun 11 14:55:50.617738 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.617602 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" event={"ID":"493f3b97-15ec-48bb-98ee-418ade520c8f","Type":"ContainerDied","Data":"6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d"} Jun 11 14:55:50.617738 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.617654 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858c5d4694-6j4x4" event={"ID":"493f3b97-15ec-48bb-98ee-418ade520c8f","Type":"ContainerDied","Data":"43b14f8b6dbf74c0742ca862690b6d6acc515c22c2dd8b3b65d4e845fbe84f44"} Jun 11 14:55:50.617738 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.617674 2562 scope.go:117] "RemoveContainer" containerID="6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d" Jun 11 14:55:50.627381 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.627357 2562 scope.go:117] "RemoveContainer" containerID="6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d" Jun 11 14:55:50.627762 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:55:50.627740 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d\": container with ID starting with 6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d not found: ID does not exist" containerID="6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d" Jun 11 14:55:50.627829 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.627773 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d"} err="failed to get container status \"6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d\": rpc error: code = NotFound desc = could not find container \"6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d\": container with ID starting with 6e4a4235d9bf929ab23aac4a96c9301a01bb620640fdb8b6415b330ce5b1d20d not found: ID does not exist" Jun 11 14:55:50.670652 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.670620 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-trusted-ca\") pod \"493f3b97-15ec-48bb-98ee-418ade520c8f\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " Jun 11 14:55:50.670764 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.670657 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") pod \"493f3b97-15ec-48bb-98ee-418ade520c8f\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " Jun 11 14:55:50.670764 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.670683 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/493f3b97-15ec-48bb-98ee-418ade520c8f-ca-trust-extracted\") pod \"493f3b97-15ec-48bb-98ee-418ade520c8f\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " Jun 11 14:55:50.670764 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.670701 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-certificates\") pod \"493f3b97-15ec-48bb-98ee-418ade520c8f\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " Jun 11 14:55:50.670764 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.670726 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-installation-pull-secrets\") pod \"493f3b97-15ec-48bb-98ee-418ade520c8f\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " Jun 11 14:55:50.670764 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.670758 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-bound-sa-token\") pod \"493f3b97-15ec-48bb-98ee-418ade520c8f\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " Jun 11 14:55:50.671001 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.670780 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jqn9\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-kube-api-access-7jqn9\") pod \"493f3b97-15ec-48bb-98ee-418ade520c8f\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " Jun 11 14:55:50.671001 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.670819 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-image-registry-private-configuration\") pod \"493f3b97-15ec-48bb-98ee-418ade520c8f\" (UID: \"493f3b97-15ec-48bb-98ee-418ade520c8f\") " Jun 11 14:55:50.671200 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.671119 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "493f3b97-15ec-48bb-98ee-418ade520c8f" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:55:50.671271 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.671159 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "493f3b97-15ec-48bb-98ee-418ade520c8f" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:55:50.673511 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.673461 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "493f3b97-15ec-48bb-98ee-418ade520c8f" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:55:50.673647 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.673566 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "493f3b97-15ec-48bb-98ee-418ade520c8f" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:55:50.673647 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.673576 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "493f3b97-15ec-48bb-98ee-418ade520c8f" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:55:50.673771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.673730 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "493f3b97-15ec-48bb-98ee-418ade520c8f" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:55:50.673828 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.673802 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-kube-api-access-7jqn9" (OuterVolumeSpecName: "kube-api-access-7jqn9") pod "493f3b97-15ec-48bb-98ee-418ade520c8f" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f"). InnerVolumeSpecName "kube-api-access-7jqn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:55:50.679798 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.679759 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493f3b97-15ec-48bb-98ee-418ade520c8f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "493f3b97-15ec-48bb-98ee-418ade520c8f" (UID: "493f3b97-15ec-48bb-98ee-418ade520c8f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:55:50.772351 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.772315 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-bound-sa-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:55:50.772351 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.772345 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jqn9\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-kube-api-access-7jqn9\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:55:50.772351 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.772358 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-image-registry-private-configuration\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:55:50.772626 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.772368 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-trusted-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:55:50.772626 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.772377 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-tls\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:55:50.772626 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.772385 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/493f3b97-15ec-48bb-98ee-418ade520c8f-ca-trust-extracted\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:55:50.772626 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.772394 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/493f3b97-15ec-48bb-98ee-418ade520c8f-registry-certificates\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:55:50.772626 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.772402 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/493f3b97-15ec-48bb-98ee-418ade520c8f-installation-pull-secrets\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:55:50.939682 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.939644 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-858c5d4694-6j4x4"] Jun 11 14:55:50.945615 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:50.945581 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-858c5d4694-6j4x4"] Jun 11 14:55:52.430838 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:55:52.430803 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="493f3b97-15ec-48bb-98ee-418ade520c8f" path="/var/lib/kubelet/pods/493f3b97-15ec-48bb-98ee-418ade520c8f/volumes" Jun 11 14:56:04.646910 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:04.646865 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c6f89cc57-8xczv" podUID="b0996cb9-794f-46a4-85db-bdd02468cd09" containerName="console" containerID="cri-o://c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294" gracePeriod=15 Jun 11 14:56:04.911424 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:04.911396 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:56:05.002492 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.002421 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-oauth-serving-cert\") pod \"b0996cb9-794f-46a4-85db-bdd02468cd09\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " Jun 11 14:56:05.002655 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.002520 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-service-ca\") pod \"b0996cb9-794f-46a4-85db-bdd02468cd09\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " Jun 11 14:56:05.002655 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.002542 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-trusted-ca-bundle\") pod \"b0996cb9-794f-46a4-85db-bdd02468cd09\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " Jun 11 14:56:05.002752 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.002724 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-serving-cert\") pod \"b0996cb9-794f-46a4-85db-bdd02468cd09\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " Jun 11 14:56:05.002804 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.002770 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-oauth-config\") pod \"b0996cb9-794f-46a4-85db-bdd02468cd09\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " Jun 11 14:56:05.002840 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.002804 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-console-config\") pod \"b0996cb9-794f-46a4-85db-bdd02468cd09\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " Jun 11 14:56:05.002840 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.002834 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfwdt\" (UniqueName: \"kubernetes.io/projected/b0996cb9-794f-46a4-85db-bdd02468cd09-kube-api-access-sfwdt\") pod \"b0996cb9-794f-46a4-85db-bdd02468cd09\" (UID: \"b0996cb9-794f-46a4-85db-bdd02468cd09\") " Jun 11 14:56:05.002949 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.002919 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b0996cb9-794f-46a4-85db-bdd02468cd09" (UID: "b0996cb9-794f-46a4-85db-bdd02468cd09"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:56:05.002949 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.002932 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0996cb9-794f-46a4-85db-bdd02468cd09" (UID: "b0996cb9-794f-46a4-85db-bdd02468cd09"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:56:05.003062 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.002997 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0996cb9-794f-46a4-85db-bdd02468cd09" (UID: "b0996cb9-794f-46a4-85db-bdd02468cd09"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:56:05.003304 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.003268 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-console-config" (OuterVolumeSpecName: "console-config") pod "b0996cb9-794f-46a4-85db-bdd02468cd09" (UID: "b0996cb9-794f-46a4-85db-bdd02468cd09"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:56:05.003304 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.003292 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:56:05.003516 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.003314 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-trusted-ca-bundle\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:56:05.003516 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.003328 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-oauth-serving-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:56:05.005270 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.005239 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0996cb9-794f-46a4-85db-bdd02468cd09-kube-api-access-sfwdt" (OuterVolumeSpecName: "kube-api-access-sfwdt") pod "b0996cb9-794f-46a4-85db-bdd02468cd09" (UID: "b0996cb9-794f-46a4-85db-bdd02468cd09"). InnerVolumeSpecName "kube-api-access-sfwdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:56:05.005270 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.005238 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0996cb9-794f-46a4-85db-bdd02468cd09" (UID: "b0996cb9-794f-46a4-85db-bdd02468cd09"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:56:05.005418 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.005263 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0996cb9-794f-46a4-85db-bdd02468cd09" (UID: "b0996cb9-794f-46a4-85db-bdd02468cd09"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:56:05.103816 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.103767 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-serving-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:56:05.103816 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.103807 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0996cb9-794f-46a4-85db-bdd02468cd09-console-oauth-config\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:56:05.103816 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.103821 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0996cb9-794f-46a4-85db-bdd02468cd09-console-config\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:56:05.104056 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.103834 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfwdt\" (UniqueName: \"kubernetes.io/projected/b0996cb9-794f-46a4-85db-bdd02468cd09-kube-api-access-sfwdt\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 14:56:05.679259 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.679225 2562 generic.go:356] "Generic (PLEG): container finished" podID="b0996cb9-794f-46a4-85db-bdd02468cd09" containerID="c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294" exitCode=0 Jun 11 14:56:05.679702 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.679284 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6f89cc57-8xczv" event={"ID":"b0996cb9-794f-46a4-85db-bdd02468cd09","Type":"ContainerDied","Data":"c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294"} Jun 11 14:56:05.679702 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.679323 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6f89cc57-8xczv" event={"ID":"b0996cb9-794f-46a4-85db-bdd02468cd09","Type":"ContainerDied","Data":"a4e3b53fb9abf1dc6e98070cf885a25c5d17695393c14a2ce4f757b8f44396cf"} Jun 11 14:56:05.679702 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.679341 2562 scope.go:117] "RemoveContainer" containerID="c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294" Jun 11 14:56:05.679702 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.679285 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6f89cc57-8xczv" Jun 11 14:56:05.688552 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.688529 2562 scope.go:117] "RemoveContainer" containerID="c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294" Jun 11 14:56:05.688886 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:56:05.688870 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294\": container with ID starting with c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294 not found: ID does not exist" containerID="c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294" Jun 11 14:56:05.688933 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.688895 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294"} err="failed to get container status \"c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294\": rpc error: code = NotFound desc = could not find container \"c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294\": container with ID starting with c160d31a37edfeda5a5fa6178043b1830ecd0275ac1f3be9e95c3cb8bf63b294 not found: ID does not exist" Jun 11 14:56:05.700073 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.700034 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6f89cc57-8xczv"] Jun 11 14:56:05.706199 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:05.706169 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c6f89cc57-8xczv"] Jun 11 14:56:06.431157 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:56:06.431117 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0996cb9-794f-46a4-85db-bdd02468cd09" path="/var/lib/kubelet/pods/b0996cb9-794f-46a4-85db-bdd02468cd09/volumes" Jun 11 14:57:14.578725 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.578685 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr"] Jun 11 14:57:14.579190 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.579021 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0996cb9-794f-46a4-85db-bdd02468cd09" containerName="console" Jun 11 14:57:14.579190 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.579034 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0996cb9-794f-46a4-85db-bdd02468cd09" containerName="console" Jun 11 14:57:14.579190 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.579046 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493f3b97-15ec-48bb-98ee-418ade520c8f" containerName="registry" Jun 11 14:57:14.579190 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.579051 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="493f3b97-15ec-48bb-98ee-418ade520c8f" containerName="registry" Jun 11 14:57:14.579190 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.579097 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0996cb9-794f-46a4-85db-bdd02468cd09" containerName="console" Jun 11 14:57:14.579190 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.579120 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="493f3b97-15ec-48bb-98ee-418ade520c8f" containerName="registry" Jun 11 14:57:14.581945 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.581924 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr" Jun 11 14:57:14.584896 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.584872 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 14:57:14.585015 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.584876 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 14:57:14.585950 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.585929 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hcsjr\"" Jun 11 14:57:14.592484 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.592457 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr"] Jun 11 14:57:14.698680 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.698637 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22b9d9af-2857-45bd-a01f-db8f0be3dd6b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mjpbr\" (UID: \"22b9d9af-2857-45bd-a01f-db8f0be3dd6b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr" Jun 11 14:57:14.698876 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.698703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv2pq\" (UniqueName: \"kubernetes.io/projected/22b9d9af-2857-45bd-a01f-db8f0be3dd6b-kube-api-access-gv2pq\") pod \"cert-manager-cainjector-5d99449ffd-mjpbr\" (UID: \"22b9d9af-2857-45bd-a01f-db8f0be3dd6b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr" Jun 11 14:57:14.799922 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.799867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22b9d9af-2857-45bd-a01f-db8f0be3dd6b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mjpbr\" (UID: \"22b9d9af-2857-45bd-a01f-db8f0be3dd6b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr" Jun 11 14:57:14.800108 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.799947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv2pq\" (UniqueName: \"kubernetes.io/projected/22b9d9af-2857-45bd-a01f-db8f0be3dd6b-kube-api-access-gv2pq\") pod \"cert-manager-cainjector-5d99449ffd-mjpbr\" (UID: \"22b9d9af-2857-45bd-a01f-db8f0be3dd6b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr" Jun 11 14:57:14.808869 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.808825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22b9d9af-2857-45bd-a01f-db8f0be3dd6b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mjpbr\" (UID: \"22b9d9af-2857-45bd-a01f-db8f0be3dd6b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr" Jun 11 14:57:14.809021 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.808929 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv2pq\" (UniqueName: \"kubernetes.io/projected/22b9d9af-2857-45bd-a01f-db8f0be3dd6b-kube-api-access-gv2pq\") pod \"cert-manager-cainjector-5d99449ffd-mjpbr\" (UID: \"22b9d9af-2857-45bd-a01f-db8f0be3dd6b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr" Jun 11 14:57:14.905056 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:14.904934 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr" Jun 11 14:57:15.049793 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:15.049747 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr"] Jun 11 14:57:15.053373 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:57:15.053339 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22b9d9af_2857_45bd_a01f_db8f0be3dd6b.slice/crio-cc8e2ccecd9fc81958c1aecc73d6fe8a4dc1487a327c7b091207aa2d7d68c0ff WatchSource:0}: Error finding container cc8e2ccecd9fc81958c1aecc73d6fe8a4dc1487a327c7b091207aa2d7d68c0ff: Status 404 returned error can't find the container with id cc8e2ccecd9fc81958c1aecc73d6fe8a4dc1487a327c7b091207aa2d7d68c0ff Jun 11 14:57:15.055361 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:15.055343 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:57:15.955971 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:15.955934 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr" event={"ID":"22b9d9af-2857-45bd-a01f-db8f0be3dd6b","Type":"ContainerStarted","Data":"cc8e2ccecd9fc81958c1aecc73d6fe8a4dc1487a327c7b091207aa2d7d68c0ff"} Jun 11 14:57:21.760869 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:21.760828 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-x84nw"] Jun 11 14:57:21.765452 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:21.765397 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-x84nw" Jun 11 14:57:21.767933 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:21.767903 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-b6frt\"" Jun 11 14:57:21.774943 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:21.774915 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-x84nw"] Jun 11 14:57:21.862742 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:21.862709 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j8zq\" (UniqueName: \"kubernetes.io/projected/57bcf98c-cf6c-4aee-a980-707bd98baea1-kube-api-access-6j8zq\") pod \"cert-manager-59c77684cc-x84nw\" (UID: \"57bcf98c-cf6c-4aee-a980-707bd98baea1\") " pod="cert-manager/cert-manager-59c77684cc-x84nw" Jun 11 14:57:21.862937 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:21.862767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57bcf98c-cf6c-4aee-a980-707bd98baea1-bound-sa-token\") pod \"cert-manager-59c77684cc-x84nw\" (UID: \"57bcf98c-cf6c-4aee-a980-707bd98baea1\") " pod="cert-manager/cert-manager-59c77684cc-x84nw" Jun 11 14:57:21.964148 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:21.964107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j8zq\" (UniqueName: \"kubernetes.io/projected/57bcf98c-cf6c-4aee-a980-707bd98baea1-kube-api-access-6j8zq\") pod \"cert-manager-59c77684cc-x84nw\" (UID: \"57bcf98c-cf6c-4aee-a980-707bd98baea1\") " pod="cert-manager/cert-manager-59c77684cc-x84nw" Jun 11 14:57:21.964324 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:21.964172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57bcf98c-cf6c-4aee-a980-707bd98baea1-bound-sa-token\") pod \"cert-manager-59c77684cc-x84nw\" (UID: \"57bcf98c-cf6c-4aee-a980-707bd98baea1\") " pod="cert-manager/cert-manager-59c77684cc-x84nw" Jun 11 14:57:21.972616 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:21.972587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57bcf98c-cf6c-4aee-a980-707bd98baea1-bound-sa-token\") pod \"cert-manager-59c77684cc-x84nw\" (UID: \"57bcf98c-cf6c-4aee-a980-707bd98baea1\") " pod="cert-manager/cert-manager-59c77684cc-x84nw" Jun 11 14:57:21.972791 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:21.972734 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j8zq\" (UniqueName: \"kubernetes.io/projected/57bcf98c-cf6c-4aee-a980-707bd98baea1-kube-api-access-6j8zq\") pod \"cert-manager-59c77684cc-x84nw\" (UID: \"57bcf98c-cf6c-4aee-a980-707bd98baea1\") " pod="cert-manager/cert-manager-59c77684cc-x84nw" Jun 11 14:57:22.078906 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:22.078803 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-x84nw" Jun 11 14:57:22.221995 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:22.221954 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-x84nw"] Jun 11 14:57:22.225242 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:57:22.225199 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57bcf98c_cf6c_4aee_a980_707bd98baea1.slice/crio-3e82b54e21474a72b9bd233056226821f94acb8972518e9014e3c7a88e43dc3f WatchSource:0}: Error finding container 3e82b54e21474a72b9bd233056226821f94acb8972518e9014e3c7a88e43dc3f: Status 404 returned error can't find the container with id 3e82b54e21474a72b9bd233056226821f94acb8972518e9014e3c7a88e43dc3f Jun 11 14:57:22.988034 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:22.987992 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-x84nw" event={"ID":"57bcf98c-cf6c-4aee-a980-707bd98baea1","Type":"ContainerStarted","Data":"3e82b54e21474a72b9bd233056226821f94acb8972518e9014e3c7a88e43dc3f"} Jun 11 14:57:26.002286 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:26.002238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr" event={"ID":"22b9d9af-2857-45bd-a01f-db8f0be3dd6b","Type":"ContainerStarted","Data":"37a72ff09213cdc96ade8c80b3020bce5908e9360180a3399dc48de7645925e8"} Jun 11 14:57:26.003949 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:26.003921 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-x84nw" event={"ID":"57bcf98c-cf6c-4aee-a980-707bd98baea1","Type":"ContainerStarted","Data":"e1621d6441aa9e38f54adb1d0f27624202841528a138d0a949480f21bfa86d92"} Jun 11 14:57:26.026590 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:26.026539 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mjpbr" podStartSLOduration=2.057708272 podStartE2EDuration="12.026523142s" totalImagesPullingTime="9.96881487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:57:26.02428751 +0000 UTC m=+432.069674915" watchObservedRunningTime="2026-06-11 14:57:26.026523142 +0000 UTC m=+432.071910546" Jun 11 14:57:26.047657 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:26.047604 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-x84nw" podStartSLOduration=2.239498232 podStartE2EDuration="5.04758201s" totalImagesPullingTime="2.808083778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:57:26.046623197 +0000 UTC m=+432.092010604" watchObservedRunningTime="2026-06-11 14:57:26.04758201 +0000 UTC m=+432.092969414" Jun 11 14:57:46.515340 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.515306 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph"] Jun 11 14:57:46.558476 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.558420 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph"] Jun 11 14:57:46.558669 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.558547 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.561775 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.561745 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 14:57:46.561954 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.561792 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 14:57:46.561954 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.561798 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 14:57:46.561954 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.561878 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 14:57:46.562387 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.562373 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cmgps\"" Jun 11 14:57:46.581822 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.581785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/750577e2-0a40-4221-b18e-70cf284aa7b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.582048 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.581840 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb8bm\" (UniqueName: \"kubernetes.io/projected/750577e2-0a40-4221-b18e-70cf284aa7b5-kube-api-access-fb8bm\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.582048 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.581873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/750577e2-0a40-4221-b18e-70cf284aa7b5-manifests\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.582048 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.581898 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/750577e2-0a40-4221-b18e-70cf284aa7b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.582048 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.581956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/750577e2-0a40-4221-b18e-70cf284aa7b5-tmp\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.683136 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.683097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/750577e2-0a40-4221-b18e-70cf284aa7b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.683136 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.683145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb8bm\" (UniqueName: \"kubernetes.io/projected/750577e2-0a40-4221-b18e-70cf284aa7b5-kube-api-access-fb8bm\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.683405 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.683168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/750577e2-0a40-4221-b18e-70cf284aa7b5-manifests\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.683405 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.683189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/750577e2-0a40-4221-b18e-70cf284aa7b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.683405 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.683215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/750577e2-0a40-4221-b18e-70cf284aa7b5-tmp\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.683711 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.683690 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/750577e2-0a40-4221-b18e-70cf284aa7b5-manifests\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.685742 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.685716 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/750577e2-0a40-4221-b18e-70cf284aa7b5-tmp\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.685984 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.685968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/750577e2-0a40-4221-b18e-70cf284aa7b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.686053 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.686035 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/750577e2-0a40-4221-b18e-70cf284aa7b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.696247 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.696218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb8bm\" (UniqueName: \"kubernetes.io/projected/750577e2-0a40-4221-b18e-70cf284aa7b5-kube-api-access-fb8bm\") pod \"opendatahub-operator-controller-manager-58897f8c7f-tb9ph\" (UID: \"750577e2-0a40-4221-b18e-70cf284aa7b5\") " pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:46.872385 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:46.872285 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:47.032642 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:47.032603 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph"] Jun 11 14:57:47.043255 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:57:47.043222 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750577e2_0a40_4221_b18e_70cf284aa7b5.slice/crio-a987960bcf3ffdf5e6cad6498ffdac26d9ff947afe70e3cf8e104b79f1711f4b WatchSource:0}: Error finding container a987960bcf3ffdf5e6cad6498ffdac26d9ff947afe70e3cf8e104b79f1711f4b: Status 404 returned error can't find the container with id a987960bcf3ffdf5e6cad6498ffdac26d9ff947afe70e3cf8e104b79f1711f4b Jun 11 14:57:47.091224 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:47.091182 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" event={"ID":"750577e2-0a40-4221-b18e-70cf284aa7b5","Type":"ContainerStarted","Data":"a987960bcf3ffdf5e6cad6498ffdac26d9ff947afe70e3cf8e104b79f1711f4b"} Jun 11 14:57:51.112691 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:51.112649 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" event={"ID":"750577e2-0a40-4221-b18e-70cf284aa7b5","Type":"ContainerStarted","Data":"f08ffe91166d0478f1c0b421c6f0aaa59d35937b13234011ee8fdffd63c3fc4e"} Jun 11 14:57:52.118139 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:52.118099 2562 generic.go:356] "Generic (PLEG): container finished" podID="750577e2-0a40-4221-b18e-70cf284aa7b5" containerID="f08ffe91166d0478f1c0b421c6f0aaa59d35937b13234011ee8fdffd63c3fc4e" exitCode=0 Jun 11 14:57:52.118613 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:52.118167 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" event={"ID":"750577e2-0a40-4221-b18e-70cf284aa7b5","Type":"ContainerDied","Data":"f08ffe91166d0478f1c0b421c6f0aaa59d35937b13234011ee8fdffd63c3fc4e"} Jun 11 14:57:53.124895 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:53.124855 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" event={"ID":"750577e2-0a40-4221-b18e-70cf284aa7b5","Type":"ContainerStarted","Data":"7646303b91bce394a4525a918da85a38ef65ab5faf97c00bc491406b112e83ef"} Jun 11 14:57:53.125318 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:53.125014 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:57:53.151885 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:57:53.151809 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" podStartSLOduration=2.7783939589999997 podStartE2EDuration="7.151770384s" totalImagesPullingTime="3.357514772s" totalInitContainerRuntime="1.015861653s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:57:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:57:53.150270331 +0000 UTC m=+459.195657736" watchObservedRunningTime="2026-06-11 14:57:53.151770384 +0000 UTC m=+459.197157789" Jun 11 14:58:04.131828 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:04.131793 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58897f8c7f-tb9ph" Jun 11 14:58:06.523346 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.523311 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh"] Jun 11 14:58:06.530388 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.530359 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" Jun 11 14:58:06.533721 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.533695 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7b5vr\"" Jun 11 14:58:06.533721 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.533705 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 14:58:06.534775 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.534761 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 14:58:06.543545 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.543516 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh"] Jun 11 14:58:06.616466 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.616418 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9njtt"] Jun 11 14:58:06.623566 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.623527 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" Jun 11 14:58:06.626554 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.626521 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 14:58:06.626554 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.626546 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8nvks\"" Jun 11 14:58:06.632798 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.632763 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9njtt"] Jun 11 14:58:06.663081 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.663042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136e18cd-a401-4070-87a9-7896aacf7923-tls-certs\") pod \"kube-auth-proxy-bb8d84687-cj8kh\" (UID: \"136e18cd-a401-4070-87a9-7896aacf7923\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" Jun 11 14:58:06.663268 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.663099 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/136e18cd-a401-4070-87a9-7896aacf7923-tmp\") pod \"kube-auth-proxy-bb8d84687-cj8kh\" (UID: \"136e18cd-a401-4070-87a9-7896aacf7923\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" Jun 11 14:58:06.663268 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.663170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wztld\" (UniqueName: \"kubernetes.io/projected/136e18cd-a401-4070-87a9-7896aacf7923-kube-api-access-wztld\") pod \"kube-auth-proxy-bb8d84687-cj8kh\" (UID: \"136e18cd-a401-4070-87a9-7896aacf7923\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" Jun 11 14:58:06.764375 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.764332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/136e18cd-a401-4070-87a9-7896aacf7923-tmp\") pod \"kube-auth-proxy-bb8d84687-cj8kh\" (UID: \"136e18cd-a401-4070-87a9-7896aacf7923\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" Jun 11 14:58:06.764610 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.764392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2fq\" (UniqueName: \"kubernetes.io/projected/63a9a343-4dcf-473a-a5c4-5d2b76b39546-kube-api-access-gr2fq\") pod \"odh-model-controller-6dc94f689f-9njtt\" (UID: \"63a9a343-4dcf-473a-a5c4-5d2b76b39546\") " pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" Jun 11 14:58:06.764610 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.764455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wztld\" (UniqueName: \"kubernetes.io/projected/136e18cd-a401-4070-87a9-7896aacf7923-kube-api-access-wztld\") pod \"kube-auth-proxy-bb8d84687-cj8kh\" (UID: \"136e18cd-a401-4070-87a9-7896aacf7923\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" Jun 11 14:58:06.764610 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.764558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136e18cd-a401-4070-87a9-7896aacf7923-tls-certs\") pod \"kube-auth-proxy-bb8d84687-cj8kh\" (UID: \"136e18cd-a401-4070-87a9-7896aacf7923\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" Jun 11 14:58:06.764610 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.764584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63a9a343-4dcf-473a-a5c4-5d2b76b39546-cert\") pod \"odh-model-controller-6dc94f689f-9njtt\" (UID: \"63a9a343-4dcf-473a-a5c4-5d2b76b39546\") " pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" Jun 11 14:58:06.767150 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.767120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/136e18cd-a401-4070-87a9-7896aacf7923-tmp\") pod \"kube-auth-proxy-bb8d84687-cj8kh\" (UID: \"136e18cd-a401-4070-87a9-7896aacf7923\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" Jun 11 14:58:06.767916 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.767893 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136e18cd-a401-4070-87a9-7896aacf7923-tls-certs\") pod \"kube-auth-proxy-bb8d84687-cj8kh\" (UID: \"136e18cd-a401-4070-87a9-7896aacf7923\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" Jun 11 14:58:06.773827 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.773743 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wztld\" (UniqueName: \"kubernetes.io/projected/136e18cd-a401-4070-87a9-7896aacf7923-kube-api-access-wztld\") pod \"kube-auth-proxy-bb8d84687-cj8kh\" (UID: \"136e18cd-a401-4070-87a9-7896aacf7923\") " pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" Jun 11 14:58:06.840481 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.840418 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" Jun 11 14:58:06.865250 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.865210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63a9a343-4dcf-473a-a5c4-5d2b76b39546-cert\") pod \"odh-model-controller-6dc94f689f-9njtt\" (UID: \"63a9a343-4dcf-473a-a5c4-5d2b76b39546\") " pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" Jun 11 14:58:06.865451 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.865279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2fq\" (UniqueName: \"kubernetes.io/projected/63a9a343-4dcf-473a-a5c4-5d2b76b39546-kube-api-access-gr2fq\") pod \"odh-model-controller-6dc94f689f-9njtt\" (UID: \"63a9a343-4dcf-473a-a5c4-5d2b76b39546\") " pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" Jun 11 14:58:06.865451 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:58:06.865380 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 14:58:06.865581 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:58:06.865468 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a9a343-4dcf-473a-a5c4-5d2b76b39546-cert podName:63a9a343-4dcf-473a-a5c4-5d2b76b39546 nodeName:}" failed. No retries permitted until 2026-06-11 14:58:07.365450681 +0000 UTC m=+473.410838067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/63a9a343-4dcf-473a-a5c4-5d2b76b39546-cert") pod "odh-model-controller-6dc94f689f-9njtt" (UID: "63a9a343-4dcf-473a-a5c4-5d2b76b39546") : secret "odh-model-controller-webhook-cert" not found Jun 11 14:58:06.875403 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.875376 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2fq\" (UniqueName: \"kubernetes.io/projected/63a9a343-4dcf-473a-a5c4-5d2b76b39546-kube-api-access-gr2fq\") pod \"odh-model-controller-6dc94f689f-9njtt\" (UID: \"63a9a343-4dcf-473a-a5c4-5d2b76b39546\") " pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" Jun 11 14:58:06.996360 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:06.996320 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh"] Jun 11 14:58:07.000140 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:58:07.000106 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136e18cd_a401_4070_87a9_7896aacf7923.slice/crio-a9e47609648161a5fd861dd9abf9355954b1506f5384cac29293205b740ea333 WatchSource:0}: Error finding container a9e47609648161a5fd861dd9abf9355954b1506f5384cac29293205b740ea333: Status 404 returned error can't find the container with id a9e47609648161a5fd861dd9abf9355954b1506f5384cac29293205b740ea333 Jun 11 14:58:07.188514 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:07.188399 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" event={"ID":"136e18cd-a401-4070-87a9-7896aacf7923","Type":"ContainerStarted","Data":"a9e47609648161a5fd861dd9abf9355954b1506f5384cac29293205b740ea333"} Jun 11 14:58:07.369877 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:07.369836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63a9a343-4dcf-473a-a5c4-5d2b76b39546-cert\") pod \"odh-model-controller-6dc94f689f-9njtt\" (UID: \"63a9a343-4dcf-473a-a5c4-5d2b76b39546\") " pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" Jun 11 14:58:07.372519 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:07.372493 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63a9a343-4dcf-473a-a5c4-5d2b76b39546-cert\") pod \"odh-model-controller-6dc94f689f-9njtt\" (UID: \"63a9a343-4dcf-473a-a5c4-5d2b76b39546\") " pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" Jun 11 14:58:07.535291 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:07.535242 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" Jun 11 14:58:07.683897 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:07.683858 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9njtt"] Jun 11 14:58:07.687510 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:58:07.687479 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a9a343_4dcf_473a_a5c4_5d2b76b39546.slice/crio-7bba5187273899a137310b26f2d9ba125d54b82109b87582c6432738b54e76b0 WatchSource:0}: Error finding container 7bba5187273899a137310b26f2d9ba125d54b82109b87582c6432738b54e76b0: Status 404 returned error can't find the container with id 7bba5187273899a137310b26f2d9ba125d54b82109b87582c6432738b54e76b0 Jun 11 14:58:08.199740 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:08.199698 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" event={"ID":"63a9a343-4dcf-473a-a5c4-5d2b76b39546","Type":"ContainerStarted","Data":"7bba5187273899a137310b26f2d9ba125d54b82109b87582c6432738b54e76b0"} Jun 11 14:58:12.229213 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:12.229168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" event={"ID":"136e18cd-a401-4070-87a9-7896aacf7923","Type":"ContainerStarted","Data":"a6b93c553730548a46cf13c34d780b9616da52e834bb073cd008cf1cd63bca40"} Jun 11 14:58:12.230861 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:12.230831 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" event={"ID":"63a9a343-4dcf-473a-a5c4-5d2b76b39546","Type":"ContainerStarted","Data":"10529cf4b4fe86f569f3dad6e40776ecb9a61ef5c5a7b90d7bc6ef034b234c2e"} Jun 11 14:58:12.231022 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:12.230991 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" Jun 11 14:58:12.251890 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:12.251826 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-bb8d84687-cj8kh" podStartSLOduration=2.006410709 podStartE2EDuration="6.251807629s" totalImagesPullingTime="4.24539692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:58:12.250477231 +0000 UTC m=+478.295864633" watchObservedRunningTime="2026-06-11 14:58:12.251807629 +0000 UTC m=+478.297195034" Jun 11 14:58:12.275917 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:12.275842 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" podStartSLOduration=2.781369936 podStartE2EDuration="6.275818808s" totalImagesPullingTime="3.494448872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:58:12.274368614 +0000 UTC m=+478.319756020" watchObservedRunningTime="2026-06-11 14:58:12.275818808 +0000 UTC m=+478.321206214" Jun 11 14:58:14.637668 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.637625 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h"] Jun 11 14:58:14.642402 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.642372 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.645612 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.645586 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:58:14.645770 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.645677 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 14:58:14.645911 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.645790 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 14:58:14.646512 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.646488 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 14:58:14.646962 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.646944 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h28pf\"" Jun 11 14:58:14.647058 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.646997 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 14:58:14.656446 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.656391 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h"] Jun 11 14:58:14.741311 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.741264 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/348a3090-5bfd-459d-8dc0-1c53765e084a-cert\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.741311 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.741317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/348a3090-5bfd-459d-8dc0-1c53765e084a-metrics-cert\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.741587 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.741408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dngbt\" (UniqueName: \"kubernetes.io/projected/348a3090-5bfd-459d-8dc0-1c53765e084a-kube-api-access-dngbt\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.741587 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.741490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/348a3090-5bfd-459d-8dc0-1c53765e084a-manager-config\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.842947 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.842905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/348a3090-5bfd-459d-8dc0-1c53765e084a-cert\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.843144 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.842957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/348a3090-5bfd-459d-8dc0-1c53765e084a-metrics-cert\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.843144 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.843008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dngbt\" (UniqueName: \"kubernetes.io/projected/348a3090-5bfd-459d-8dc0-1c53765e084a-kube-api-access-dngbt\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.843144 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.843038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/348a3090-5bfd-459d-8dc0-1c53765e084a-manager-config\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.843818 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.843795 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/348a3090-5bfd-459d-8dc0-1c53765e084a-manager-config\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.845864 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.845831 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/348a3090-5bfd-459d-8dc0-1c53765e084a-cert\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.845982 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.845831 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/348a3090-5bfd-459d-8dc0-1c53765e084a-metrics-cert\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.852740 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.852711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dngbt\" (UniqueName: \"kubernetes.io/projected/348a3090-5bfd-459d-8dc0-1c53765e084a-kube-api-access-dngbt\") pod \"lws-controller-manager-56c95b7d7d-w4w7h\" (UID: \"348a3090-5bfd-459d-8dc0-1c53765e084a\") " pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:14.952125 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:14.951972 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:15.116366 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:15.116340 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h"] Jun 11 14:58:15.118868 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:58:15.118835 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348a3090_5bfd_459d_8dc0_1c53765e084a.slice/crio-42a8f4d316b6a24ee66803cb99f35c80e1a9f96d60c67a6c392e6e2b91b59a3b WatchSource:0}: Error finding container 42a8f4d316b6a24ee66803cb99f35c80e1a9f96d60c67a6c392e6e2b91b59a3b: Status 404 returned error can't find the container with id 42a8f4d316b6a24ee66803cb99f35c80e1a9f96d60c67a6c392e6e2b91b59a3b Jun 11 14:58:15.247498 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:15.247411 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" event={"ID":"348a3090-5bfd-459d-8dc0-1c53765e084a","Type":"ContainerStarted","Data":"42a8f4d316b6a24ee66803cb99f35c80e1a9f96d60c67a6c392e6e2b91b59a3b"} Jun 11 14:58:18.266061 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:18.266011 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" event={"ID":"348a3090-5bfd-459d-8dc0-1c53765e084a","Type":"ContainerStarted","Data":"1b3c1755eb45434e79055220a866254d85c4d163eed68c9fe09a5d35c8ab58af"} Jun 11 14:58:18.266479 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:18.266096 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:58:18.306548 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:18.306486 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" podStartSLOduration=1.698158774 podStartE2EDuration="4.306470199s" totalImagesPullingTime="2.608311425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:58:18.299849111 +0000 UTC m=+484.345236516" watchObservedRunningTime="2026-06-11 14:58:18.306470199 +0000 UTC m=+484.351857602" Jun 11 14:58:23.238285 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:23.238244 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-9njtt" Jun 11 14:58:29.272286 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:58:29.272254 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56c95b7d7d-w4w7h" Jun 11 14:59:55.242957 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.242916 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-695b84dcd5-5jh9f"] Jun 11 14:59:55.245990 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.245970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.260647 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.260616 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-trusted-ca-bundle\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.260647 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.260649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4958l\" (UniqueName: \"kubernetes.io/projected/4e2cf8bb-815a-41c6-99df-45310e418ff8-kube-api-access-4958l\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.260829 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.260669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-service-ca\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.260829 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.260687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e2cf8bb-815a-41c6-99df-45310e418ff8-console-serving-cert\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.260829 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.260738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e2cf8bb-815a-41c6-99df-45310e418ff8-console-oauth-config\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.260927 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.260833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-oauth-serving-cert\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.260927 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.260887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-console-config\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.268554 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.268523 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-695b84dcd5-5jh9f"] Jun 11 14:59:55.361499 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.361412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-oauth-serving-cert\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.361698 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.361535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-console-config\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.361698 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.361588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-trusted-ca-bundle\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.361698 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.361604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4958l\" (UniqueName: \"kubernetes.io/projected/4e2cf8bb-815a-41c6-99df-45310e418ff8-kube-api-access-4958l\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.361698 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.361627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-service-ca\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.361698 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.361653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e2cf8bb-815a-41c6-99df-45310e418ff8-console-serving-cert\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.361698 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.361676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e2cf8bb-815a-41c6-99df-45310e418ff8-console-oauth-config\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.362327 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.362298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-oauth-serving-cert\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.362708 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.362323 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-console-config\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.362813 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.362464 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-service-ca\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.362854 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.362819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e2cf8bb-815a-41c6-99df-45310e418ff8-trusted-ca-bundle\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.364461 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.364419 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e2cf8bb-815a-41c6-99df-45310e418ff8-console-oauth-config\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.364573 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.364548 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e2cf8bb-815a-41c6-99df-45310e418ff8-console-serving-cert\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.380448 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.380400 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4958l\" (UniqueName: \"kubernetes.io/projected/4e2cf8bb-815a-41c6-99df-45310e418ff8-kube-api-access-4958l\") pod \"console-695b84dcd5-5jh9f\" (UID: \"4e2cf8bb-815a-41c6-99df-45310e418ff8\") " pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.555335 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.555233 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 14:59:55.731343 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.731191 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-695b84dcd5-5jh9f"] Jun 11 14:59:55.734175 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:59:55.734145 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2cf8bb_815a_41c6_99df_45310e418ff8.slice/crio-f0715c37ba43b7aedb0062fcb8747eb4cc77816f7caddf3ff3000dd34868b674 WatchSource:0}: Error finding container f0715c37ba43b7aedb0062fcb8747eb4cc77816f7caddf3ff3000dd34868b674: Status 404 returned error can't find the container with id f0715c37ba43b7aedb0062fcb8747eb4cc77816f7caddf3ff3000dd34868b674 Jun 11 14:59:55.802978 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.802936 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm"] Jun 11 14:59:55.806965 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.806897 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm" Jun 11 14:59:55.812018 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.811987 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 14:59:55.812695 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.812667 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-htg9z\"" Jun 11 14:59:55.813072 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.813050 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 14:59:55.814641 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.814171 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 14:59:55.830991 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.830927 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm"] Jun 11 14:59:55.866836 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.866793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hpgz\" (UniqueName: \"kubernetes.io/projected/170b5bfd-9d29-4133-9ad3-bff099185a99-kube-api-access-8hpgz\") pod \"dns-operator-controller-manager-864dd78c4c-zrvtm\" (UID: \"170b5bfd-9d29-4133-9ad3-bff099185a99\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm" Jun 11 14:59:55.968300 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.968235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hpgz\" (UniqueName: \"kubernetes.io/projected/170b5bfd-9d29-4133-9ad3-bff099185a99-kube-api-access-8hpgz\") pod \"dns-operator-controller-manager-864dd78c4c-zrvtm\" (UID: \"170b5bfd-9d29-4133-9ad3-bff099185a99\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm" Jun 11 14:59:55.982422 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:55.982383 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hpgz\" (UniqueName: \"kubernetes.io/projected/170b5bfd-9d29-4133-9ad3-bff099185a99-kube-api-access-8hpgz\") pod \"dns-operator-controller-manager-864dd78c4c-zrvtm\" (UID: \"170b5bfd-9d29-4133-9ad3-bff099185a99\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm" Jun 11 14:59:56.118642 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:56.118545 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm" Jun 11 14:59:56.289535 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:56.289505 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm"] Jun 11 14:59:56.292581 ip-10-0-139-244 kubenswrapper[2562]: W0611 14:59:56.292551 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170b5bfd_9d29_4133_9ad3_bff099185a99.slice/crio-8bd5d210e7692b299781d1b4bb184a4c430b2ef3f91885f8d90af1aa29664cba WatchSource:0}: Error finding container 8bd5d210e7692b299781d1b4bb184a4c430b2ef3f91885f8d90af1aa29664cba: Status 404 returned error can't find the container with id 8bd5d210e7692b299781d1b4bb184a4c430b2ef3f91885f8d90af1aa29664cba Jun 11 14:59:56.703790 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:56.703745 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695b84dcd5-5jh9f" event={"ID":"4e2cf8bb-815a-41c6-99df-45310e418ff8","Type":"ContainerStarted","Data":"52659dcd04506ba0ad3ea82b0d1bc5247c519fd0e6a40d9d283cf27a653f8262"} Jun 11 14:59:56.703982 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:56.703800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695b84dcd5-5jh9f" event={"ID":"4e2cf8bb-815a-41c6-99df-45310e418ff8","Type":"ContainerStarted","Data":"f0715c37ba43b7aedb0062fcb8747eb4cc77816f7caddf3ff3000dd34868b674"} Jun 11 14:59:56.704940 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:56.704915 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm" event={"ID":"170b5bfd-9d29-4133-9ad3-bff099185a99","Type":"ContainerStarted","Data":"8bd5d210e7692b299781d1b4bb184a4c430b2ef3f91885f8d90af1aa29664cba"} Jun 11 14:59:56.740752 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:56.740692 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-695b84dcd5-5jh9f" podStartSLOduration=1.740674056 podStartE2EDuration="1.740674056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:59:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:56.739549899 +0000 UTC m=+582.784937305" watchObservedRunningTime="2026-06-11 14:59:56.740674056 +0000 UTC m=+582.786061460" Jun 11 14:59:58.718259 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:58.718217 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm" event={"ID":"170b5bfd-9d29-4133-9ad3-bff099185a99","Type":"ContainerStarted","Data":"d79bfd51f6f07159063f00ae184848828e49e4e512f61b7d8ebb2bc6d6ead8b3"} Jun 11 14:59:58.718674 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:58.718389 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm" Jun 11 14:59:58.767325 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:58.767195 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm" podStartSLOduration=1.589879539 podStartE2EDuration="3.767174688s" totalImagesPullingTime="2.177295149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:59:58.766054583 +0000 UTC m=+584.811441987" watchObservedRunningTime="2026-06-11 14:59:58.767174688 +0000 UTC m=+584.812562092" Jun 11 14:59:59.701081 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.701025 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl"] Jun 11 14:59:59.705017 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.704988 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 14:59:59.708280 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.708249 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4wlqd\"" Jun 11 14:59:59.708525 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.708349 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 14:59:59.708662 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.708647 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 14:59:59.721650 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.721615 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl"] Jun 11 14:59:59.808771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.808719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fczz4\" (UniqueName: \"kubernetes.io/projected/274f4430-d8e2-4f6d-b4de-0326df6c22f3-kube-api-access-fczz4\") pod \"kuadrant-console-plugin-66b5774985-gqncl\" (UID: \"274f4430-d8e2-4f6d-b4de-0326df6c22f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 14:59:59.808771 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.808779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/274f4430-d8e2-4f6d-b4de-0326df6c22f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gqncl\" (UID: \"274f4430-d8e2-4f6d-b4de-0326df6c22f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 14:59:59.809011 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.808798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/274f4430-d8e2-4f6d-b4de-0326df6c22f3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gqncl\" (UID: \"274f4430-d8e2-4f6d-b4de-0326df6c22f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 14:59:59.909648 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.909595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fczz4\" (UniqueName: \"kubernetes.io/projected/274f4430-d8e2-4f6d-b4de-0326df6c22f3-kube-api-access-fczz4\") pod \"kuadrant-console-plugin-66b5774985-gqncl\" (UID: \"274f4430-d8e2-4f6d-b4de-0326df6c22f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 14:59:59.909648 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.909655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/274f4430-d8e2-4f6d-b4de-0326df6c22f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gqncl\" (UID: \"274f4430-d8e2-4f6d-b4de-0326df6c22f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 14:59:59.909937 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:59:59.909741 2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 14:59:59.909937 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.909782 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/274f4430-d8e2-4f6d-b4de-0326df6c22f3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gqncl\" (UID: \"274f4430-d8e2-4f6d-b4de-0326df6c22f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 14:59:59.909937 ip-10-0-139-244 kubenswrapper[2562]: E0611 14:59:59.909798 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/274f4430-d8e2-4f6d-b4de-0326df6c22f3-plugin-serving-cert podName:274f4430-d8e2-4f6d-b4de-0326df6c22f3 nodeName:}" failed. No retries permitted until 2026-06-11 15:00:00.409781634 +0000 UTC m=+586.455169016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/274f4430-d8e2-4f6d-b4de-0326df6c22f3-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-gqncl" (UID: "274f4430-d8e2-4f6d-b4de-0326df6c22f3") : secret "plugin-serving-cert" not found Jun 11 14:59:59.910449 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.910412 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/274f4430-d8e2-4f6d-b4de-0326df6c22f3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gqncl\" (UID: \"274f4430-d8e2-4f6d-b4de-0326df6c22f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 14:59:59.931996 ip-10-0-139-244 kubenswrapper[2562]: I0611 14:59:59.931961 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fczz4\" (UniqueName: \"kubernetes.io/projected/274f4430-d8e2-4f6d-b4de-0326df6c22f3-kube-api-access-fczz4\") pod \"kuadrant-console-plugin-66b5774985-gqncl\" (UID: \"274f4430-d8e2-4f6d-b4de-0326df6c22f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 15:00:00.414753 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:00.414703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/274f4430-d8e2-4f6d-b4de-0326df6c22f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gqncl\" (UID: \"274f4430-d8e2-4f6d-b4de-0326df6c22f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 15:00:00.417420 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:00.417383 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/274f4430-d8e2-4f6d-b4de-0326df6c22f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gqncl\" (UID: \"274f4430-d8e2-4f6d-b4de-0326df6c22f3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 15:00:00.615105 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:00.615058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" Jun 11 15:00:00.777026 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:00.776991 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl"] Jun 11 15:00:00.778993 ip-10-0-139-244 kubenswrapper[2562]: W0611 15:00:00.778959 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod274f4430_d8e2_4f6d_b4de_0326df6c22f3.slice/crio-16b4ecc3ed35c8efd9d01a498ac750c180104e54fcfa63f9e4c1d70a0ff44d25 WatchSource:0}: Error finding container 16b4ecc3ed35c8efd9d01a498ac750c180104e54fcfa63f9e4c1d70a0ff44d25: Status 404 returned error can't find the container with id 16b4ecc3ed35c8efd9d01a498ac750c180104e54fcfa63f9e4c1d70a0ff44d25 Jun 11 15:00:01.737792 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:01.737737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" event={"ID":"274f4430-d8e2-4f6d-b4de-0326df6c22f3","Type":"ContainerStarted","Data":"16b4ecc3ed35c8efd9d01a498ac750c180104e54fcfa63f9e4c1d70a0ff44d25"} Jun 11 15:00:05.555802 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:05.555758 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 15:00:05.556266 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:05.555830 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 15:00:05.562320 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:05.562284 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 15:00:05.766645 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:05.766614 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-695b84dcd5-5jh9f" Jun 11 15:00:05.823047 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:05.822962 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5755d49cbc-5ssdg"] Jun 11 15:00:09.726640 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:09.726610 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zrvtm" Jun 11 15:00:12.548335 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:12.548299 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv"] Jun 11 15:00:12.605576 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:12.605532 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv"] Jun 11 15:00:12.605722 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:12.605646 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:00:12.610399 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:12.610372 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2j6w9\"" Jun 11 15:00:12.741385 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:12.741341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hjln\" (UniqueName: \"kubernetes.io/projected/88c76a4a-0952-4f17-ab41-89b01fced9ff-kube-api-access-7hjln\") pod \"kuadrant-operator-controller-manager-86878c769f-8z4hv\" (UID: \"88c76a4a-0952-4f17-ab41-89b01fced9ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:00:12.741609 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:12.741499 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88c76a4a-0952-4f17-ab41-89b01fced9ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8z4hv\" (UID: \"88c76a4a-0952-4f17-ab41-89b01fced9ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:00:12.843083 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:12.842989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88c76a4a-0952-4f17-ab41-89b01fced9ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8z4hv\" (UID: \"88c76a4a-0952-4f17-ab41-89b01fced9ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:00:12.843263 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:12.843115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hjln\" (UniqueName: \"kubernetes.io/projected/88c76a4a-0952-4f17-ab41-89b01fced9ff-kube-api-access-7hjln\") pod \"kuadrant-operator-controller-manager-86878c769f-8z4hv\" (UID: \"88c76a4a-0952-4f17-ab41-89b01fced9ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:00:12.843573 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:12.843522 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88c76a4a-0952-4f17-ab41-89b01fced9ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8z4hv\" (UID: \"88c76a4a-0952-4f17-ab41-89b01fced9ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:00:12.857730 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:12.857693 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hjln\" (UniqueName: \"kubernetes.io/projected/88c76a4a-0952-4f17-ab41-89b01fced9ff-kube-api-access-7hjln\") pod \"kuadrant-operator-controller-manager-86878c769f-8z4hv\" (UID: \"88c76a4a-0952-4f17-ab41-89b01fced9ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:00:12.918296 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:12.918258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:00:23.258026 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:23.257997 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:00:23.258495 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:23.257997 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:00:23.377332 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:23.377300 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv"] Jun 11 15:00:23.389703 ip-10-0-139-244 kubenswrapper[2562]: W0611 15:00:23.389667 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c76a4a_0952_4f17_ab41_89b01fced9ff.slice/crio-fa94f52f8c2ca1b5cd6a2dd3455d891a0648a516b9a4e78f937eace3197ccbe2 WatchSource:0}: Error finding container fa94f52f8c2ca1b5cd6a2dd3455d891a0648a516b9a4e78f937eace3197ccbe2: Status 404 returned error can't find the container with id fa94f52f8c2ca1b5cd6a2dd3455d891a0648a516b9a4e78f937eace3197ccbe2 Jun 11 15:00:23.862345 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:23.862299 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" event={"ID":"274f4430-d8e2-4f6d-b4de-0326df6c22f3","Type":"ContainerStarted","Data":"cc458a9f7cf793a194864787e3d1dcfa1eb225d7f1ba871c564dad550b6afa4f"} Jun 11 15:00:23.863701 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:23.863673 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" event={"ID":"88c76a4a-0952-4f17-ab41-89b01fced9ff","Type":"ContainerStarted","Data":"fa94f52f8c2ca1b5cd6a2dd3455d891a0648a516b9a4e78f937eace3197ccbe2"} Jun 11 15:00:23.881181 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:23.881121 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gqncl" podStartSLOduration=2.341558282 podStartE2EDuration="24.881101631s" totalImagesPullingTime="22.539543349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:23.880143674 +0000 UTC m=+609.925531079" watchObservedRunningTime="2026-06-11 15:00:23.881101631 +0000 UTC m=+609.926489035" Jun 11 15:00:29.899287 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:29.899188 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" event={"ID":"88c76a4a-0952-4f17-ab41-89b01fced9ff","Type":"ContainerStarted","Data":"5203f80527714b405fce3d72705ec14ad049c5ed761e2ce213bd3c3c075c341c"} Jun 11 15:00:29.899794 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:29.899336 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:00:29.937455 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:29.937370 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" podStartSLOduration=11.848138472 podStartE2EDuration="17.93735104s" totalImagesPullingTime="6.089212568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:29.931550117 +0000 UTC m=+615.976937522" watchObservedRunningTime="2026-06-11 15:00:29.93735104 +0000 UTC m=+615.982738522" Jun 11 15:00:30.851922 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:30.851877 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5755d49cbc-5ssdg" podUID="c55a5c06-0e12-45d1-8144-1c364edfddab" containerName="console" containerID="cri-o://07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241" gracePeriod=15 Jun 11 15:00:31.161034 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.160946 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 15:00:31.220339 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.220306 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-console-config\") pod \"c55a5c06-0e12-45d1-8144-1c364edfddab\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " Jun 11 15:00:31.220540 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.220352 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kvtr\" (UniqueName: \"kubernetes.io/projected/c55a5c06-0e12-45d1-8144-1c364edfddab-kube-api-access-8kvtr\") pod \"c55a5c06-0e12-45d1-8144-1c364edfddab\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " Jun 11 15:00:31.220540 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.220378 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-serving-cert\") pod \"c55a5c06-0e12-45d1-8144-1c364edfddab\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " Jun 11 15:00:31.220540 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.220407 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-oauth-serving-cert\") pod \"c55a5c06-0e12-45d1-8144-1c364edfddab\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " Jun 11 15:00:31.220723 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.220536 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-oauth-config\") pod \"c55a5c06-0e12-45d1-8144-1c364edfddab\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " Jun 11 15:00:31.220723 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.220588 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-trusted-ca-bundle\") pod \"c55a5c06-0e12-45d1-8144-1c364edfddab\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " Jun 11 15:00:31.220723 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.220674 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-service-ca\") pod \"c55a5c06-0e12-45d1-8144-1c364edfddab\" (UID: \"c55a5c06-0e12-45d1-8144-1c364edfddab\") " Jun 11 15:00:31.220877 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.220790 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-console-config" (OuterVolumeSpecName: "console-config") pod "c55a5c06-0e12-45d1-8144-1c364edfddab" (UID: "c55a5c06-0e12-45d1-8144-1c364edfddab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:00:31.220877 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.220823 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c55a5c06-0e12-45d1-8144-1c364edfddab" (UID: "c55a5c06-0e12-45d1-8144-1c364edfddab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:00:31.221178 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.221090 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-console-config\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:00:31.221266 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.221243 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-oauth-serving-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:00:31.221266 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.221146 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c55a5c06-0e12-45d1-8144-1c364edfddab" (UID: "c55a5c06-0e12-45d1-8144-1c364edfddab"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:00:31.221358 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.221158 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-service-ca" (OuterVolumeSpecName: "service-ca") pod "c55a5c06-0e12-45d1-8144-1c364edfddab" (UID: "c55a5c06-0e12-45d1-8144-1c364edfddab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:00:31.222790 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.222760 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c55a5c06-0e12-45d1-8144-1c364edfddab" (UID: "c55a5c06-0e12-45d1-8144-1c364edfddab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:00:31.223295 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.223261 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c55a5c06-0e12-45d1-8144-1c364edfddab" (UID: "c55a5c06-0e12-45d1-8144-1c364edfddab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:00:31.223295 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.223281 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c55a5c06-0e12-45d1-8144-1c364edfddab-kube-api-access-8kvtr" (OuterVolumeSpecName: "kube-api-access-8kvtr") pod "c55a5c06-0e12-45d1-8144-1c364edfddab" (UID: "c55a5c06-0e12-45d1-8144-1c364edfddab"). InnerVolumeSpecName "kube-api-access-8kvtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:00:31.322037 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.321994 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:00:31.322037 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.322029 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kvtr\" (UniqueName: \"kubernetes.io/projected/c55a5c06-0e12-45d1-8144-1c364edfddab-kube-api-access-8kvtr\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:00:31.322037 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.322039 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-serving-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:00:31.322037 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.322049 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c55a5c06-0e12-45d1-8144-1c364edfddab-console-oauth-config\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:00:31.322334 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.322057 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55a5c06-0e12-45d1-8144-1c364edfddab-trusted-ca-bundle\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:00:31.910378 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.910332 2562 generic.go:356] "Generic (PLEG): container finished" podID="c55a5c06-0e12-45d1-8144-1c364edfddab" containerID="07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241" exitCode=0 Jun 11 15:00:31.910378 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.910380 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5755d49cbc-5ssdg" Jun 11 15:00:31.910623 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.910419 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755d49cbc-5ssdg" event={"ID":"c55a5c06-0e12-45d1-8144-1c364edfddab","Type":"ContainerDied","Data":"07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241"} Jun 11 15:00:31.910623 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.910504 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5755d49cbc-5ssdg" event={"ID":"c55a5c06-0e12-45d1-8144-1c364edfddab","Type":"ContainerDied","Data":"cdb552cab340aa4b7ea8cc12966ae3d642ef6931b696a7f9ecaa6403a1c28f61"} Jun 11 15:00:31.910623 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.910524 2562 scope.go:117] "RemoveContainer" containerID="07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241" Jun 11 15:00:31.922540 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.922515 2562 scope.go:117] "RemoveContainer" containerID="07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241" Jun 11 15:00:31.923077 ip-10-0-139-244 kubenswrapper[2562]: E0611 15:00:31.923053 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241\": container with ID starting with 07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241 not found: ID does not exist" containerID="07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241" Jun 11 15:00:31.923173 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.923089 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241"} err="failed to get container status \"07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241\": rpc error: code = NotFound desc = could not find container \"07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241\": container with ID starting with 07d18f95c109e802c79eda8ee78316335a5265d5b1b4080667bbcf81e68a7241 not found: ID does not exist" Jun 11 15:00:31.940394 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.940355 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5755d49cbc-5ssdg"] Jun 11 15:00:31.943971 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:31.943933 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5755d49cbc-5ssdg"] Jun 11 15:00:32.432303 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:32.432259 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c55a5c06-0e12-45d1-8144-1c364edfddab" path="/var/lib/kubelet/pods/c55a5c06-0e12-45d1-8144-1c364edfddab/volumes" Jun 11 15:00:40.907175 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:00:40.907136 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:01:00.861289 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:00.861248 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mrjpr"] Jun 11 15:01:00.861765 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:00.861638 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55a5c06-0e12-45d1-8144-1c364edfddab" containerName="console" Jun 11 15:01:00.861765 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:00.861651 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55a5c06-0e12-45d1-8144-1c364edfddab" containerName="console" Jun 11 15:01:00.861765 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:00.861742 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55a5c06-0e12-45d1-8144-1c364edfddab" containerName="console" Jun 11 15:01:00.884701 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:00.884668 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mrjpr" Jun 11 15:01:00.888029 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:00.887998 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mrjpr"] Jun 11 15:01:00.888195 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:00.888128 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-s6ssm\"" Jun 11 15:01:00.998687 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:00.998654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c9fl\" (UniqueName: \"kubernetes.io/projected/d0158eef-bc18-4871-8689-7c2a10cc8bb0-kube-api-access-9c9fl\") pod \"authorino-58cd955675-mrjpr\" (UID: \"d0158eef-bc18-4871-8689-7c2a10cc8bb0\") " pod="kuadrant-system/authorino-58cd955675-mrjpr" Jun 11 15:01:01.100145 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:01.100105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c9fl\" (UniqueName: \"kubernetes.io/projected/d0158eef-bc18-4871-8689-7c2a10cc8bb0-kube-api-access-9c9fl\") pod \"authorino-58cd955675-mrjpr\" (UID: \"d0158eef-bc18-4871-8689-7c2a10cc8bb0\") " pod="kuadrant-system/authorino-58cd955675-mrjpr" Jun 11 15:01:01.113704 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:01.113625 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c9fl\" (UniqueName: \"kubernetes.io/projected/d0158eef-bc18-4871-8689-7c2a10cc8bb0-kube-api-access-9c9fl\") pod \"authorino-58cd955675-mrjpr\" (UID: \"d0158eef-bc18-4871-8689-7c2a10cc8bb0\") " pod="kuadrant-system/authorino-58cd955675-mrjpr" Jun 11 15:01:01.195495 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:01.195420 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mrjpr" Jun 11 15:01:01.345333 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:01.345297 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mrjpr"] Jun 11 15:01:01.349677 ip-10-0-139-244 kubenswrapper[2562]: W0611 15:01:01.349641 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0158eef_bc18_4871_8689_7c2a10cc8bb0.slice/crio-8d13342edcfc69f24cc524b5e39e59b277100c322337c636a6c11c04bf25efbb WatchSource:0}: Error finding container 8d13342edcfc69f24cc524b5e39e59b277100c322337c636a6c11c04bf25efbb: Status 404 returned error can't find the container with id 8d13342edcfc69f24cc524b5e39e59b277100c322337c636a6c11c04bf25efbb Jun 11 15:01:02.059040 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:02.059001 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mrjpr" event={"ID":"d0158eef-bc18-4871-8689-7c2a10cc8bb0","Type":"ContainerStarted","Data":"8d13342edcfc69f24cc524b5e39e59b277100c322337c636a6c11c04bf25efbb"} Jun 11 15:01:05.889876 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:05.889831 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mrjpr"] Jun 11 15:01:06.083985 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:06.083942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mrjpr" event={"ID":"d0158eef-bc18-4871-8689-7c2a10cc8bb0","Type":"ContainerStarted","Data":"a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b"} Jun 11 15:01:06.099508 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:06.099447 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mrjpr" podStartSLOduration=2.424935663 podStartE2EDuration="6.099413499s" totalImagesPullingTime="3.674477836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:01:06.097768223 +0000 UTC m=+652.143155630" watchObservedRunningTime="2026-06-11 15:01:06.099413499 +0000 UTC m=+652.144800904" Jun 11 15:01:07.088755 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:07.088687 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mrjpr" podUID="d0158eef-bc18-4871-8689-7c2a10cc8bb0" containerName="authorino" containerID="cri-o://a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b" gracePeriod=30 Jun 11 15:01:07.352867 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:07.352784 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mrjpr" Jun 11 15:01:07.360444 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:07.360404 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c9fl\" (UniqueName: \"kubernetes.io/projected/d0158eef-bc18-4871-8689-7c2a10cc8bb0-kube-api-access-9c9fl\") pod \"d0158eef-bc18-4871-8689-7c2a10cc8bb0\" (UID: \"d0158eef-bc18-4871-8689-7c2a10cc8bb0\") " Jun 11 15:01:07.362878 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:07.362849 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0158eef-bc18-4871-8689-7c2a10cc8bb0-kube-api-access-9c9fl" (OuterVolumeSpecName: "kube-api-access-9c9fl") pod "d0158eef-bc18-4871-8689-7c2a10cc8bb0" (UID: "d0158eef-bc18-4871-8689-7c2a10cc8bb0"). InnerVolumeSpecName "kube-api-access-9c9fl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:01:07.461671 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:07.461633 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c9fl\" (UniqueName: \"kubernetes.io/projected/d0158eef-bc18-4871-8689-7c2a10cc8bb0-kube-api-access-9c9fl\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:01:08.094506 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:08.094464 2562 generic.go:356] "Generic (PLEG): container finished" podID="d0158eef-bc18-4871-8689-7c2a10cc8bb0" containerID="a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b" exitCode=0 Jun 11 15:01:08.094506 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:08.094504 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mrjpr" Jun 11 15:01:08.094996 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:08.094519 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mrjpr" event={"ID":"d0158eef-bc18-4871-8689-7c2a10cc8bb0","Type":"ContainerDied","Data":"a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b"} Jun 11 15:01:08.094996 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:08.094561 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mrjpr" event={"ID":"d0158eef-bc18-4871-8689-7c2a10cc8bb0","Type":"ContainerDied","Data":"8d13342edcfc69f24cc524b5e39e59b277100c322337c636a6c11c04bf25efbb"} Jun 11 15:01:08.094996 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:08.094583 2562 scope.go:117] "RemoveContainer" containerID="a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b" Jun 11 15:01:08.103480 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:08.103460 2562 scope.go:117] "RemoveContainer" containerID="a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b" Jun 11 15:01:08.103779 ip-10-0-139-244 kubenswrapper[2562]: E0611 15:01:08.103756 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b\": container with ID starting with a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b not found: ID does not exist" containerID="a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b" Jun 11 15:01:08.103836 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:08.103789 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b"} err="failed to get container status \"a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b\": rpc error: code = NotFound desc = could not find container \"a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b\": container with ID starting with a1ef97cbef3234b0554250423242304919cb128b6e1351d337bb8fbe5f295a1b not found: ID does not exist" Jun 11 15:01:08.115380 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:08.115332 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mrjpr"] Jun 11 15:01:08.119099 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:08.119070 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mrjpr"] Jun 11 15:01:08.432121 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:01:08.432037 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0158eef-bc18-4871-8689-7c2a10cc8bb0" path="/var/lib/kubelet/pods/d0158eef-bc18-4871-8689-7c2a10cc8bb0/volumes" Jun 11 15:02:28.818264 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:28.818225 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pvx2w"] Jun 11 15:02:28.818782 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:28.818600 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0158eef-bc18-4871-8689-7c2a10cc8bb0" containerName="authorino" Jun 11 15:02:28.818782 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:28.818613 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0158eef-bc18-4871-8689-7c2a10cc8bb0" containerName="authorino" Jun 11 15:02:28.818782 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:28.818674 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0158eef-bc18-4871-8689-7c2a10cc8bb0" containerName="authorino" Jun 11 15:02:28.820859 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:28.820839 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pvx2w" Jun 11 15:02:28.824358 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:28.824325 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-s6ssm\"" Jun 11 15:02:28.830647 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:28.830616 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pvx2w"] Jun 11 15:02:29.011122 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.011072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgjmp\" (UniqueName: \"kubernetes.io/projected/da0e00a2-04ac-450e-a8b8-10553e3df93a-kube-api-access-tgjmp\") pod \"authorino-5d4b67c446-pvx2w\" (UID: \"da0e00a2-04ac-450e-a8b8-10553e3df93a\") " pod="kuadrant-system/authorino-5d4b67c446-pvx2w" Jun 11 15:02:29.043913 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.043858 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pvx2w"] Jun 11 15:02:29.044154 ip-10-0-139-244 kubenswrapper[2562]: E0611 15:02:29.044133 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-tgjmp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-pvx2w" podUID="da0e00a2-04ac-450e-a8b8-10553e3df93a" Jun 11 15:02:29.074272 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.074179 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b7c7ff444-n7cqv"] Jun 11 15:02:29.076927 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.076901 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b7c7ff444-n7cqv" Jun 11 15:02:29.086841 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.086811 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b7c7ff444-n7cqv"] Jun 11 15:02:29.112123 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.112088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgjmp\" (UniqueName: \"kubernetes.io/projected/da0e00a2-04ac-450e-a8b8-10553e3df93a-kube-api-access-tgjmp\") pod \"authorino-5d4b67c446-pvx2w\" (UID: \"da0e00a2-04ac-450e-a8b8-10553e3df93a\") " pod="kuadrant-system/authorino-5d4b67c446-pvx2w" Jun 11 15:02:29.121467 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.121396 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgjmp\" (UniqueName: \"kubernetes.io/projected/da0e00a2-04ac-450e-a8b8-10553e3df93a-kube-api-access-tgjmp\") pod \"authorino-5d4b67c446-pvx2w\" (UID: \"da0e00a2-04ac-450e-a8b8-10553e3df93a\") " pod="kuadrant-system/authorino-5d4b67c446-pvx2w" Jun 11 15:02:29.171368 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.171332 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b7c7ff444-n7cqv"] Jun 11 15:02:29.171643 ip-10-0-139-244 kubenswrapper[2562]: E0611 15:02:29.171622 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-znphn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-b7c7ff444-n7cqv" podUID="f267a414-d18f-47a1-9d68-e5772540e7b9" Jun 11 15:02:29.196598 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.196557 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-696f6f8dfb-qccpc"] Jun 11 15:02:29.199106 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.199081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696f6f8dfb-qccpc" Jun 11 15:02:29.201652 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.201626 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 15:02:29.208826 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.208796 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-696f6f8dfb-qccpc"] Jun 11 15:02:29.212600 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.212571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znphn\" (UniqueName: \"kubernetes.io/projected/f267a414-d18f-47a1-9d68-e5772540e7b9-kube-api-access-znphn\") pod \"authorino-b7c7ff444-n7cqv\" (UID: \"f267a414-d18f-47a1-9d68-e5772540e7b9\") " pod="kuadrant-system/authorino-b7c7ff444-n7cqv" Jun 11 15:02:29.313628 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.313583 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znphn\" (UniqueName: \"kubernetes.io/projected/f267a414-d18f-47a1-9d68-e5772540e7b9-kube-api-access-znphn\") pod \"authorino-b7c7ff444-n7cqv\" (UID: \"f267a414-d18f-47a1-9d68-e5772540e7b9\") " pod="kuadrant-system/authorino-b7c7ff444-n7cqv" Jun 11 15:02:29.313808 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.313650 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-tls-cert\") pod \"authorino-696f6f8dfb-qccpc\" (UID: \"1f3b8ab7-5904-499b-9460-dcbf379ff3ba\") " pod="kuadrant-system/authorino-696f6f8dfb-qccpc" Jun 11 15:02:29.313808 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.313700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgsd5\" (UniqueName: \"kubernetes.io/projected/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-kube-api-access-vgsd5\") pod \"authorino-696f6f8dfb-qccpc\" (UID: \"1f3b8ab7-5904-499b-9460-dcbf379ff3ba\") " pod="kuadrant-system/authorino-696f6f8dfb-qccpc" Jun 11 15:02:29.322628 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.322596 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znphn\" (UniqueName: \"kubernetes.io/projected/f267a414-d18f-47a1-9d68-e5772540e7b9-kube-api-access-znphn\") pod \"authorino-b7c7ff444-n7cqv\" (UID: \"f267a414-d18f-47a1-9d68-e5772540e7b9\") " pod="kuadrant-system/authorino-b7c7ff444-n7cqv" Jun 11 15:02:29.414953 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.414838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-tls-cert\") pod \"authorino-696f6f8dfb-qccpc\" (UID: \"1f3b8ab7-5904-499b-9460-dcbf379ff3ba\") " pod="kuadrant-system/authorino-696f6f8dfb-qccpc" Jun 11 15:02:29.414953 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.414883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgsd5\" (UniqueName: \"kubernetes.io/projected/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-kube-api-access-vgsd5\") pod \"authorino-696f6f8dfb-qccpc\" (UID: \"1f3b8ab7-5904-499b-9460-dcbf379ff3ba\") " pod="kuadrant-system/authorino-696f6f8dfb-qccpc" Jun 11 15:02:29.417560 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.417535 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-tls-cert\") pod \"authorino-696f6f8dfb-qccpc\" (UID: \"1f3b8ab7-5904-499b-9460-dcbf379ff3ba\") " pod="kuadrant-system/authorino-696f6f8dfb-qccpc" Jun 11 15:02:29.424769 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.424740 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgsd5\" (UniqueName: \"kubernetes.io/projected/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-kube-api-access-vgsd5\") pod \"authorino-696f6f8dfb-qccpc\" (UID: \"1f3b8ab7-5904-499b-9460-dcbf379ff3ba\") " pod="kuadrant-system/authorino-696f6f8dfb-qccpc" Jun 11 15:02:29.475721 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.475684 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b7c7ff444-n7cqv" Jun 11 15:02:29.475896 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.475684 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pvx2w" Jun 11 15:02:29.482576 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.482551 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b7c7ff444-n7cqv" Jun 11 15:02:29.485841 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.485813 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pvx2w" Jun 11 15:02:29.510392 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.510354 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696f6f8dfb-qccpc" Jun 11 15:02:29.616974 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.616940 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgjmp\" (UniqueName: \"kubernetes.io/projected/da0e00a2-04ac-450e-a8b8-10553e3df93a-kube-api-access-tgjmp\") pod \"da0e00a2-04ac-450e-a8b8-10553e3df93a\" (UID: \"da0e00a2-04ac-450e-a8b8-10553e3df93a\") " Jun 11 15:02:29.617166 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.616987 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znphn\" (UniqueName: \"kubernetes.io/projected/f267a414-d18f-47a1-9d68-e5772540e7b9-kube-api-access-znphn\") pod \"f267a414-d18f-47a1-9d68-e5772540e7b9\" (UID: \"f267a414-d18f-47a1-9d68-e5772540e7b9\") " Jun 11 15:02:29.620190 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.620155 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da0e00a2-04ac-450e-a8b8-10553e3df93a-kube-api-access-tgjmp" (OuterVolumeSpecName: "kube-api-access-tgjmp") pod "da0e00a2-04ac-450e-a8b8-10553e3df93a" (UID: "da0e00a2-04ac-450e-a8b8-10553e3df93a"). InnerVolumeSpecName "kube-api-access-tgjmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:02:29.620487 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.620471 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f267a414-d18f-47a1-9d68-e5772540e7b9-kube-api-access-znphn" (OuterVolumeSpecName: "kube-api-access-znphn") pod "f267a414-d18f-47a1-9d68-e5772540e7b9" (UID: "f267a414-d18f-47a1-9d68-e5772540e7b9"). InnerVolumeSpecName "kube-api-access-znphn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:02:29.653275 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.653240 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-696f6f8dfb-qccpc"] Jun 11 15:02:29.656658 ip-10-0-139-244 kubenswrapper[2562]: W0611 15:02:29.656627 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f3b8ab7_5904_499b_9460_dcbf379ff3ba.slice/crio-bd4532b0cfb4e78d270a325afaf1e8b50240c36fda0ce816dca05fb6216a10ac WatchSource:0}: Error finding container bd4532b0cfb4e78d270a325afaf1e8b50240c36fda0ce816dca05fb6216a10ac: Status 404 returned error can't find the container with id bd4532b0cfb4e78d270a325afaf1e8b50240c36fda0ce816dca05fb6216a10ac Jun 11 15:02:29.658030 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.658013 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:02:29.718078 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.717983 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgjmp\" (UniqueName: \"kubernetes.io/projected/da0e00a2-04ac-450e-a8b8-10553e3df93a-kube-api-access-tgjmp\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:02:29.718078 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:29.718014 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znphn\" (UniqueName: \"kubernetes.io/projected/f267a414-d18f-47a1-9d68-e5772540e7b9-kube-api-access-znphn\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:02:30.482210 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:30.482180 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pvx2w" Jun 11 15:02:30.482210 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:30.482204 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b7c7ff444-n7cqv" Jun 11 15:02:30.482765 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:30.482172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-696f6f8dfb-qccpc" event={"ID":"1f3b8ab7-5904-499b-9460-dcbf379ff3ba","Type":"ContainerStarted","Data":"0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40"} Jun 11 15:02:30.482765 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:30.482324 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-696f6f8dfb-qccpc" event={"ID":"1f3b8ab7-5904-499b-9460-dcbf379ff3ba","Type":"ContainerStarted","Data":"bd4532b0cfb4e78d270a325afaf1e8b50240c36fda0ce816dca05fb6216a10ac"} Jun 11 15:02:30.511897 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:30.511845 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-696f6f8dfb-qccpc" podStartSLOduration=1.165605359 podStartE2EDuration="1.511826207s" totalImagesPullingTime="346.220848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:02:30.509384206 +0000 UTC m=+736.554771611" watchObservedRunningTime="2026-06-11 15:02:30.511826207 +0000 UTC m=+736.557213611" Jun 11 15:02:30.547268 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:30.547210 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b7c7ff444-n7cqv"] Jun 11 15:02:30.553661 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:30.553624 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b7c7ff444-n7cqv"] Jun 11 15:02:30.577883 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:30.577846 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pvx2w"] Jun 11 15:02:30.597494 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:30.597453 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pvx2w"] Jun 11 15:02:32.432311 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:32.432270 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da0e00a2-04ac-450e-a8b8-10553e3df93a" path="/var/lib/kubelet/pods/da0e00a2-04ac-450e-a8b8-10553e3df93a/volumes" Jun 11 15:02:32.432738 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:02:32.432545 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f267a414-d18f-47a1-9d68-e5772540e7b9" path="/var/lib/kubelet/pods/f267a414-d18f-47a1-9d68-e5772540e7b9/volumes" Jun 11 15:03:58.821141 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:58.821097 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b5d497598-d5sl5"] Jun 11 15:03:58.824491 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:58.824466 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:03:58.827201 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:58.827168 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 15:03:58.833051 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:58.833022 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b5d497598-d5sl5"] Jun 11 15:03:58.915045 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:58.915003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/904dbb3f-cc53-4785-8a26-47fd21ca115a-tls-cert\") pod \"authorino-7b5d497598-d5sl5\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:03:58.915221 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:58.915083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/904dbb3f-cc53-4785-8a26-47fd21ca115a-oidc-ca\") pod \"authorino-7b5d497598-d5sl5\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:03:58.915221 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:58.915124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qfx7\" (UniqueName: \"kubernetes.io/projected/904dbb3f-cc53-4785-8a26-47fd21ca115a-kube-api-access-7qfx7\") pod \"authorino-7b5d497598-d5sl5\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:03:59.015677 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.015631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/904dbb3f-cc53-4785-8a26-47fd21ca115a-oidc-ca\") pod \"authorino-7b5d497598-d5sl5\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:03:59.015900 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.015695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qfx7\" (UniqueName: \"kubernetes.io/projected/904dbb3f-cc53-4785-8a26-47fd21ca115a-kube-api-access-7qfx7\") pod \"authorino-7b5d497598-d5sl5\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:03:59.015900 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.015772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/904dbb3f-cc53-4785-8a26-47fd21ca115a-tls-cert\") pod \"authorino-7b5d497598-d5sl5\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:03:59.016422 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.016391 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/904dbb3f-cc53-4785-8a26-47fd21ca115a-oidc-ca\") pod \"authorino-7b5d497598-d5sl5\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:03:59.018655 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.018625 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/904dbb3f-cc53-4785-8a26-47fd21ca115a-tls-cert\") pod \"authorino-7b5d497598-d5sl5\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:03:59.024149 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.024115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qfx7\" (UniqueName: \"kubernetes.io/projected/904dbb3f-cc53-4785-8a26-47fd21ca115a-kube-api-access-7qfx7\") pod \"authorino-7b5d497598-d5sl5\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:03:59.134714 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.134615 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:03:59.283950 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.283919 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b5d497598-d5sl5"] Jun 11 15:03:59.287051 ip-10-0-139-244 kubenswrapper[2562]: W0611 15:03:59.287018 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod904dbb3f_cc53_4785_8a26_47fd21ca115a.slice/crio-436198f043e3bbd7cec6dcb15d2718535ee47a7d6b1df05e8c40ff208d410594 WatchSource:0}: Error finding container 436198f043e3bbd7cec6dcb15d2718535ee47a7d6b1df05e8c40ff208d410594: Status 404 returned error can't find the container with id 436198f043e3bbd7cec6dcb15d2718535ee47a7d6b1df05e8c40ff208d410594 Jun 11 15:03:59.925528 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.925387 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b5d497598-d5sl5" event={"ID":"904dbb3f-cc53-4785-8a26-47fd21ca115a","Type":"ContainerStarted","Data":"634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681"} Jun 11 15:03:59.925528 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.925461 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b5d497598-d5sl5" event={"ID":"904dbb3f-cc53-4785-8a26-47fd21ca115a","Type":"ContainerStarted","Data":"436198f043e3bbd7cec6dcb15d2718535ee47a7d6b1df05e8c40ff208d410594"} Jun 11 15:03:59.944980 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.944922 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b5d497598-d5sl5" podStartSLOduration=1.5976154299999998 podStartE2EDuration="1.944903839s" totalImagesPullingTime="347.288409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:03:59.942652426 +0000 UTC m=+825.988039830" watchObservedRunningTime="2026-06-11 15:03:59.944903839 +0000 UTC m=+825.990291272" Jun 11 15:03:59.971285 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.971226 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-696f6f8dfb-qccpc"] Jun 11 15:03:59.971713 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:03:59.971674 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-696f6f8dfb-qccpc" podUID="1f3b8ab7-5904-499b-9460-dcbf379ff3ba" containerName="authorino" containerID="cri-o://0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40" gracePeriod=30 Jun 11 15:04:00.237499 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.237449 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696f6f8dfb-qccpc" Jun 11 15:04:00.327419 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.327377 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgsd5\" (UniqueName: \"kubernetes.io/projected/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-kube-api-access-vgsd5\") pod \"1f3b8ab7-5904-499b-9460-dcbf379ff3ba\" (UID: \"1f3b8ab7-5904-499b-9460-dcbf379ff3ba\") " Jun 11 15:04:00.327601 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.327526 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-tls-cert\") pod \"1f3b8ab7-5904-499b-9460-dcbf379ff3ba\" (UID: \"1f3b8ab7-5904-499b-9460-dcbf379ff3ba\") " Jun 11 15:04:00.329759 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.329728 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-kube-api-access-vgsd5" (OuterVolumeSpecName: "kube-api-access-vgsd5") pod "1f3b8ab7-5904-499b-9460-dcbf379ff3ba" (UID: "1f3b8ab7-5904-499b-9460-dcbf379ff3ba"). InnerVolumeSpecName "kube-api-access-vgsd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:04:00.339326 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.339289 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1f3b8ab7-5904-499b-9460-dcbf379ff3ba" (UID: "1f3b8ab7-5904-499b-9460-dcbf379ff3ba"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:04:00.428381 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.428347 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgsd5\" (UniqueName: \"kubernetes.io/projected/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-kube-api-access-vgsd5\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:04:00.428381 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.428374 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f3b8ab7-5904-499b-9460-dcbf379ff3ba-tls-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:04:00.931460 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.931394 2562 generic.go:356] "Generic (PLEG): container finished" podID="1f3b8ab7-5904-499b-9460-dcbf379ff3ba" containerID="0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40" exitCode=0 Jun 11 15:04:00.931460 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.931457 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696f6f8dfb-qccpc" Jun 11 15:04:00.931955 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.931470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-696f6f8dfb-qccpc" event={"ID":"1f3b8ab7-5904-499b-9460-dcbf379ff3ba","Type":"ContainerDied","Data":"0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40"} Jun 11 15:04:00.931955 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.931513 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-696f6f8dfb-qccpc" event={"ID":"1f3b8ab7-5904-499b-9460-dcbf379ff3ba","Type":"ContainerDied","Data":"bd4532b0cfb4e78d270a325afaf1e8b50240c36fda0ce816dca05fb6216a10ac"} Jun 11 15:04:00.931955 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.931531 2562 scope.go:117] "RemoveContainer" containerID="0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40" Jun 11 15:04:00.940871 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.940843 2562 scope.go:117] "RemoveContainer" containerID="0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40" Jun 11 15:04:00.941194 ip-10-0-139-244 kubenswrapper[2562]: E0611 15:04:00.941174 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40\": container with ID starting with 0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40 not found: ID does not exist" containerID="0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40" Jun 11 15:04:00.941266 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.941201 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40"} err="failed to get container status \"0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40\": rpc error: code = NotFound desc = could not find container \"0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40\": container with ID starting with 0e745976104408e3d2b0dd3d1ac6a129f001467370b88000c4adeb6c622e5f40 not found: ID does not exist" Jun 11 15:04:00.972957 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.972918 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-696f6f8dfb-qccpc"] Jun 11 15:04:00.984548 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:00.984511 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-696f6f8dfb-qccpc"] Jun 11 15:04:02.431751 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:02.431717 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f3b8ab7-5904-499b-9460-dcbf379ff3ba" path="/var/lib/kubelet/pods/1f3b8ab7-5904-499b-9460-dcbf379ff3ba/volumes" Jun 11 15:04:16.362097 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.362061 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq"] Jun 11 15:04:16.362519 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.362476 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f3b8ab7-5904-499b-9460-dcbf379ff3ba" containerName="authorino" Jun 11 15:04:16.362519 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.362491 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f3b8ab7-5904-499b-9460-dcbf379ff3ba" containerName="authorino" Jun 11 15:04:16.362615 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.362591 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f3b8ab7-5904-499b-9460-dcbf379ff3ba" containerName="authorino" Jun 11 15:04:16.368207 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.368174 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.372646 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.372617 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 15:04:16.373917 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.373896 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j7pp5\"" Jun 11 15:04:16.373917 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.373907 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 15:04:16.374115 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.373907 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 15:04:16.379133 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.379105 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq"] Jun 11 15:04:16.479845 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.479807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.480052 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.479865 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.480052 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.479974 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ec9c5d-7f25-44d6-852f-13fac9009025-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.480052 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.480017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.480188 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.480054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.480188 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.480079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84t2j\" (UniqueName: \"kubernetes.io/projected/80ec9c5d-7f25-44d6-852f-13fac9009025-kube-api-access-84t2j\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.581708 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.581659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ec9c5d-7f25-44d6-852f-13fac9009025-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.581920 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.581746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.581920 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.581864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.581920 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.581917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84t2j\" (UniqueName: \"kubernetes.io/projected/80ec9c5d-7f25-44d6-852f-13fac9009025-kube-api-access-84t2j\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.582090 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.581990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.582090 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.582028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.582182 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.582157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.582528 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.582501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.586452 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.582756 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.590691 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.590652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ec9c5d-7f25-44d6-852f-13fac9009025-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.590826 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.590763 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ec9c5d-7f25-44d6-852f-13fac9009025-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.592076 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.592047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84t2j\" (UniqueName: \"kubernetes.io/projected/80ec9c5d-7f25-44d6-852f-13fac9009025-kube-api-access-84t2j\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq\" (UID: \"80ec9c5d-7f25-44d6-852f-13fac9009025\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.681224 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.681123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:04:16.859183 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:16.859140 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq"] Jun 11 15:04:16.863963 ip-10-0-139-244 kubenswrapper[2562]: W0611 15:04:16.863920 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ec9c5d_7f25_44d6_852f_13fac9009025.slice/crio-042ec3fdb3f48b975aaad990b3681534b6f8c18483aff1ad36a173a5e87cf24a WatchSource:0}: Error finding container 042ec3fdb3f48b975aaad990b3681534b6f8c18483aff1ad36a173a5e87cf24a: Status 404 returned error can't find the container with id 042ec3fdb3f48b975aaad990b3681534b6f8c18483aff1ad36a173a5e87cf24a Jun 11 15:04:17.016301 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:17.016257 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" event={"ID":"80ec9c5d-7f25-44d6-852f-13fac9009025","Type":"ContainerStarted","Data":"042ec3fdb3f48b975aaad990b3681534b6f8c18483aff1ad36a173a5e87cf24a"} Jun 11 15:04:21.038343 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:21.038308 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" event={"ID":"80ec9c5d-7f25-44d6-852f-13fac9009025","Type":"ContainerStarted","Data":"1f945635a1d4037e66e4daee9d5b446592f9d2d12f691335df708520b56f2ce9"} Jun 11 15:04:32.449172 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.449129 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q"] Jun 11 15:04:32.457377 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.457344 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.459951 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.459920 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 15:04:32.463615 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.463582 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q"] Jun 11 15:04:32.539078 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.539028 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.539078 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.539081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.539356 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.539115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.539356 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.539154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.539356 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.539257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.539356 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.539282 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2ff9\" (UniqueName: \"kubernetes.io/projected/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-kube-api-access-f2ff9\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.640474 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.640386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.640703 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.640525 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.640703 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.640553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2ff9\" (UniqueName: \"kubernetes.io/projected/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-kube-api-access-f2ff9\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.640703 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.640632 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.640703 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.640657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.640703 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.640683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.641080 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.641051 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.641201 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.641110 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.641201 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.641156 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.643593 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.643565 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.643962 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.643940 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.649909 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.649867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2ff9\" (UniqueName: \"kubernetes.io/projected/336e9779-9729-4a95-a2e5-4e0fadc4fdc1-kube-api-access-f2ff9\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q\" (UID: \"336e9779-9729-4a95-a2e5-4e0fadc4fdc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.769623 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.769582 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:32.921230 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:32.921189 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q"] Jun 11 15:04:32.923684 ip-10-0-139-244 kubenswrapper[2562]: W0611 15:04:32.923650 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336e9779_9729_4a95_a2e5_4e0fadc4fdc1.slice/crio-851a2ae41f9e088b8291415223294d2d08ebc0bc50ef140e2b02a56042e5930d WatchSource:0}: Error finding container 851a2ae41f9e088b8291415223294d2d08ebc0bc50ef140e2b02a56042e5930d: Status 404 returned error can't find the container with id 851a2ae41f9e088b8291415223294d2d08ebc0bc50ef140e2b02a56042e5930d Jun 11 15:04:33.108470 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:33.108342 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" event={"ID":"336e9779-9729-4a95-a2e5-4e0fadc4fdc1","Type":"ContainerStarted","Data":"c2d03737dd6b8b8c9b183a727df3d85a6c42d88f07814204d385bde9d847abaa"} Jun 11 15:04:33.108470 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:33.108401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" event={"ID":"336e9779-9729-4a95-a2e5-4e0fadc4fdc1","Type":"ContainerStarted","Data":"851a2ae41f9e088b8291415223294d2d08ebc0bc50ef140e2b02a56042e5930d"} Jun 11 15:04:37.129266 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:37.129174 2562 generic.go:356] "Generic (PLEG): container finished" podID="336e9779-9729-4a95-a2e5-4e0fadc4fdc1" containerID="c2d03737dd6b8b8c9b183a727df3d85a6c42d88f07814204d385bde9d847abaa" exitCode=0 Jun 11 15:04:37.129266 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:37.129230 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" event={"ID":"336e9779-9729-4a95-a2e5-4e0fadc4fdc1","Type":"ContainerDied","Data":"c2d03737dd6b8b8c9b183a727df3d85a6c42d88f07814204d385bde9d847abaa"} Jun 11 15:04:39.142143 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:39.142108 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" event={"ID":"336e9779-9729-4a95-a2e5-4e0fadc4fdc1","Type":"ContainerStarted","Data":"f67ce8fc1ac6d2bace8337e9ee69ed4ed9be3ab4cef977150bb8e85a1e0c8d44"} Jun 11 15:04:39.164971 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:39.164920 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" podStartSLOduration=2.179683736 podStartE2EDuration="7.164904972s" totalImagesPullingTime="1.125528825s" totalInitContainerRuntime="3.859692411s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:04:39.162703807 +0000 UTC m=+865.208091212" watchObservedRunningTime="2026-06-11 15:04:39.164904972 +0000 UTC m=+865.210292402" Jun 11 15:04:42.770713 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:42.770666 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:42.771125 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:42.770740 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:42.783856 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:42.783824 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:04:43.172900 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:04:43.172808 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q" Jun 11 15:05:00.349309 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.349271 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh"] Jun 11 15:05:00.352538 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.352509 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.355483 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.355454 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 15:05:00.367298 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.367263 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh"] Jun 11 15:05:00.406615 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.406561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e10a13c-be53-40ed-ad77-653bd13f91e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.406615 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.406620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.406870 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.406661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqssc\" (UniqueName: \"kubernetes.io/projected/8e10a13c-be53-40ed-ad77-653bd13f91e9-kube-api-access-cqssc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.406870 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.406756 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.406870 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.406825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.406870 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.406852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.507466 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.507402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e10a13c-be53-40ed-ad77-653bd13f91e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.507466 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.507472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.507726 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.507497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqssc\" (UniqueName: \"kubernetes.io/projected/8e10a13c-be53-40ed-ad77-653bd13f91e9-kube-api-access-cqssc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.507726 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.507527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.507726 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.507612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.507726 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.507649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.508157 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.508123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.508290 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.508267 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.508366 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.508317 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.510522 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.510489 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e10a13c-be53-40ed-ad77-653bd13f91e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.510637 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.510545 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e10a13c-be53-40ed-ad77-653bd13f91e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.525872 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.525837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqssc\" (UniqueName: \"kubernetes.io/projected/8e10a13c-be53-40ed-ad77-653bd13f91e9-kube-api-access-cqssc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4psmh\" (UID: \"8e10a13c-be53-40ed-ad77-653bd13f91e9\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.665508 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.665394 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:05:00.818449 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:00.818390 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh"] Jun 11 15:05:00.821383 ip-10-0-139-244 kubenswrapper[2562]: W0611 15:05:00.821351 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e10a13c_be53_40ed_ad77_653bd13f91e9.slice/crio-21bb06de1b71438d7b11e44a332d7a22e8ad387c704cf4034e42451a2357224d WatchSource:0}: Error finding container 21bb06de1b71438d7b11e44a332d7a22e8ad387c704cf4034e42451a2357224d: Status 404 returned error can't find the container with id 21bb06de1b71438d7b11e44a332d7a22e8ad387c704cf4034e42451a2357224d Jun 11 15:05:01.258886 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:01.258850 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" event={"ID":"8e10a13c-be53-40ed-ad77-653bd13f91e9","Type":"ContainerStarted","Data":"26ccdc7deb4bf7805b7bd90dbf3dda00ead0a429dd1b508c7a1e36fbddfdf9ee"} Jun 11 15:05:01.259066 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:01.258904 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" event={"ID":"8e10a13c-be53-40ed-ad77-653bd13f91e9","Type":"ContainerStarted","Data":"21bb06de1b71438d7b11e44a332d7a22e8ad387c704cf4034e42451a2357224d"} Jun 11 15:05:21.370012 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:21.369974 2562 generic.go:356] "Generic (PLEG): container finished" podID="80ec9c5d-7f25-44d6-852f-13fac9009025" containerID="1f945635a1d4037e66e4daee9d5b446592f9d2d12f691335df708520b56f2ce9" exitCode=0 Jun 11 15:05:21.370452 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:21.370044 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" event={"ID":"80ec9c5d-7f25-44d6-852f-13fac9009025","Type":"ContainerDied","Data":"1f945635a1d4037e66e4daee9d5b446592f9d2d12f691335df708520b56f2ce9"} Jun 11 15:05:22.377345 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:22.377307 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" event={"ID":"80ec9c5d-7f25-44d6-852f-13fac9009025","Type":"ContainerStarted","Data":"5f116585e6b4268fee33fa2750c1b0959d718d4a638c21d80b35381e93096487"} Jun 11 15:05:22.404477 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:22.404399 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" podStartSLOduration=2.656007196 podStartE2EDuration="1m6.404380611s" totalImagesPullingTime="4.023546001s" totalInitContainerRuntime="59.724827414s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:04:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:22.402882267 +0000 UTC m=+908.448269671" watchObservedRunningTime="2026-06-11 15:05:22.404380611 +0000 UTC m=+908.449768016" Jun 11 15:05:23.288579 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:23.288446 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:05:23.297450 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:23.290477 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:05:26.682142 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:26.682096 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:05:26.682618 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:26.682177 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:05:26.695353 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:26.695321 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:05:27.413988 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:27.413949 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq" Jun 11 15:05:55.543962 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:55.543925 2562 generic.go:356] "Generic (PLEG): container finished" podID="8e10a13c-be53-40ed-ad77-653bd13f91e9" containerID="26ccdc7deb4bf7805b7bd90dbf3dda00ead0a429dd1b508c7a1e36fbddfdf9ee" exitCode=0 Jun 11 15:05:55.544476 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:55.543977 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" event={"ID":"8e10a13c-be53-40ed-ad77-653bd13f91e9","Type":"ContainerDied","Data":"26ccdc7deb4bf7805b7bd90dbf3dda00ead0a429dd1b508c7a1e36fbddfdf9ee"} Jun 11 15:05:56.550995 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:56.550960 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" event={"ID":"8e10a13c-be53-40ed-ad77-653bd13f91e9","Type":"ContainerStarted","Data":"b1e4d3f192951cc37e80bdcd5790ead0e413e076dd44b8921b7454c9d858aacb"} Jun 11 15:05:56.569827 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:05:56.569777 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" podStartSLOduration=2.255022583 podStartE2EDuration="56.569760288s" totalImagesPullingTime="247.733167ms" totalInitContainerRuntime="54.067004538s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:56.56902268 +0000 UTC m=+942.614410088" watchObservedRunningTime="2026-06-11 15:05:56.569760288 +0000 UTC m=+942.615147706" Jun 11 15:06:00.665759 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:06:00.665714 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:06:00.666199 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:06:00.665789 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:06:00.678899 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:06:00.678871 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:06:01.587516 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:06:01.587475 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4psmh" Jun 11 15:07:58.572114 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.572071 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cd9d8b8dc-4rxlg"] Jun 11 15:07:58.574567 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.574546 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" Jun 11 15:07:58.583049 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.583020 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cd9d8b8dc-4rxlg"] Jun 11 15:07:58.699008 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.698967 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69d5h\" (UniqueName: \"kubernetes.io/projected/251196fb-7c72-497c-b50d-5cffa89c7ab8-kube-api-access-69d5h\") pod \"authorino-7cd9d8b8dc-4rxlg\" (UID: \"251196fb-7c72-497c-b50d-5cffa89c7ab8\") " pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" Jun 11 15:07:58.699190 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.699048 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/251196fb-7c72-497c-b50d-5cffa89c7ab8-oidc-ca\") pod \"authorino-7cd9d8b8dc-4rxlg\" (UID: \"251196fb-7c72-497c-b50d-5cffa89c7ab8\") " pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" Jun 11 15:07:58.699190 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.699095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/251196fb-7c72-497c-b50d-5cffa89c7ab8-tls-cert\") pod \"authorino-7cd9d8b8dc-4rxlg\" (UID: \"251196fb-7c72-497c-b50d-5cffa89c7ab8\") " pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" Jun 11 15:07:58.800277 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.800232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69d5h\" (UniqueName: \"kubernetes.io/projected/251196fb-7c72-497c-b50d-5cffa89c7ab8-kube-api-access-69d5h\") pod \"authorino-7cd9d8b8dc-4rxlg\" (UID: \"251196fb-7c72-497c-b50d-5cffa89c7ab8\") " pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" Jun 11 15:07:58.800492 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.800309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/251196fb-7c72-497c-b50d-5cffa89c7ab8-oidc-ca\") pod \"authorino-7cd9d8b8dc-4rxlg\" (UID: \"251196fb-7c72-497c-b50d-5cffa89c7ab8\") " pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" Jun 11 15:07:58.800492 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.800405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/251196fb-7c72-497c-b50d-5cffa89c7ab8-tls-cert\") pod \"authorino-7cd9d8b8dc-4rxlg\" (UID: \"251196fb-7c72-497c-b50d-5cffa89c7ab8\") " pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" Jun 11 15:07:58.801002 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.800968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/251196fb-7c72-497c-b50d-5cffa89c7ab8-oidc-ca\") pod \"authorino-7cd9d8b8dc-4rxlg\" (UID: \"251196fb-7c72-497c-b50d-5cffa89c7ab8\") " pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" Jun 11 15:07:58.803058 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.803035 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/251196fb-7c72-497c-b50d-5cffa89c7ab8-tls-cert\") pod \"authorino-7cd9d8b8dc-4rxlg\" (UID: \"251196fb-7c72-497c-b50d-5cffa89c7ab8\") " pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" Jun 11 15:07:58.809350 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.809319 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69d5h\" (UniqueName: \"kubernetes.io/projected/251196fb-7c72-497c-b50d-5cffa89c7ab8-kube-api-access-69d5h\") pod \"authorino-7cd9d8b8dc-4rxlg\" (UID: \"251196fb-7c72-497c-b50d-5cffa89c7ab8\") " pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" Jun 11 15:07:58.884266 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:58.884168 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" Jun 11 15:07:59.050828 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:59.050791 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cd9d8b8dc-4rxlg"] Jun 11 15:07:59.055210 ip-10-0-139-244 kubenswrapper[2562]: W0611 15:07:59.055178 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod251196fb_7c72_497c_b50d_5cffa89c7ab8.slice/crio-ea960390d620ed4ae8d1d51dd370deac8f1179eaa3239c530b57e9128ea59357 WatchSource:0}: Error finding container ea960390d620ed4ae8d1d51dd370deac8f1179eaa3239c530b57e9128ea59357: Status 404 returned error can't find the container with id ea960390d620ed4ae8d1d51dd370deac8f1179eaa3239c530b57e9128ea59357 Jun 11 15:07:59.056718 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:59.056695 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:07:59.177975 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:07:59.177869 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" event={"ID":"251196fb-7c72-497c-b50d-5cffa89c7ab8","Type":"ContainerStarted","Data":"ea960390d620ed4ae8d1d51dd370deac8f1179eaa3239c530b57e9128ea59357"} Jun 11 15:08:00.187475 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.187405 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" event={"ID":"251196fb-7c72-497c-b50d-5cffa89c7ab8","Type":"ContainerStarted","Data":"272a91de9bf93aa803db29131542c73b478369a6110a538d4ea2fc96001e34a3"} Jun 11 15:08:00.229273 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.229205 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7cd9d8b8dc-4rxlg" podStartSLOduration=1.7922166229999998 podStartE2EDuration="2.229180263s" totalImagesPullingTime="436.96364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:08:00.227971865 +0000 UTC m=+1066.273359270" watchObservedRunningTime="2026-06-11 15:08:00.229180263 +0000 UTC m=+1066.274567668" Jun 11 15:08:00.308094 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.307130 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b5d497598-d5sl5"] Jun 11 15:08:00.308094 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.307373 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7b5d497598-d5sl5" podUID="904dbb3f-cc53-4785-8a26-47fd21ca115a" containerName="authorino" containerID="cri-o://634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681" gracePeriod=30 Jun 11 15:08:00.607030 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.606982 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:08:00.721316 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.719786 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/904dbb3f-cc53-4785-8a26-47fd21ca115a-tls-cert\") pod \"904dbb3f-cc53-4785-8a26-47fd21ca115a\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " Jun 11 15:08:00.721316 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.719850 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/904dbb3f-cc53-4785-8a26-47fd21ca115a-oidc-ca\") pod \"904dbb3f-cc53-4785-8a26-47fd21ca115a\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " Jun 11 15:08:00.721316 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.719931 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qfx7\" (UniqueName: \"kubernetes.io/projected/904dbb3f-cc53-4785-8a26-47fd21ca115a-kube-api-access-7qfx7\") pod \"904dbb3f-cc53-4785-8a26-47fd21ca115a\" (UID: \"904dbb3f-cc53-4785-8a26-47fd21ca115a\") " Jun 11 15:08:00.723791 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.723748 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/904dbb3f-cc53-4785-8a26-47fd21ca115a-kube-api-access-7qfx7" (OuterVolumeSpecName: "kube-api-access-7qfx7") pod "904dbb3f-cc53-4785-8a26-47fd21ca115a" (UID: "904dbb3f-cc53-4785-8a26-47fd21ca115a"). InnerVolumeSpecName "kube-api-access-7qfx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:08:00.728022 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.727984 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/904dbb3f-cc53-4785-8a26-47fd21ca115a-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "904dbb3f-cc53-4785-8a26-47fd21ca115a" (UID: "904dbb3f-cc53-4785-8a26-47fd21ca115a"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:08:00.733710 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.733674 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/904dbb3f-cc53-4785-8a26-47fd21ca115a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "904dbb3f-cc53-4785-8a26-47fd21ca115a" (UID: "904dbb3f-cc53-4785-8a26-47fd21ca115a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:00.821671 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.821630 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qfx7\" (UniqueName: \"kubernetes.io/projected/904dbb3f-cc53-4785-8a26-47fd21ca115a-kube-api-access-7qfx7\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:08:00.821671 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.821666 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/904dbb3f-cc53-4785-8a26-47fd21ca115a-tls-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:08:00.821671 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:00.821681 2562 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/904dbb3f-cc53-4785-8a26-47fd21ca115a-oidc-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:08:01.193801 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:01.193704 2562 generic.go:356] "Generic (PLEG): container finished" podID="904dbb3f-cc53-4785-8a26-47fd21ca115a" containerID="634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681" exitCode=0 Jun 11 15:08:01.193801 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:01.193746 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b5d497598-d5sl5" Jun 11 15:08:01.194310 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:01.193799 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b5d497598-d5sl5" event={"ID":"904dbb3f-cc53-4785-8a26-47fd21ca115a","Type":"ContainerDied","Data":"634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681"} Jun 11 15:08:01.194310 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:01.193839 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b5d497598-d5sl5" event={"ID":"904dbb3f-cc53-4785-8a26-47fd21ca115a","Type":"ContainerDied","Data":"436198f043e3bbd7cec6dcb15d2718535ee47a7d6b1df05e8c40ff208d410594"} Jun 11 15:08:01.194310 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:01.193860 2562 scope.go:117] "RemoveContainer" containerID="634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681" Jun 11 15:08:01.203940 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:01.203916 2562 scope.go:117] "RemoveContainer" containerID="634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681" Jun 11 15:08:01.204267 ip-10-0-139-244 kubenswrapper[2562]: E0611 15:08:01.204244 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681\": container with ID starting with 634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681 not found: ID does not exist" containerID="634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681" Jun 11 15:08:01.204333 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:01.204278 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681"} err="failed to get container status \"634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681\": rpc error: code = NotFound desc = could not find container \"634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681\": container with ID starting with 634f09ee2261abb4e770c29f7477ca8c690fb43c981b48c91eedb2ac0e959681 not found: ID does not exist" Jun 11 15:08:01.216079 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:01.216035 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b5d497598-d5sl5"] Jun 11 15:08:01.222326 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:01.222290 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b5d497598-d5sl5"] Jun 11 15:08:02.432259 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:08:02.432219 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="904dbb3f-cc53-4785-8a26-47fd21ca115a" path="/var/lib/kubelet/pods/904dbb3f-cc53-4785-8a26-47fd21ca115a/volumes" Jun 11 15:10:23.319862 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:10:23.319750 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:10:23.323138 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:10:23.321269 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:15:23.354137 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:15:23.354020 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:15:23.358281 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:15:23.356154 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:19:47.609058 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:47.609008 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv"] Jun 11 15:19:47.609697 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:47.609317 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" podUID="88c76a4a-0952-4f17-ab41-89b01fced9ff" containerName="manager" containerID="cri-o://5203f80527714b405fce3d72705ec14ad049c5ed761e2ce213bd3c3c075c341c" gracePeriod=10 Jun 11 15:19:47.796722 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:47.796683 2562 generic.go:356] "Generic (PLEG): container finished" podID="88c76a4a-0952-4f17-ab41-89b01fced9ff" containerID="5203f80527714b405fce3d72705ec14ad049c5ed761e2ce213bd3c3c075c341c" exitCode=0 Jun 11 15:19:47.796901 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:47.796753 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" event={"ID":"88c76a4a-0952-4f17-ab41-89b01fced9ff","Type":"ContainerDied","Data":"5203f80527714b405fce3d72705ec14ad049c5ed761e2ce213bd3c3c075c341c"} Jun 11 15:19:47.862769 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:47.862696 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:19:47.963768 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:47.963729 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hjln\" (UniqueName: \"kubernetes.io/projected/88c76a4a-0952-4f17-ab41-89b01fced9ff-kube-api-access-7hjln\") pod \"88c76a4a-0952-4f17-ab41-89b01fced9ff\" (UID: \"88c76a4a-0952-4f17-ab41-89b01fced9ff\") " Jun 11 15:19:47.963973 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:47.963840 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88c76a4a-0952-4f17-ab41-89b01fced9ff-extensions-socket-volume\") pod \"88c76a4a-0952-4f17-ab41-89b01fced9ff\" (UID: \"88c76a4a-0952-4f17-ab41-89b01fced9ff\") " Jun 11 15:19:47.964268 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:47.964237 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88c76a4a-0952-4f17-ab41-89b01fced9ff-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "88c76a4a-0952-4f17-ab41-89b01fced9ff" (UID: "88c76a4a-0952-4f17-ab41-89b01fced9ff"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:19:47.966209 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:47.966175 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88c76a4a-0952-4f17-ab41-89b01fced9ff-kube-api-access-7hjln" (OuterVolumeSpecName: "kube-api-access-7hjln") pod "88c76a4a-0952-4f17-ab41-89b01fced9ff" (UID: "88c76a4a-0952-4f17-ab41-89b01fced9ff"). InnerVolumeSpecName "kube-api-access-7hjln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:19:48.064571 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:48.064525 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hjln\" (UniqueName: \"kubernetes.io/projected/88c76a4a-0952-4f17-ab41-89b01fced9ff-kube-api-access-7hjln\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:19:48.064571 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:48.064558 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88c76a4a-0952-4f17-ab41-89b01fced9ff-extensions-socket-volume\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\"" Jun 11 15:19:48.803666 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:48.803632 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" Jun 11 15:19:48.804121 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:48.803663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv" event={"ID":"88c76a4a-0952-4f17-ab41-89b01fced9ff","Type":"ContainerDied","Data":"fa94f52f8c2ca1b5cd6a2dd3455d891a0648a516b9a4e78f937eace3197ccbe2"} Jun 11 15:19:48.804121 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:48.803743 2562 scope.go:117] "RemoveContainer" containerID="5203f80527714b405fce3d72705ec14ad049c5ed761e2ce213bd3c3c075c341c" Jun 11 15:19:48.825641 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:48.825600 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv"] Jun 11 15:19:48.829720 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:48.829686 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8z4hv"] Jun 11 15:19:50.432120 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:19:50.432086 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88c76a4a-0952-4f17-ab41-89b01fced9ff" path="/var/lib/kubelet/pods/88c76a4a-0952-4f17-ab41-89b01fced9ff/volumes" Jun 11 15:20:23.385981 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:20:23.385852 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:20:23.387864 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:20:23.387841 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:21:18.783199 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.783158 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj"] Jun 11 15:21:18.783892 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.783722 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c76a4a-0952-4f17-ab41-89b01fced9ff" containerName="manager" Jun 11 15:21:18.783892 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.783743 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c76a4a-0952-4f17-ab41-89b01fced9ff" containerName="manager" Jun 11 15:21:18.783892 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.783782 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="904dbb3f-cc53-4785-8a26-47fd21ca115a" containerName="authorino" Jun 11 15:21:18.783892 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.783792 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="904dbb3f-cc53-4785-8a26-47fd21ca115a" containerName="authorino" Jun 11 15:21:18.783892 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.783874 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="88c76a4a-0952-4f17-ab41-89b01fced9ff" containerName="manager" Jun 11 15:21:18.783892 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.783887 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="904dbb3f-cc53-4785-8a26-47fd21ca115a" containerName="authorino" Jun 11 15:21:18.786873 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.786848 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" Jun 11 15:21:18.789969 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.789942 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2j6w9\"" Jun 11 15:21:18.806793 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.806755 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj"] Jun 11 15:21:18.939794 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.939753 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df290506-5739-4283-be07-2f8fb74ff45f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vm8vj\" (UID: \"df290506-5739-4283-be07-2f8fb74ff45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" Jun 11 15:21:18.939989 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:18.939808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxc7v\" (UniqueName: \"kubernetes.io/projected/df290506-5739-4283-be07-2f8fb74ff45f-kube-api-access-hxc7v\") pod \"kuadrant-operator-controller-manager-86878c769f-vm8vj\" (UID: \"df290506-5739-4283-be07-2f8fb74ff45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" Jun 11 15:21:19.040540 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:19.040419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df290506-5739-4283-be07-2f8fb74ff45f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vm8vj\" (UID: \"df290506-5739-4283-be07-2f8fb74ff45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" Jun 11 15:21:19.040540 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:19.040494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxc7v\" (UniqueName: \"kubernetes.io/projected/df290506-5739-4283-be07-2f8fb74ff45f-kube-api-access-hxc7v\") pod \"kuadrant-operator-controller-manager-86878c769f-vm8vj\" (UID: \"df290506-5739-4283-be07-2f8fb74ff45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" Jun 11 15:21:19.040848 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:19.040824 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df290506-5739-4283-be07-2f8fb74ff45f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vm8vj\" (UID: \"df290506-5739-4283-be07-2f8fb74ff45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" Jun 11 15:21:19.056529 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:19.056496 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxc7v\" (UniqueName: \"kubernetes.io/projected/df290506-5739-4283-be07-2f8fb74ff45f-kube-api-access-hxc7v\") pod \"kuadrant-operator-controller-manager-86878c769f-vm8vj\" (UID: \"df290506-5739-4283-be07-2f8fb74ff45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" Jun 11 15:21:19.098299 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:19.098253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" Jun 11 15:21:19.265501 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:19.265475 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj"] Jun 11 15:21:19.267563 ip-10-0-139-244 kubenswrapper[2562]: W0611 15:21:19.267533 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf290506_5739_4283_be07_2f8fb74ff45f.slice/crio-bf13203d07cc7bc35f8184fde54bcea69ff8543704c6a6f96665df0b33ff8ea4 WatchSource:0}: Error finding container bf13203d07cc7bc35f8184fde54bcea69ff8543704c6a6f96665df0b33ff8ea4: Status 404 returned error can't find the container with id bf13203d07cc7bc35f8184fde54bcea69ff8543704c6a6f96665df0b33ff8ea4 Jun 11 15:21:20.263041 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:20.263006 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" event={"ID":"df290506-5739-4283-be07-2f8fb74ff45f","Type":"ContainerStarted","Data":"9e5f14d971f76aa4b33e0c58f4ca3223a0009e1619c872e67fc21bc8379a6d8f"} Jun 11 15:21:20.263459 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:20.263059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" event={"ID":"df290506-5739-4283-be07-2f8fb74ff45f","Type":"ContainerStarted","Data":"bf13203d07cc7bc35f8184fde54bcea69ff8543704c6a6f96665df0b33ff8ea4"} Jun 11 15:21:20.263459 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:20.263137 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" Jun 11 15:21:20.289614 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:20.289540 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" podStartSLOduration=2.28951578 podStartE2EDuration="2.28951578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:20.283657049 +0000 UTC m=+1866.329044456" watchObservedRunningTime="2026-06-11 15:21:20.28951578 +0000 UTC m=+1866.334903187" Jun 11 15:21:31.271091 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:21:31.271054 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vm8vj" Jun 11 15:25:23.416346 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:25:23.416235 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:25:23.420422 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:25:23.418907 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:30:23.448350 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:30:23.448222 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:30:23.453379 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:30:23.453358 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rqgqt_edc13586-9c50-4c1b-87cf-08a030e1adf0/ovn-acl-logging/0.log" Jun 11 15:31:27.630175 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:27.630132 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cd9d8b8dc-4rxlg_251196fb-7c72-497c-b50d-5cffa89c7ab8/authorino/0.log" Jun 11 15:31:32.897494 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:32.897456 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9njtt_63a9a343-4dcf-473a-a5c4-5d2b76b39546/manager/0.log" Jun 11 15:31:33.261276 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:33.261243 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58897f8c7f-tb9ph_750577e2-0a40-4221-b18e-70cf284aa7b5/copy-manifests/0.log" Jun 11 15:31:33.269000 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:33.268971 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58897f8c7f-tb9ph_750577e2-0a40-4221-b18e-70cf284aa7b5/manager/0.log" Jun 11 15:31:34.541134 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:34.541096 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cd9d8b8dc-4rxlg_251196fb-7c72-497c-b50d-5cffa89c7ab8/authorino/0.log" Jun 11 15:31:34.782764 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:34.782730 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zrvtm_170b5bfd-9d29-4133-9ad3-bff099185a99/manager/0.log" Jun 11 15:31:34.896191 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:34.896106 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gqncl_274f4430-d8e2-4f6d-b4de-0326df6c22f3/kuadrant-console-plugin/0.log" Jun 11 15:31:35.144458 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:35.144419 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vm8vj_df290506-5739-4283-be07-2f8fb74ff45f/manager/0.log" Jun 11 15:31:35.977742 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:35.977710 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb8d84687-cj8kh_136e18cd-a401-4070-87a9-7896aacf7923/kube-auth-proxy/0.log" Jun 11 15:31:36.580577 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:36.580543 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdbc75df-j55tt_41629d05-8b07-4ceb-acf5-228f076da1a4/router/0.log" Jun 11 15:31:36.933249 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:36.933167 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq_80ec9c5d-7f25-44d6-852f-13fac9009025/storage-initializer/0.log" Jun 11 15:31:36.940983 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:36.940956 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-xpzlq_80ec9c5d-7f25-44d6-852f-13fac9009025/main/0.log" Jun 11 15:31:37.187111 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:37.187031 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q_336e9779-9729-4a95-a2e5-4e0fadc4fdc1/storage-initializer/0.log" Jun 11 15:31:37.195865 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:37.195833 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-lqf5q_336e9779-9729-4a95-a2e5-4e0fadc4fdc1/main/0.log" Jun 11 15:31:37.435945 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:37.435898 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4psmh_8e10a13c-be53-40ed-ad77-653bd13f91e9/storage-initializer/0.log" Jun 11 15:31:37.444067 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:37.443999 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4psmh_8e10a13c-be53-40ed-ad77-653bd13f91e9/main/0.log" Jun 11 15:31:45.038342 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:45.038310 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9sm6h_c85d9bb0-a0f0-46b3-9c97-58961e603482/global-pull-secret-syncer/0.log" Jun 11 15:31:45.209733 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:45.209699 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lcsm9_d316b1d3-e66c-44c9-abf6-0318431f3082/konnectivity-agent/0.log" Jun 11 15:31:45.305766 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:45.305669 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-244.ec2.internal_9c0bd5da9b4cc155444e674e4daae372/haproxy/0.log" Jun 11 15:31:50.738771 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:50.738736 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cd9d8b8dc-4rxlg_251196fb-7c72-497c-b50d-5cffa89c7ab8/authorino/0.log" Jun 11 15:31:50.864930 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:50.864899 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zrvtm_170b5bfd-9d29-4133-9ad3-bff099185a99/manager/0.log" Jun 11 15:31:50.891345 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:50.891315 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gqncl_274f4430-d8e2-4f6d-b4de-0326df6c22f3/kuadrant-console-plugin/0.log" Jun 11 15:31:51.019376 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:51.019284 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vm8vj_df290506-5739-4283-be07-2f8fb74ff45f/manager/0.log" Jun 11 15:31:52.873016 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:52.872983 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-fpnqk_8cb5e2b7-4d4e-4f0a-a1d2-60e69cf6ba3c/cluster-monitoring-operator/0.log" Jun 11 15:31:52.907495 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:52.907420 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7z45j_a8fb46ef-3dce-41f5-aac8-73c6539c2604/kube-state-metrics/0.log" Jun 11 15:31:52.930416 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:52.930391 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7z45j_a8fb46ef-3dce-41f5-aac8-73c6539c2604/kube-rbac-proxy-main/0.log" Jun 11 15:31:52.958891 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:52.958866 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7z45j_a8fb46ef-3dce-41f5-aac8-73c6539c2604/kube-rbac-proxy-self/0.log" Jun 11 15:31:53.032197 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.032169 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-49mw7_8d538102-4200-44ab-b996-74050d37eba4/monitoring-plugin/0.log" Jun 11 15:31:53.245689 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.245652 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkvzm_14469488-91de-4f5a-9d3c-eb992bb9a453/node-exporter/0.log" Jun 11 15:31:53.268475 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.268422 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkvzm_14469488-91de-4f5a-9d3c-eb992bb9a453/kube-rbac-proxy/0.log" Jun 11 15:31:53.294948 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.294921 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hkvzm_14469488-91de-4f5a-9d3c-eb992bb9a453/init-textfile/0.log" Jun 11 15:31:53.321931 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.321900 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jqpnn_32486209-d218-4855-a26b-0d7018374857/kube-rbac-proxy-main/0.log" Jun 11 15:31:53.341973 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.341935 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jqpnn_32486209-d218-4855-a26b-0d7018374857/kube-rbac-proxy-self/0.log" Jun 11 15:31:53.363140 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.363106 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-jqpnn_32486209-d218-4855-a26b-0d7018374857/openshift-state-metrics/0.log" Jun 11 15:31:53.669123 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.669029 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7pkj9_e4435c00-db25-4ae3-a406-3c2cda3ae8e0/prometheus-operator/0.log" Jun 11 15:31:53.688482 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.688386 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7pkj9_e4435c00-db25-4ae3-a406-3c2cda3ae8e0/kube-rbac-proxy/0.log" Jun 11 15:31:53.753144 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.753111 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bd9ff6b64-56b5k_697ecff3-1654-416a-978c-e96762bc92d9/telemeter-client/0.log" Jun 11 15:31:53.774658 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.774628 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bd9ff6b64-56b5k_697ecff3-1654-416a-978c-e96762bc92d9/reload/0.log" Jun 11 15:31:53.796886 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:53.796856 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bd9ff6b64-56b5k_697ecff3-1654-416a-978c-e96762bc92d9/kube-rbac-proxy/0.log" Jun 11 15:31:56.364864 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.364830 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-695b84dcd5-5jh9f_4e2cf8bb-815a-41c6-99df-45310e418ff8/console/0.log" Jun 11 15:31:56.468693 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.468654 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x"] Jun 11 15:31:56.472105 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.472075 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.475194 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.475167 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5kp2\"/\"openshift-service-ca.crt\"" Jun 11 15:31:56.476496 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.476468 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5kp2\"/\"kube-root-ca.crt\"" Jun 11 15:31:56.476636 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.476468 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n5kp2\"/\"default-dockercfg-z27gt\"" Jun 11 15:31:56.482424 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.482394 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x"] Jun 11 15:31:56.531692 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.531649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-sys\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.531909 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.531721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-proc\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.531909 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.531800 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-lib-modules\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.531909 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.531824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfp8q\" (UniqueName: \"kubernetes.io/projected/26f026c9-9a48-4241-85bc-a3fe32404948-kube-api-access-jfp8q\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.531909 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.531855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-podres\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.633062 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.632962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-sys\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.633062 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.633023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-proc\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.633338 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.633075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-lib-modules\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.633338 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.633093 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfp8q\" (UniqueName: \"kubernetes.io/projected/26f026c9-9a48-4241-85bc-a3fe32404948-kube-api-access-jfp8q\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.633338 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.633095 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-sys\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.633338 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.633144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-podres\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.633338 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.633168 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-proc\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.633338 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.633247 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-lib-modules\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.633338 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.633258 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26f026c9-9a48-4241-85bc-a3fe32404948-podres\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.642918 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.642891 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfp8q\" (UniqueName: \"kubernetes.io/projected/26f026c9-9a48-4241-85bc-a3fe32404948-kube-api-access-jfp8q\") pod \"perf-node-gather-daemonset-xq42x\" (UID: \"26f026c9-9a48-4241-85bc-a3fe32404948\") " pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.783852 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.783812 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:56.929519 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:56.929485 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x"] Jun 11 15:31:56.931952 ip-10-0-139-244 kubenswrapper[2562]: W0611 15:31:56.931908 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod26f026c9_9a48_4241_85bc_a3fe32404948.slice/crio-bfbad8595f2ab05c4bd1c5eebfb37dfb69d63187e8ff9e5c43ff4c745d7d48ca WatchSource:0}: Error finding container bfbad8595f2ab05c4bd1c5eebfb37dfb69d63187e8ff9e5c43ff4c745d7d48ca: Status 404 returned error can't find the container with id bfbad8595f2ab05c4bd1c5eebfb37dfb69d63187e8ff9e5c43ff4c745d7d48ca Jun 11 15:31:57.534934 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:57.534892 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" event={"ID":"26f026c9-9a48-4241-85bc-a3fe32404948","Type":"ContainerStarted","Data":"7b2b17005a85c14abdfb0d0652031310c457e3ad315cf813c42599bda9a6ccae"} Jun 11 15:31:57.535341 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:57.534953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" event={"ID":"26f026c9-9a48-4241-85bc-a3fe32404948","Type":"ContainerStarted","Data":"bfbad8595f2ab05c4bd1c5eebfb37dfb69d63187e8ff9e5c43ff4c745d7d48ca"} Jun 11 15:31:57.535341 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:57.535003 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:31:57.551822 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:57.551766 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" podStartSLOduration=1.551748704 podStartE2EDuration="1.551748704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:31:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:31:57.55040892 +0000 UTC m=+2503.595796325" watchObservedRunningTime="2026-06-11 15:31:57.551748704 +0000 UTC m=+2503.597136172" Jun 11 15:31:58.235923 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:58.235891 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7wn45_baa10ca3-dc20-47bd-a6b3-38e10bac1b3e/dns/0.log" Jun 11 15:31:58.257979 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:58.257944 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7wn45_baa10ca3-dc20-47bd-a6b3-38e10bac1b3e/kube-rbac-proxy/0.log" Jun 11 15:31:58.414815 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:58.414777 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sq4qw_8c7f7145-6dd1-4bcd-bc44-acd990a2d517/dns-node-resolver/0.log" Jun 11 15:31:59.042321 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:31:59.042285 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7d55_40ea14c6-cca7-4e29-89e7-12e1a626e0f5/node-ca/0.log" Jun 11 15:32:00.110618 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:00.110579 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb8d84687-cj8kh_136e18cd-a401-4070-87a9-7896aacf7923/kube-auth-proxy/0.log" Jun 11 15:32:00.388724 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:00.388631 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdbc75df-j55tt_41629d05-8b07-4ceb-acf5-228f076da1a4/router/0.log" Jun 11 15:32:01.043074 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:01.043032 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hk7zh_36b795d5-21e0-40ca-a94e-e268fca1e2a5/serve-healthcheck-canary/0.log" Jun 11 15:32:01.552549 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:01.552500 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-8jp5g_72613a71-d9bd-4b3f-80c7-5ca7982b8db6/insights-operator/0.log" Jun 11 15:32:01.555065 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:01.555029 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-8jp5g_72613a71-d9bd-4b3f-80c7-5ca7982b8db6/insights-operator/1.log" Jun 11 15:32:01.647718 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:01.647690 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpr6g_630375c6-7f9a-463e-817b-eab421059c7d/kube-rbac-proxy/0.log" Jun 11 15:32:01.669602 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:01.669566 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpr6g_630375c6-7f9a-463e-817b-eab421059c7d/exporter/0.log" Jun 11 15:32:01.689536 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:01.689503 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpr6g_630375c6-7f9a-463e-817b-eab421059c7d/extractor/0.log" Jun 11 15:32:03.559080 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:03.559046 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n5kp2/perf-node-gather-daemonset-xq42x" Jun 11 15:32:04.303704 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:04.303667 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9njtt_63a9a343-4dcf-473a-a5c4-5d2b76b39546/manager/0.log" Jun 11 15:32:04.550303 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:04.550267 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58897f8c7f-tb9ph_750577e2-0a40-4221-b18e-70cf284aa7b5/manager/0.log" Jun 11 15:32:04.575032 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:04.574944 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58897f8c7f-tb9ph_750577e2-0a40-4221-b18e-70cf284aa7b5/copy-manifests/0.log" Jun 11 15:32:06.279556 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:06.279523 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56c95b7d7d-w4w7h_348a3090-5bfd-459d-8dc0-1c53765e084a/manager/0.log" Jun 11 15:32:10.409677 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:10.409633 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb8d84687-cj8kh_136e18cd-a401-4070-87a9-7896aacf7923/kube-auth-proxy/0.log" Jun 11 15:32:10.662801 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:10.662697 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdbc75df-j55tt_41629d05-8b07-4ceb-acf5-228f076da1a4/router/0.log" Jun 11 15:32:11.812867 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:11.812829 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb8d84687-cj8kh_136e18cd-a401-4070-87a9-7896aacf7923/kube-auth-proxy/0.log" Jun 11 15:32:11.846902 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:11.846865 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-xc45j_433fc2e0-5ffb-406b-989f-96ce70213829/kube-storage-version-migrator-operator/1.log" Jun 11 15:32:11.847817 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:11.847772 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-xc45j_433fc2e0-5ffb-406b-989f-96ce70213829/kube-storage-version-migrator-operator/0.log" Jun 11 15:32:12.042531 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:12.042488 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdbc75df-j55tt_41629d05-8b07-4ceb-acf5-228f076da1a4/router/0.log" Jun 11 15:32:13.186521 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.186489 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j6q2_e20387c0-94f0-42e5-ba1e-2f234b38c0a9/kube-multus-additional-cni-plugins/0.log" Jun 11 15:32:13.212243 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.212214 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j6q2_e20387c0-94f0-42e5-ba1e-2f234b38c0a9/egress-router-binary-copy/0.log" Jun 11 15:32:13.235344 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.235307 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j6q2_e20387c0-94f0-42e5-ba1e-2f234b38c0a9/cni-plugins/0.log" Jun 11 15:32:13.257188 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.257159 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j6q2_e20387c0-94f0-42e5-ba1e-2f234b38c0a9/bond-cni-plugin/0.log" Jun 11 15:32:13.278599 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.278571 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j6q2_e20387c0-94f0-42e5-ba1e-2f234b38c0a9/routeoverride-cni/0.log" Jun 11 15:32:13.298904 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.298878 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j6q2_e20387c0-94f0-42e5-ba1e-2f234b38c0a9/whereabouts-cni-bincopy/0.log" Jun 11 15:32:13.321300 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.321277 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j6q2_e20387c0-94f0-42e5-ba1e-2f234b38c0a9/whereabouts-cni/0.log" Jun 11 15:32:13.645868 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.645830 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb8d84687-cj8kh_136e18cd-a401-4070-87a9-7896aacf7923/kube-auth-proxy/0.log" Jun 11 15:32:13.686197 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.686163 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nx4z2_73d14d01-5879-4aa4-96ae-8be3de77b473/kube-multus/0.log" Jun 11 15:32:13.786062 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.786033 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-chz6g_6c70a562-3b07-482e-bbaa-a285419c369b/network-metrics-daemon/0.log" Jun 11 15:32:13.809599 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.809570 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-chz6g_6c70a562-3b07-482e-bbaa-a285419c369b/kube-rbac-proxy/0.log" Jun 11 15:32:13.884213 ip-10-0-139-244 kubenswrapper[2562]: I0611 15:32:13.884186 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8bdbc75df-j55tt_41629d05-8b07-4ceb-acf5-228f076da1a4/router/0.log"