Jun 03 15:38:09.774743 ip-10-0-139-233 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 15:38:09.774753 ip-10-0-139-233 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 15:38:09.774760 ip-10-0-139-233 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 15:38:09.774992 ip-10-0-139-233 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 15:38:19.961962 ip-10-0-139-233 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 15:38:19.961979 ip-10-0-139-233 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 49382575370942b796bb40384f16ea69 -- Jun 03 15:40:40.663003 ip-10-0-139-233 systemd[1]: Starting Kubernetes Kubelet... Jun 03 15:40:41.023688 ip-10-0-139-233 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:40:41.023688 ip-10-0-139-233 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 15:40:41.023688 ip-10-0-139-233 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:40:41.023688 ip-10-0-139-233 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 15:40:41.023688 ip-10-0-139-233 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:40:41.026318 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.026228 2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 15:40:41.033038 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033021 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:40:41.033038 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033039 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033042 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033047 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033050 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033053 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033056 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033058 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033061 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033063 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033066 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033068 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033071 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033074 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033077 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033084 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033087 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033089 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033092 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033094 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:40:41.033103 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033097 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033100 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033102 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033105 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033107 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033110 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033113 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033115 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033118 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033121 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033123 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033126 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033128 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033131 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033133 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033136 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033138 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033143 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033149 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:40:41.033545 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033151 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033154 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033156 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033159 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033163 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033166 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033169 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033172 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033175 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033177 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033179 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033181 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033184 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033186 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033189 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033192 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033195 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033197 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033200 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033202 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:40:41.034205 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033205 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033207 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033210 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033212 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033215 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033217 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033220 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033222 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033225 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033228 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033230 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033233 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033236 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033239 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033241 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033243 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033246 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033249 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033251 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033254 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:40:41.034789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033256 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033258 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033261 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033263 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033266 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033268 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.033271 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035255 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035266 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035269 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035273 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035277 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035280 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035283 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035285 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035288 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035290 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035293 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035295 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035298 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:40:41.035295 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035301 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035304 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035307 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035309 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035312 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035317 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035321 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035325 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035328 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035331 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035334 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035336 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035339 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035341 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035344 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035346 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035348 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035351 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035354 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035356 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:40:41.035789 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035359 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035361 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035364 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035366 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035369 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035372 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035374 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035376 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035379 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035381 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035384 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035386 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035388 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035391 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035394 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035398 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035401 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035405 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035407 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035410 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:40:41.036285 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035412 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035415 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035417 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035420 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035422 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035424 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035427 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035429 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035432 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035434 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035437 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035439 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035441 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035444 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035446 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035449 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035451 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035453 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035456 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:40:41.036795 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035459 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035461 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035464 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035467 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035469 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035471 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035481 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035484 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035487 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035490 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035492 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035495 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035497 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.035500 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035571 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035578 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035584 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035589 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035593 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035596 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035600 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 15:40:41.037279 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035604 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035607 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035610 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035613 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035616 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035619 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035622 2566 flags.go:64] FLAG: --cgroup-root="" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035624 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035627 2566 flags.go:64] FLAG: --client-ca-file="" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035630 2566 flags.go:64] FLAG: --cloud-config="" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035632 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035635 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035639 2566 flags.go:64] FLAG: --cluster-domain="" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035642 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035645 2566 flags.go:64] FLAG: --config-dir="" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035647 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035651 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035655 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035664 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035668 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035671 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035674 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035676 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035679 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035682 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 15:40:41.037804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035685 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035689 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035692 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035694 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035697 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035700 2566 flags.go:64] FLAG: --enable-server="true" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035702 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035706 2566 flags.go:64] FLAG: --event-burst="100" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035709 2566 flags.go:64] FLAG: --event-qps="50" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035712 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035715 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035735 2566 flags.go:64] FLAG: --eviction-hard="" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035741 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035745 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035749 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035752 2566 flags.go:64] FLAG: --eviction-soft="" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035755 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035757 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035760 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035763 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035765 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035768 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035771 2566 flags.go:64] FLAG: --feature-gates="" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035775 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035778 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 15:40:41.038406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035782 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035791 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035794 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035797 2566 flags.go:64] FLAG: --help="false" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035800 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035804 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035806 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035809 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035812 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035815 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035818 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035821 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035823 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035826 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035828 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035831 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035834 2566 flags.go:64] FLAG: --kube-reserved="" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035836 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035840 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035843 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035845 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035848 2566 flags.go:64] FLAG: --lock-file="" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035850 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035853 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 15:40:41.039183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035856 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035861 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035863 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035866 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035868 2566 flags.go:64] FLAG: --logging-format="text" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035872 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035875 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035877 2566 flags.go:64] FLAG: --manifest-url="" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035880 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035885 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035896 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035900 2566 flags.go:64] FLAG: --max-pods="110" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035903 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035906 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035908 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035912 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035914 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035917 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035920 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035927 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035931 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035933 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035936 2566 flags.go:64] FLAG: --pod-cidr="" Jun 03 15:40:41.039788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035939 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035944 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035946 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035949 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035952 2566 flags.go:64] FLAG: --port="10250" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035955 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035958 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a83c204df4e99b29" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035961 2566 flags.go:64] FLAG: --qos-reserved="" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035963 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035966 2566 flags.go:64] FLAG: --register-node="true" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035969 2566 flags.go:64] FLAG: --register-schedulable="true" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035972 2566 flags.go:64] FLAG: --register-with-taints="" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035975 2566 flags.go:64] FLAG: --registry-burst="10" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035978 2566 flags.go:64] FLAG: --registry-qps="5" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035980 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035983 2566 flags.go:64] FLAG: --reserved-memory="" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035987 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035990 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035993 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.035996 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036005 2566 flags.go:64] FLAG: --runonce="false" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036008 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036011 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036014 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036016 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036019 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 15:40:41.040357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036022 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036024 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036027 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036030 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036033 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036035 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036038 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036041 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036044 2566 flags.go:64] FLAG: --system-cgroups="" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036046 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036052 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036055 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036057 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036061 2566 flags.go:64] FLAG: --tls-min-version="" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036064 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036066 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036069 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036072 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036075 2566 flags.go:64] FLAG: --v="2" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036079 2566 flags.go:64] FLAG: --version="false" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036083 2566 flags.go:64] FLAG: --vmodule="" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036087 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.036090 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036195 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:40:41.040994 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036199 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036203 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036206 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036215 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036218 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036221 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036223 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036226 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036228 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036231 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036233 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036235 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036238 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036241 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036243 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036245 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036248 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036250 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036253 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036257 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:40:41.041576 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036260 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036263 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036266 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036268 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036271 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036274 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036276 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036279 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036281 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036286 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036289 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036292 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036295 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036298 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036300 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036304 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036313 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036316 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036318 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:40:41.042118 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036321 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036324 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036326 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036328 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036331 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036333 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036335 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036338 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036341 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036343 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036345 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036348 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036351 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036353 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036356 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036358 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036360 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036363 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036365 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036367 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:40:41.042630 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036370 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036372 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036377 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036379 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036382 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036384 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036387 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036389 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036392 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036394 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036402 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036405 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036407 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036410 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036412 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036415 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036417 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036420 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036423 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036425 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:40:41.043185 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036427 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036430 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036432 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036434 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036437 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.036439 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.037165 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.043595 2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.043612 2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043664 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043669 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043672 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043675 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:40:41.043672 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043678 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043681 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043684 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043687 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043689 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043692 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043694 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043697 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043699 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043702 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043704 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043706 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043709 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043711 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043714 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043734 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043737 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043740 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043742 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043745 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:40:41.044022 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043747 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043750 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043752 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043754 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043757 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043759 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043762 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043765 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043768 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043771 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043773 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043776 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043778 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043780 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043783 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043786 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043788 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043790 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043793 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043795 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:40:41.044546 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043798 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043800 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043803 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043805 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043808 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043810 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043812 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043815 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043817 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043820 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043822 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043824 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043828 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043832 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043835 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043838 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043841 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043843 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043847 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:40:41.045049 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043849 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043853 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043855 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043858 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043860 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043863 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043867 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043871 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043874 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043876 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043879 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043881 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043884 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043886 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043889 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043891 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043894 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043897 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043899 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043902 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:40:41.045510 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043904 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043907 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.043909 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.043914 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044011 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044014 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044017 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044020 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044022 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044025 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044028 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044031 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044035 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044038 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:40:41.046011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044041 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044044 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044046 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044049 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044052 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044054 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044057 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044059 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044061 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044064 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044066 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044069 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044071 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044073 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044076 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044078 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044080 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044082 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044085 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044087 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:40:41.046362 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044089 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044092 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044094 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044097 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044099 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044101 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044104 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044106 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044108 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044111 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044114 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044116 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044119 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044121 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044124 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044126 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044129 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044131 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044135 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:40:41.046841 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044138 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044140 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044151 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044153 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044156 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044158 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044160 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044163 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044165 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044167 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044169 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044172 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044174 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044176 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044179 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044181 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044183 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044185 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044188 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044190 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:40:41.047312 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044192 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044195 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044197 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044200 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044202 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044205 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044207 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044210 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044213 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044215 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044218 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044220 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044222 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044225 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044227 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044230 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:40:41.047856 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:41.044232 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:40:41.048241 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.044237 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:40:41.048241 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.044849 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 15:40:41.048241 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.046936 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 15:40:41.048958 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.048946 2566 server.go:1019] "Starting client certificate rotation" Jun 03 15:40:41.049062 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.049046 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:40:41.049097 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.049087 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:40:41.068939 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.068922 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:40:41.070599 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.070583 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:40:41.086107 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.086088 2566 log.go:25] "Validated CRI v1 runtime API" Jun 03 15:40:41.091241 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.091225 2566 log.go:25] "Validated CRI v1 image API" Jun 03 15:40:41.093021 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.093002 2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 15:40:41.096511 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.096494 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:40:41.096974 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.096952 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a0ec899d-8121-4bd4-a1b1-3fcfc0037d9d:/dev/nvme0n1p4 a76bcfd4-34f3-4322-915f-22fed54b6beb:/dev/nvme0n1p3] Jun 03 15:40:41.097011 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.096976 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 15:40:41.101394 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.101287 2566 manager.go:217] Machine: {Timestamp:2026-06-03 15:40:41.100752173 +0000 UTC m=+0.338499714 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096275 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2772dd0e444e64c46ae16de04fe5bf SystemUUID:ec2772dd-0e44-4e64-c46a-e16de04fe5bf BootID:49382575-3709-42b7-96bb-40384f16ea69 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:76:71:7d:cd:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:76:71:7d:cd:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:1e:22:19:5a:86 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 15:40:41.101806 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.101795 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 15:40:41.101892 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.101880 2566 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 15:40:41.103431 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.103405 2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 15:40:41.103564 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.103433 2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 15:40:41.103608 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.103571 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 15:40:41.103608 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.103579 2566 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 15:40:41.103608 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.103587 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:40:41.104327 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.104317 2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:40:41.105659 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.105649 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:40:41.105786 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.105778 2566 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 15:40:41.107800 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.107790 2566 kubelet.go:491] "Attempting to sync node with API server" Jun 03 15:40:41.107839 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.107809 2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 15:40:41.107839 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.107820 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 15:40:41.107839 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.107829 2566 kubelet.go:397] "Adding apiserver pod source" Jun 03 15:40:41.107839 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.107838 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 15:40:41.108820 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.108808 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:40:41.108857 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.108835 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:40:41.121095 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.121071 2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 15:40:41.123156 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.123140 2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 15:40:41.125143 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125124 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 15:40:41.125143 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125142 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 15:40:41.125259 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125149 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 15:40:41.125259 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125155 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 15:40:41.125259 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125163 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 15:40:41.125259 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125169 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 15:40:41.125259 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125174 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 15:40:41.125259 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125179 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 15:40:41.125259 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125186 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 15:40:41.125259 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125193 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 15:40:41.125259 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125201 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 15:40:41.125259 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125206 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 15:40:41.125874 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125864 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 15:40:41.125874 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.125873 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 15:40:41.127031 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.126998 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 15:40:41.127112 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.127035 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 15:40:41.129026 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.129014 2566 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 15:40:41.129068 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.129046 2566 server.go:1295] "Started kubelet" Jun 03 15:40:41.129389 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.129371 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 15:40:41.129744 ip-10-0-139-233 systemd[1]: Started Kubernetes Kubelet. Jun 03 15:40:41.131417 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.131343 2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 15:40:41.131494 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.131440 2566 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 15:40:41.131882 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.131869 2566 server.go:317] "Adding debug handlers to kubelet server" Jun 03 15:40:41.133058 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.133044 2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 15:40:41.135543 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.135524 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 15:40:41.136021 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.136002 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 15:40:41.136210 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.136196 2566 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 15:40:41.136210 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.136212 2566 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 15:40:41.136344 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.136334 2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 15:40:41.136397 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.136381 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 03 15:40:41.136397 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.136389 2566 reconciler.go:26] "Reconciler: start to sync state" Jun 03 15:40:41.137028 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.137011 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:41.137974 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.137958 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 15:40:41.137974 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.137974 2566 factory.go:55] Registering systemd factory Jun 03 15:40:41.138123 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.137983 2566 factory.go:223] Registration of the systemd container factory successfully Jun 03 15:40:41.138181 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.138168 2566 factory.go:153] Registering CRI-O factory Jun 03 15:40:41.138244 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.138183 2566 factory.go:223] Registration of the crio container factory successfully Jun 03 15:40:41.138244 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.138202 2566 factory.go:103] Registering Raw factory Jun 03 15:40:41.138244 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.138220 2566 manager.go:1196] Started watching for new ooms in manager Jun 03 15:40:41.138545 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.138531 2566 manager.go:319] Starting recovery of all containers Jun 03 15:40:41.139579 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.139554 2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 15:40:41.142027 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.141993 2566 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 15:40:41.142548 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.142517 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 15:40:41.142638 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.142568 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 15:40:41.143773 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.142219 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-233.ec2.internal.18b59c71ffa343d1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-233.ec2.internal,UID:ip-10-0-139-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-233.ec2.internal,},FirstTimestamp:2026-06-03 15:40:41.129026513 +0000 UTC m=+0.366774042,LastTimestamp:2026-06-03 15:40:41.129026513 +0000 UTC m=+0.366774042,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-233.ec2.internal,}" Jun 03 15:40:41.149214 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.149083 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-df2jf" Jun 03 15:40:41.151862 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.151844 2566 manager.go:324] Recovery completed Jun 03 15:40:41.155895 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.155872 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-df2jf" Jun 03 15:40:41.156071 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.156060 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:41.157853 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.157838 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:41.157934 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.157870 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:41.157934 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.157883 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:41.158389 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.158377 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 15:40:41.158389 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.158388 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 15:40:41.158475 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.158405 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:40:41.159798 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.159697 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-233.ec2.internal.18b59c72015b1f1b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-233.ec2.internal,UID:ip-10-0-139-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-233.ec2.internal,},FirstTimestamp:2026-06-03 15:40:41.157852955 +0000 UTC m=+0.395600488,LastTimestamp:2026-06-03 15:40:41.157852955 +0000 UTC m=+0.395600488,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-233.ec2.internal,}" Jun 03 15:40:41.160866 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.160853 2566 policy_none.go:49] "None policy: Start" Jun 03 15:40:41.160925 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.160869 2566 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 15:40:41.160925 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.160879 2566 state_mem.go:35] "Initializing new in-memory state store" Jun 03 15:40:41.217317 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.217300 2566 manager.go:341] "Starting Device Plugin manager" Jun 03 15:40:41.218548 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.217359 2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 15:40:41.218548 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.217375 2566 server.go:85] "Starting device plugin registration server" Jun 03 15:40:41.218548 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.217618 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 15:40:41.218548 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.217632 2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 15:40:41.218548 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.217750 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 15:40:41.218548 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.217855 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 15:40:41.218548 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.217866 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 15:40:41.218548 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.218298 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 15:40:41.218548 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.218336 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:41.239653 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.239626 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 15:40:41.240975 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.240954 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 15:40:41.241053 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.240982 2566 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 15:40:41.241053 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.241018 2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 15:40:41.241053 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.241024 2566 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 15:40:41.241157 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.241062 2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 15:40:41.243506 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.243486 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:41.318545 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.318473 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:41.319566 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.319549 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:41.319654 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.319582 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:41.319654 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.319592 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:41.319654 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.319617 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.328589 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.328569 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.328633 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.328598 2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-233.ec2.internal\": node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:41.341486 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.341466 2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-233.ec2.internal"] Jun 03 15:40:41.341552 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.341522 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:41.343012 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.342999 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:41.343079 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.343026 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:41.343079 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.343040 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:41.344250 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.344239 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:41.344425 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.344413 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.344462 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.344442 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:41.344914 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.344900 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:41.344978 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.344900 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:41.344978 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.344954 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:41.344978 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.344966 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:41.345064 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.344929 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:41.345064 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.345000 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:41.345993 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.345981 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.346029 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.346003 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:40:41.346569 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.346552 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:40:41.346631 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.346581 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:40:41.346631 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.346595 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:40:41.346977 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.346962 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:41.379330 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.379273 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-233.ec2.internal\" not found" node="ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.383713 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.383697 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-233.ec2.internal\" not found" node="ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.438357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.438329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8fd5fecc6875c8582ac03c1e0e534ca-config\") pod \"kube-apiserver-proxy-ip-10-0-139-233.ec2.internal\" (UID: \"c8fd5fecc6875c8582ac03c1e0e534ca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.438357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.438359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98d44e77ea7f249f79b0474b960a99c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal\" (UID: \"98d44e77ea7f249f79b0474b960a99c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.438502 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.438378 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98d44e77ea7f249f79b0474b960a99c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal\" (UID: \"98d44e77ea7f249f79b0474b960a99c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.447431 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.447409 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:41.538818 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.538790 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98d44e77ea7f249f79b0474b960a99c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal\" (UID: \"98d44e77ea7f249f79b0474b960a99c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.538874 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.538824 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98d44e77ea7f249f79b0474b960a99c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal\" (UID: \"98d44e77ea7f249f79b0474b960a99c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.538874 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.538841 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8fd5fecc6875c8582ac03c1e0e534ca-config\") pod \"kube-apiserver-proxy-ip-10-0-139-233.ec2.internal\" (UID: \"c8fd5fecc6875c8582ac03c1e0e534ca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.538944 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.538894 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98d44e77ea7f249f79b0474b960a99c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal\" (UID: \"98d44e77ea7f249f79b0474b960a99c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.538944 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.538902 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98d44e77ea7f249f79b0474b960a99c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal\" (UID: \"98d44e77ea7f249f79b0474b960a99c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.538944 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.538902 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8fd5fecc6875c8582ac03c1e0e534ca-config\") pod \"kube-apiserver-proxy-ip-10-0-139-233.ec2.internal\" (UID: \"c8fd5fecc6875c8582ac03c1e0e534ca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.547907 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.547887 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:41.648672 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.648603 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:41.682786 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.682766 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.686859 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:41.686841 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-233.ec2.internal" Jun 03 15:40:41.749691 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.749666 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:41.850160 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.850130 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:41.950698 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:41.950625 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:42.049369 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.049332 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 15:40:42.049945 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.049490 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:40:42.051469 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:42.051451 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:42.136041 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.136014 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 15:40:42.150186 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.150160 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:42.151788 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:42.151771 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:42.157240 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.157216 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 15:35:41 +0000 UTC" deadline="2028-03-17 05:52:01.575619932 +0000 UTC" Jun 03 15:40:42.157240 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.157238 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15662h11m19.418384363s" Jun 03 15:40:42.157362 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.157270 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:40:42.179795 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.179775 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tmznc" Jun 03 15:40:42.186524 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.186504 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tmznc" Jun 03 15:40:42.186639 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:42.186613 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d44e77ea7f249f79b0474b960a99c3.slice/crio-f088fde98f1208b3b59211f8f217c91541ccb6f2b32458e8917b3848675da38b WatchSource:0}: Error finding container f088fde98f1208b3b59211f8f217c91541ccb6f2b32458e8917b3848675da38b: Status 404 returned error can't find the container with id f088fde98f1208b3b59211f8f217c91541ccb6f2b32458e8917b3848675da38b Jun 03 15:40:42.186869 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:42.186850 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8fd5fecc6875c8582ac03c1e0e534ca.slice/crio-95ca16769dd7881434a49c8f3c068f0c7005fae709476b9d97309c55aa1281ea WatchSource:0}: Error finding container 95ca16769dd7881434a49c8f3c068f0c7005fae709476b9d97309c55aa1281ea: Status 404 returned error can't find the container with id 95ca16769dd7881434a49c8f3c068f0c7005fae709476b9d97309c55aa1281ea Jun 03 15:40:42.190155 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.190138 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:40:42.243689 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.243611 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-233.ec2.internal" event={"ID":"c8fd5fecc6875c8582ac03c1e0e534ca","Type":"ContainerStarted","Data":"95ca16769dd7881434a49c8f3c068f0c7005fae709476b9d97309c55aa1281ea"} Jun 03 15:40:42.244583 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.244562 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" event={"ID":"98d44e77ea7f249f79b0474b960a99c3","Type":"ContainerStarted","Data":"f088fde98f1208b3b59211f8f217c91541ccb6f2b32458e8917b3848675da38b"} Jun 03 15:40:42.252790 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:42.252772 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:42.343602 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.343581 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:42.353749 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:42.353730 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:42.454235 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:42.454207 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-233.ec2.internal\" not found" Jun 03 15:40:42.532952 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.532897 2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:42.537045 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.537031 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" Jun 03 15:40:42.556062 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.556045 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:40:42.557010 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.556995 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-233.ec2.internal" Jun 03 15:40:42.565451 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:42.565433 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:40:43.109503 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.109233 2566 apiserver.go:52] "Watching apiserver" Jun 03 15:40:43.115983 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.115949 2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 15:40:43.118217 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.118191 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-233.ec2.internal","openshift-image-registry/node-ca-qr4lb","openshift-multus/network-metrics-daemon-llzgd","openshift-network-operator/iptables-alerter-ht4w5","openshift-ovn-kubernetes/ovnkube-node-4gqgl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw","openshift-cluster-node-tuning-operator/tuned-9cht2","openshift-dns/node-resolver-p4b5p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal","openshift-multus/multus-5qq54","openshift-multus/multus-additional-cni-plugins-s72xm","openshift-network-diagnostics/network-check-target-9cxct","kube-system/konnectivity-agent-qxccn"] Jun 03 15:40:43.120604 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.120581 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.121733 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.121696 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qr4lb" Jun 03 15:40:43.121824 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.121802 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:43.121887 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.121862 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:40:43.123261 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.123155 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ht4w5" Jun 03 15:40:43.124781 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.124059 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 15:40:43.124781 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.124509 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:40:43.124781 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.124588 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7nfm7\"" Jun 03 15:40:43.124781 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.124593 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 15:40:43.124781 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.124756 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x7sgw\"" Jun 03 15:40:43.125024 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.124994 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 15:40:43.125225 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.125122 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 15:40:43.126311 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.125899 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:40:43.126618 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.126588 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.127694 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.127672 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 15:40:43.127828 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.127810 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g6gw5\"" Jun 03 15:40:43.127900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.127885 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 15:40:43.128676 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.128656 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 15:40:43.129029 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.128772 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.129457 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.129437 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 15:40:43.129542 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.129493 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 15:40:43.129737 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.129704 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 15:40:43.129830 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.129760 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hdzfd\"" Jun 03 15:40:43.129898 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.129824 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 15:40:43.129898 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.129870 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 15:40:43.130884 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.130628 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4b5p" Jun 03 15:40:43.130884 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.130756 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 15:40:43.131438 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.131328 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 15:40:43.131438 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.131379 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 15:40:43.131508 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.131379 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m6nxx\"" Jun 03 15:40:43.132383 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.132367 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.132933 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.132915 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 15:40:43.133021 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.132916 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 15:40:43.133021 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.132923 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pzdzn\"" Jun 03 15:40:43.133734 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.133702 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.134290 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.134272 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 15:40:43.134394 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.134379 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 15:40:43.134809 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.134781 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 15:40:43.134910 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.134811 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nrd7q\"" Jun 03 15:40:43.134910 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.134817 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 15:40:43.135038 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.134958 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:43.135127 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.135082 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:40:43.136045 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.136027 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 15:40:43.136239 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.136225 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 15:40:43.136472 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.136454 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mxb28\"" Jun 03 15:40:43.136600 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.136572 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:40:43.137697 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.137681 2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 15:40:43.138830 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.138809 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 15:40:43.139164 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.139144 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-64q26\"" Jun 03 15:40:43.139252 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.139204 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 15:40:43.147346 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147326 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-os-release\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.147431 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-hostroot\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.147431 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147385 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-registration-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.147431 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-run\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.147590 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147437 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-run-systemd\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.147590 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-run-ovn-kubernetes\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.147590 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147483 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-kubelet\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.147590 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147504 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-slash\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.147590 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqllg\" (UniqueName: \"kubernetes.io/projected/c1363edd-7664-461f-97f1-7343ef69e469-kube-api-access-sqllg\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.147590 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65aae031-fa35-47fd-bdb3-ede2d2255c04-cni-binary-copy\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.147590 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147578 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n79j8\" (UniqueName: \"kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8\") pod \"network-check-target-9cxct\" (UID: \"e58e24e8-e014-4d36-bd6f-5b10482fde22\") " pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:43.147883 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147616 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:43.147883 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f83cc80e-2a78-4924-89f0-73513fdeebe7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.147883 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147708 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k724\" (UniqueName: \"kubernetes.io/projected/f83cc80e-2a78-4924-89f0-73513fdeebe7-kube-api-access-4k724\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.147883 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147747 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-log-socket\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.147883 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147771 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-run-k8s-cni-cncf-io\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.147883 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-run-netns\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.147883 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147838 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-os-release\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.148158 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147896 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f83cc80e-2a78-4924-89f0-73513fdeebe7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.148158 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-sysconfig\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.148158 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147957 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-sysctl-conf\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.148158 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6888c28-3ce4-430b-95d7-928a55f82992-serviceca\") pod \"node-ca-qr4lb\" (UID: \"b6888c28-3ce4-430b-95d7-928a55f82992\") " pod="openshift-image-registry/node-ca-qr4lb" Jun 03 15:40:43.148158 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.147989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-run-netns\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.148158 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1363edd-7664-461f-97f1-7343ef69e469-ovn-node-metrics-cert\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.148158 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148023 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-var-lib-cni-bin\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.148158 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-sys\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.148158 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-var-lib-kubelet\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.148158 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148124 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c774\" (UniqueName: \"kubernetes.io/projected/72947292-2b7f-49f2-ba4c-91b67b294dd7-kube-api-access-2c774\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.148158 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148150 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-systemd-units\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148172 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-run-multus-certs\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-etc-kubernetes\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-var-lib-kubelet\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-system-cni-dir\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148275 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f83cc80e-2a78-4924-89f0-73513fdeebe7-cni-binary-copy\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148326 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72947292-2b7f-49f2-ba4c-91b67b294dd7-tmp\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148349 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6888c28-3ce4-430b-95d7-928a55f82992-host\") pod \"node-ca-qr4lb\" (UID: \"b6888c28-3ce4-430b-95d7-928a55f82992\") " pod="openshift-image-registry/node-ca-qr4lb" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148371 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-node-log\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148397 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-cni-dir\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55dwv\" (UniqueName: \"kubernetes.io/projected/65aae031-fa35-47fd-bdb3-ede2d2255c04-kube-api-access-55dwv\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148436 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44641150-4d93-42b3-bf38-725c47722bab-host-slash\") pod \"iptables-alerter-ht4w5\" (UID: \"44641150-4d93-42b3-bf38-725c47722bab\") " pod="openshift-network-operator/iptables-alerter-ht4w5" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148458 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-cnibin\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148482 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-systemd\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-var-lib-openvswitch\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.148550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-cni-netd\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-cnibin\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148586 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-socket-dir-parent\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148603 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-var-lib-cni-multus\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148618 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/24e0b295-848d-456f-8447-6cb5878a49fb-konnectivity-ca\") pod \"konnectivity-agent-qxccn\" (UID: \"24e0b295-848d-456f-8447-6cb5878a49fb\") " pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148634 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-run-openvswitch\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148649 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-cni-bin\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148688 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq6ns\" (UniqueName: \"kubernetes.io/projected/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-kube-api-access-qq6ns\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148710 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-etc-openvswitch\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c1363edd-7664-461f-97f1-7343ef69e469-ovnkube-config\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/24e0b295-848d-456f-8447-6cb5878a49fb-agent-certs\") pod \"konnectivity-agent-qxccn\" (UID: \"24e0b295-848d-456f-8447-6cb5878a49fb\") " pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148865 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mkfq\" (UniqueName: \"kubernetes.io/projected/6284ebc4-f9c4-427d-9788-45e117df6a55-kube-api-access-2mkfq\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148894 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-run-ovn\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c1363edd-7664-461f-97f1-7343ef69e469-env-overrides\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148944 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-sysctl-d\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.149172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.148975 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c1363edd-7664-461f-97f1-7343ef69e469-ovnkube-script-lib\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-system-cni-dir\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-socket-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04f1a986-af91-4f11-8331-24d0a44eed34-hosts-file\") pod \"node-resolver-p4b5p\" (UID: \"04f1a986-af91-4f11-8331-24d0a44eed34\") " pod="openshift-dns/node-resolver-p4b5p" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149068 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f1a986-af91-4f11-8331-24d0a44eed34-tmp-dir\") pod \"node-resolver-p4b5p\" (UID: \"04f1a986-af91-4f11-8331-24d0a44eed34\") " pod="openshift-dns/node-resolver-p4b5p" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149090 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-modprobe-d\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149111 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-lib-modules\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149148 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-tuned\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149200 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-etc-selinux\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6spnz\" (UniqueName: \"kubernetes.io/projected/04f1a986-af91-4f11-8331-24d0a44eed34-kube-api-access-6spnz\") pod \"node-resolver-p4b5p\" (UID: \"04f1a986-af91-4f11-8331-24d0a44eed34\") " pod="openshift-dns/node-resolver-p4b5p" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-kubernetes\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-host\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-conf-dir\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149342 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-device-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-sys-fs\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.149900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-daemon-config\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.150638 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44641150-4d93-42b3-bf38-725c47722bab-iptables-alerter-script\") pod \"iptables-alerter-ht4w5\" (UID: \"44641150-4d93-42b3-bf38-725c47722bab\") " pod="openshift-network-operator/iptables-alerter-ht4w5" Jun 03 15:40:43.150638 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8b7r\" (UniqueName: \"kubernetes.io/projected/44641150-4d93-42b3-bf38-725c47722bab-kube-api-access-h8b7r\") pod \"iptables-alerter-ht4w5\" (UID: \"44641150-4d93-42b3-bf38-725c47722bab\") " pod="openshift-network-operator/iptables-alerter-ht4w5" Jun 03 15:40:43.150638 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.149459 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6867\" (UniqueName: \"kubernetes.io/projected/b6888c28-3ce4-430b-95d7-928a55f82992-kube-api-access-m6867\") pod \"node-ca-qr4lb\" (UID: \"b6888c28-3ce4-430b-95d7-928a55f82992\") " pod="openshift-image-registry/node-ca-qr4lb" Jun 03 15:40:43.187495 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.187253 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:35:42 +0000 UTC" deadline="2027-12-19 02:29:21.66382784 +0000 UTC" Jun 03 15:40:43.187495 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.187285 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13522h48m38.476546496s" Jun 03 15:40:43.249836 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.249800 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-run-systemd\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.249966 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.249846 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-run-ovn-kubernetes\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.249966 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.249867 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-kubelet\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.249966 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.249875 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-run-systemd\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.249966 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.249882 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-slash\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.249966 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.249932 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-kubelet\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.249966 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.249936 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-run-ovn-kubernetes\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.249966 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.249940 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqllg\" (UniqueName: \"kubernetes.io/projected/c1363edd-7664-461f-97f1-7343ef69e469-kube-api-access-sqllg\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.249966 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.249966 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65aae031-fa35-47fd-bdb3-ede2d2255c04-cni-binary-copy\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.249980 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-slash\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.249993 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n79j8\" (UniqueName: \"kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8\") pod \"network-check-target-9cxct\" (UID: \"e58e24e8-e014-4d36-bd6f-5b10482fde22\") " pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250017 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250043 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f83cc80e-2a78-4924-89f0-73513fdeebe7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250068 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k724\" (UniqueName: \"kubernetes.io/projected/f83cc80e-2a78-4924-89f0-73513fdeebe7-kube-api-access-4k724\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250092 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-log-socket\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250118 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-run-k8s-cni-cncf-io\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250143 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-run-netns\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250171 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-os-release\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250197 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f83cc80e-2a78-4924-89f0-73513fdeebe7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250196 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-log-socket\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.250210 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250229 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-sysconfig\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250251 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-sysctl-conf\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250264 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-run-k8s-cni-cncf-io\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250267 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-run-netns\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.250298 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.250301 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs podName:1c22f0a9-6788-4c37-89a6-5ab6de86ef60 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:43.750257291 +0000 UTC m=+2.988004828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs") pod "network-metrics-daemon-llzgd" (UID: "1c22f0a9-6788-4c37-89a6-5ab6de86ef60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250339 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-os-release\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250369 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-sysconfig\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250397 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-sysctl-conf\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250420 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6888c28-3ce4-430b-95d7-928a55f82992-serviceca\") pod \"node-ca-qr4lb\" (UID: \"b6888c28-3ce4-430b-95d7-928a55f82992\") " pod="openshift-image-registry/node-ca-qr4lb" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250444 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-run-netns\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250467 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1363edd-7664-461f-97f1-7343ef69e469-ovn-node-metrics-cert\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250492 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-var-lib-cni-bin\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250515 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-sys\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250514 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-run-netns\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250538 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-var-lib-kubelet\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250561 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2c774\" (UniqueName: \"kubernetes.io/projected/72947292-2b7f-49f2-ba4c-91b67b294dd7-kube-api-access-2c774\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250564 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-var-lib-cni-bin\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250603 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-sys\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250630 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-var-lib-kubelet\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250590 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-systemd-units\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250630 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-systemd-units\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250668 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-run-multus-certs\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.251128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250693 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-etc-kubernetes\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250736 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-var-lib-kubelet\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250763 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-system-cni-dir\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250787 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f83cc80e-2a78-4924-89f0-73513fdeebe7-cni-binary-copy\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250821 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250820 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f83cc80e-2a78-4924-89f0-73513fdeebe7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250835 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f83cc80e-2a78-4924-89f0-73513fdeebe7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250845 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72947292-2b7f-49f2-ba4c-91b67b294dd7-tmp\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250840 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-var-lib-kubelet\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250879 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-etc-kubernetes\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250881 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6888c28-3ce4-430b-95d7-928a55f82992-serviceca\") pod \"node-ca-qr4lb\" (UID: \"b6888c28-3ce4-430b-95d7-928a55f82992\") " pod="openshift-image-registry/node-ca-qr4lb" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250879 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6888c28-3ce4-430b-95d7-928a55f82992-host\") pod \"node-ca-qr4lb\" (UID: \"b6888c28-3ce4-430b-95d7-928a55f82992\") " pod="openshift-image-registry/node-ca-qr4lb" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250861 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-run-multus-certs\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-system-cni-dir\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250911 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-node-log\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250927 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-node-log\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250949 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-cni-dir\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250985 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-cni-dir\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252069 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.250953 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6888c28-3ce4-430b-95d7-928a55f82992-host\") pod \"node-ca-qr4lb\" (UID: \"b6888c28-3ce4-430b-95d7-928a55f82992\") " pod="openshift-image-registry/node-ca-qr4lb" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251007 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55dwv\" (UniqueName: \"kubernetes.io/projected/65aae031-fa35-47fd-bdb3-ede2d2255c04-kube-api-access-55dwv\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251024 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251034 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44641150-4d93-42b3-bf38-725c47722bab-host-slash\") pod \"iptables-alerter-ht4w5\" (UID: \"44641150-4d93-42b3-bf38-725c47722bab\") " pod="openshift-network-operator/iptables-alerter-ht4w5" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251055 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65aae031-fa35-47fd-bdb3-ede2d2255c04-cni-binary-copy\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251086 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44641150-4d93-42b3-bf38-725c47722bab-host-slash\") pod \"iptables-alerter-ht4w5\" (UID: \"44641150-4d93-42b3-bf38-725c47722bab\") " pod="openshift-network-operator/iptables-alerter-ht4w5" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251091 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251157 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-cnibin\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251188 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-systemd\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251211 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-var-lib-openvswitch\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251231 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-cni-netd\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251256 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-cnibin\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251258 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f83cc80e-2a78-4924-89f0-73513fdeebe7-cnibin\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251275 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-systemd\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251281 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-socket-dir-parent\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251281 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-var-lib-openvswitch\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251312 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-cni-netd\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251318 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-var-lib-cni-multus\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.252893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251338 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-cnibin\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251344 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/24e0b295-848d-456f-8447-6cb5878a49fb-konnectivity-ca\") pod \"konnectivity-agent-qxccn\" (UID: \"24e0b295-848d-456f-8447-6cb5878a49fb\") " pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251353 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f83cc80e-2a78-4924-89f0-73513fdeebe7-cni-binary-copy\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251369 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-host-var-lib-cni-multus\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251369 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-run-openvswitch\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251389 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-cni-bin\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251345 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-socket-dir-parent\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251403 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-run-openvswitch\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251405 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq6ns\" (UniqueName: \"kubernetes.io/projected/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-kube-api-access-qq6ns\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251439 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251443 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-cni-bin\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251468 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-etc-openvswitch\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251487 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251498 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c1363edd-7664-461f-97f1-7343ef69e469-ovnkube-config\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-etc-openvswitch\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251537 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/24e0b295-848d-456f-8447-6cb5878a49fb-agent-certs\") pod \"konnectivity-agent-qxccn\" (UID: \"24e0b295-848d-456f-8447-6cb5878a49fb\") " pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251556 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2mkfq\" (UniqueName: \"kubernetes.io/projected/6284ebc4-f9c4-427d-9788-45e117df6a55-kube-api-access-2mkfq\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.253610 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251580 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-run-ovn\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251598 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c1363edd-7664-461f-97f1-7343ef69e469-env-overrides\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251628 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-sysctl-d\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251656 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c1363edd-7664-461f-97f1-7343ef69e469-ovnkube-script-lib\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251686 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-system-cni-dir\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251709 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-socket-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251754 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04f1a986-af91-4f11-8331-24d0a44eed34-hosts-file\") pod \"node-resolver-p4b5p\" (UID: \"04f1a986-af91-4f11-8331-24d0a44eed34\") " pod="openshift-dns/node-resolver-p4b5p" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251782 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f1a986-af91-4f11-8331-24d0a44eed34-tmp-dir\") pod \"node-resolver-p4b5p\" (UID: \"04f1a986-af91-4f11-8331-24d0a44eed34\") " pod="openshift-dns/node-resolver-p4b5p" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251805 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-modprobe-d\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251832 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-lib-modules\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251853 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-system-cni-dir\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251864 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/24e0b295-848d-456f-8447-6cb5878a49fb-konnectivity-ca\") pod \"konnectivity-agent-qxccn\" (UID: \"24e0b295-848d-456f-8447-6cb5878a49fb\") " pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.251855 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-tuned\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.252452 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.252516 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-etc-selinux\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.252553 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6spnz\" (UniqueName: \"kubernetes.io/projected/04f1a986-af91-4f11-8331-24d0a44eed34-kube-api-access-6spnz\") pod \"node-resolver-p4b5p\" (UID: \"04f1a986-af91-4f11-8331-24d0a44eed34\") " pod="openshift-dns/node-resolver-p4b5p" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.252581 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-kubernetes\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.254339 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.252613 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-host\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.255091 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.254852 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-sysctl-d\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.255091 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.255023 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c1363edd-7664-461f-97f1-7343ef69e469-ovnkube-config\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.255324 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-conf-dir\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.255357 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c1363edd-7664-461f-97f1-7343ef69e469-env-overrides\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.255370 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-device-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.255437 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-device-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.255495 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-conf-dir\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.255682 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72947292-2b7f-49f2-ba4c-91b67b294dd7-tmp\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.255919 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1363edd-7664-461f-97f1-7343ef69e469-ovn-node-metrics-cert\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256019 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c1363edd-7664-461f-97f1-7343ef69e469-ovnkube-script-lib\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256142 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/24e0b295-848d-456f-8447-6cb5878a49fb-agent-certs\") pod \"konnectivity-agent-qxccn\" (UID: \"24e0b295-848d-456f-8447-6cb5878a49fb\") " pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256156 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-socket-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256220 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04f1a986-af91-4f11-8331-24d0a44eed34-hosts-file\") pod \"node-resolver-p4b5p\" (UID: \"04f1a986-af91-4f11-8331-24d0a44eed34\") " pod="openshift-dns/node-resolver-p4b5p" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256268 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256327 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c1363edd-7664-461f-97f1-7343ef69e469-run-ovn\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256364 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-sys-fs\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256400 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-daemon-config\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256430 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44641150-4d93-42b3-bf38-725c47722bab-iptables-alerter-script\") pod \"iptables-alerter-ht4w5\" (UID: \"44641150-4d93-42b3-bf38-725c47722bab\") " pod="openshift-network-operator/iptables-alerter-ht4w5" Jun 03 15:40:43.258197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256468 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8b7r\" (UniqueName: \"kubernetes.io/projected/44641150-4d93-42b3-bf38-725c47722bab-kube-api-access-h8b7r\") pod \"iptables-alerter-ht4w5\" (UID: \"44641150-4d93-42b3-bf38-725c47722bab\") " pod="openshift-network-operator/iptables-alerter-ht4w5" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256477 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-etc-selinux\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256504 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6867\" (UniqueName: \"kubernetes.io/projected/b6888c28-3ce4-430b-95d7-928a55f82992-kube-api-access-m6867\") pod \"node-ca-qr4lb\" (UID: \"b6888c28-3ce4-430b-95d7-928a55f82992\") " pod="openshift-image-registry/node-ca-qr4lb" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256541 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-os-release\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256547 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f1a986-af91-4f11-8331-24d0a44eed34-tmp-dir\") pod \"node-resolver-p4b5p\" (UID: \"04f1a986-af91-4f11-8331-24d0a44eed34\") " pod="openshift-dns/node-resolver-p4b5p" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256554 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-kubernetes\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256570 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-hostroot\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256595 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-registration-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256624 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-run\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256641 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-modprobe-d\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256745 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-os-release\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256898 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/65aae031-fa35-47fd-bdb3-ede2d2255c04-hostroot\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.256963 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-registration-dir\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.257017 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-run\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.257042 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/65aae031-fa35-47fd-bdb3-ede2d2255c04-multus-daemon-config\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.257083 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6284ebc4-f9c4-427d-9788-45e117df6a55-sys-fs\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.257140 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-host\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.257173 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72947292-2b7f-49f2-ba4c-91b67b294dd7-lib-modules\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.259028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.257538 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44641150-4d93-42b3-bf38-725c47722bab-iptables-alerter-script\") pod \"iptables-alerter-ht4w5\" (UID: \"44641150-4d93-42b3-bf38-725c47722bab\") " pod="openshift-network-operator/iptables-alerter-ht4w5" Jun 03 15:40:43.260034 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.259640 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:40:43.260034 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.259659 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:40:43.260034 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.259673 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n79j8 for pod openshift-network-diagnostics/network-check-target-9cxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:43.260034 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.259774 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8 podName:e58e24e8-e014-4d36-bd6f-5b10482fde22 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:43.75974792 +0000 UTC m=+2.997495451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n79j8" (UniqueName: "kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8") pod "network-check-target-9cxct" (UID: "e58e24e8-e014-4d36-bd6f-5b10482fde22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:43.262737 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.262647 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq6ns\" (UniqueName: \"kubernetes.io/projected/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-kube-api-access-qq6ns\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:43.262829 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.262709 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c774\" (UniqueName: \"kubernetes.io/projected/72947292-2b7f-49f2-ba4c-91b67b294dd7-kube-api-access-2c774\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.262948 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.262926 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqllg\" (UniqueName: \"kubernetes.io/projected/c1363edd-7664-461f-97f1-7343ef69e469-kube-api-access-sqllg\") pod \"ovnkube-node-4gqgl\" (UID: \"c1363edd-7664-461f-97f1-7343ef69e469\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.263225 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.263200 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55dwv\" (UniqueName: \"kubernetes.io/projected/65aae031-fa35-47fd-bdb3-ede2d2255c04-kube-api-access-55dwv\") pod \"multus-5qq54\" (UID: \"65aae031-fa35-47fd-bdb3-ede2d2255c04\") " pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.263694 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.263672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72947292-2b7f-49f2-ba4c-91b67b294dd7-etc-tuned\") pod \"tuned-9cht2\" (UID: \"72947292-2b7f-49f2-ba4c-91b67b294dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.265123 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.265099 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mkfq\" (UniqueName: \"kubernetes.io/projected/6284ebc4-f9c4-427d-9788-45e117df6a55-kube-api-access-2mkfq\") pod \"aws-ebs-csi-driver-node-dkwlw\" (UID: \"6284ebc4-f9c4-427d-9788-45e117df6a55\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.266167 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.266145 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6spnz\" (UniqueName: \"kubernetes.io/projected/04f1a986-af91-4f11-8331-24d0a44eed34-kube-api-access-6spnz\") pod \"node-resolver-p4b5p\" (UID: \"04f1a986-af91-4f11-8331-24d0a44eed34\") " pod="openshift-dns/node-resolver-p4b5p" Jun 03 15:40:43.266605 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.266425 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8b7r\" (UniqueName: \"kubernetes.io/projected/44641150-4d93-42b3-bf38-725c47722bab-kube-api-access-h8b7r\") pod \"iptables-alerter-ht4w5\" (UID: \"44641150-4d93-42b3-bf38-725c47722bab\") " pod="openshift-network-operator/iptables-alerter-ht4w5" Jun 03 15:40:43.266605 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.266461 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k724\" (UniqueName: \"kubernetes.io/projected/f83cc80e-2a78-4924-89f0-73513fdeebe7-kube-api-access-4k724\") pod \"multus-additional-cni-plugins-s72xm\" (UID: \"f83cc80e-2a78-4924-89f0-73513fdeebe7\") " pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.266605 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.266516 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6867\" (UniqueName: \"kubernetes.io/projected/b6888c28-3ce4-430b-95d7-928a55f82992-kube-api-access-m6867\") pod \"node-ca-qr4lb\" (UID: \"b6888c28-3ce4-430b-95d7-928a55f82992\") " pod="openshift-image-registry/node-ca-qr4lb" Jun 03 15:40:43.435281 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.435203 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9cht2" Jun 03 15:40:43.443142 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.443116 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qr4lb" Jun 03 15:40:43.454741 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.454706 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ht4w5" Jun 03 15:40:43.460432 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.460413 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:40:43.468496 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.468024 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" Jun 03 15:40:43.475016 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.474994 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4b5p" Jun 03 15:40:43.483613 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.483589 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5qq54" Jun 03 15:40:43.491198 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.491175 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s72xm" Jun 03 15:40:43.497897 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.497873 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:40:43.623764 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.623736 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:40:43.758839 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.758761 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:43.758989 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.758884 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:43.758989 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.758943 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs podName:1c22f0a9-6788-4c37-89a6-5ab6de86ef60 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:44.758928469 +0000 UTC m=+3.996675988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs") pod "network-metrics-daemon-llzgd" (UID: "1c22f0a9-6788-4c37-89a6-5ab6de86ef60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:43.859896 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:43.859851 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n79j8\" (UniqueName: \"kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8\") pod \"network-check-target-9cxct\" (UID: \"e58e24e8-e014-4d36-bd6f-5b10482fde22\") " pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:43.860072 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.860005 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:40:43.860072 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.860021 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:40:43.860072 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.860030 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n79j8 for pod openshift-network-diagnostics/network-check-target-9cxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:43.860232 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:43.860088 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8 podName:e58e24e8-e014-4d36-bd6f-5b10482fde22 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:44.860070804 +0000 UTC m=+4.097818338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n79j8" (UniqueName: "kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8") pod "network-check-target-9cxct" (UID: "e58e24e8-e014-4d36-bd6f-5b10482fde22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:43.985502 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:43.985468 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e0b295_848d_456f_8447_6cb5878a49fb.slice/crio-ea27d36bf3fa9af746f4378737044d1958e187faac647898fd4e4877b371970e WatchSource:0}: Error finding container ea27d36bf3fa9af746f4378737044d1958e187faac647898fd4e4877b371970e: Status 404 returned error can't find the container with id ea27d36bf3fa9af746f4378737044d1958e187faac647898fd4e4877b371970e Jun 03 15:40:44.009406 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:44.009306 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6284ebc4_f9c4_427d_9788_45e117df6a55.slice/crio-595242f25a80d97dfa9bb2a7136941687ebfb570f04e55f5aa216b2f18e7be94 WatchSource:0}: Error finding container 595242f25a80d97dfa9bb2a7136941687ebfb570f04e55f5aa216b2f18e7be94: Status 404 returned error can't find the container with id 595242f25a80d97dfa9bb2a7136941687ebfb570f04e55f5aa216b2f18e7be94 Jun 03 15:40:44.010122 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:44.010093 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6888c28_3ce4_430b_95d7_928a55f82992.slice/crio-b04cef7b9122cf619d548629ef9bfb907d0095dba81accb41d99c0c367b2df3c WatchSource:0}: Error finding container b04cef7b9122cf619d548629ef9bfb907d0095dba81accb41d99c0c367b2df3c: Status 404 returned error can't find the container with id b04cef7b9122cf619d548629ef9bfb907d0095dba81accb41d99c0c367b2df3c Jun 03 15:40:44.011021 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:44.011001 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1363edd_7664_461f_97f1_7343ef69e469.slice/crio-d8c1716ec63f73bfd67c8416ee815aa91b33f289fbaee09d76bd1c4572e02e5a WatchSource:0}: Error finding container d8c1716ec63f73bfd67c8416ee815aa91b33f289fbaee09d76bd1c4572e02e5a: Status 404 returned error can't find the container with id d8c1716ec63f73bfd67c8416ee815aa91b33f289fbaee09d76bd1c4572e02e5a Jun 03 15:40:44.011805 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:44.011678 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f1a986_af91_4f11_8331_24d0a44eed34.slice/crio-3381e5978adb02e9d4692c595427de3631c6789ef26b83ef2647a9c45409c68f WatchSource:0}: Error finding container 3381e5978adb02e9d4692c595427de3631c6789ef26b83ef2647a9c45409c68f: Status 404 returned error can't find the container with id 3381e5978adb02e9d4692c595427de3631c6789ef26b83ef2647a9c45409c68f Jun 03 15:40:44.015011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:44.013915 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44641150_4d93_42b3_bf38_725c47722bab.slice/crio-1dd91299bf5fb649046e37d38c0dd7a4dc5e12aa103f19d4ed618aa927648257 WatchSource:0}: Error finding container 1dd91299bf5fb649046e37d38c0dd7a4dc5e12aa103f19d4ed618aa927648257: Status 404 returned error can't find the container with id 1dd91299bf5fb649046e37d38c0dd7a4dc5e12aa103f19d4ed618aa927648257 Jun 03 15:40:44.015011 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:44.014334 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83cc80e_2a78_4924_89f0_73513fdeebe7.slice/crio-27df38b6088ca9b6f36da048e81d71f2e8165ac3492b0157cca60b33b7befc5f WatchSource:0}: Error finding container 27df38b6088ca9b6f36da048e81d71f2e8165ac3492b0157cca60b33b7befc5f: Status 404 returned error can't find the container with id 27df38b6088ca9b6f36da048e81d71f2e8165ac3492b0157cca60b33b7befc5f Jun 03 15:40:44.015693 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:40:44.015616 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65aae031_fa35_47fd_bdb3_ede2d2255c04.slice/crio-dcf4317d960b2e783545fb3df7b9976f01ff3bf9ffd3727a5671566f272fb2d1 WatchSource:0}: Error finding container dcf4317d960b2e783545fb3df7b9976f01ff3bf9ffd3727a5671566f272fb2d1: Status 404 returned error can't find the container with id dcf4317d960b2e783545fb3df7b9976f01ff3bf9ffd3727a5671566f272fb2d1 Jun 03 15:40:44.188574 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.188398 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:35:42 +0000 UTC" deadline="2028-01-08 14:55:18.123915208 +0000 UTC" Jun 03 15:40:44.188574 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.188569 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14015h14m33.935348621s" Jun 03 15:40:44.241870 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.241845 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:44.241985 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:44.241952 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:40:44.248250 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.248220 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ht4w5" event={"ID":"44641150-4d93-42b3-bf38-725c47722bab","Type":"ContainerStarted","Data":"1dd91299bf5fb649046e37d38c0dd7a4dc5e12aa103f19d4ed618aa927648257"} Jun 03 15:40:44.249071 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.249052 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4b5p" event={"ID":"04f1a986-af91-4f11-8331-24d0a44eed34","Type":"ContainerStarted","Data":"3381e5978adb02e9d4692c595427de3631c6789ef26b83ef2647a9c45409c68f"} Jun 03 15:40:44.250033 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.250015 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" event={"ID":"c1363edd-7664-461f-97f1-7343ef69e469","Type":"ContainerStarted","Data":"d8c1716ec63f73bfd67c8416ee815aa91b33f289fbaee09d76bd1c4572e02e5a"} Jun 03 15:40:44.250840 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.250824 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qxccn" event={"ID":"24e0b295-848d-456f-8447-6cb5878a49fb","Type":"ContainerStarted","Data":"ea27d36bf3fa9af746f4378737044d1958e187faac647898fd4e4877b371970e"} Jun 03 15:40:44.251603 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.251587 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9cht2" event={"ID":"72947292-2b7f-49f2-ba4c-91b67b294dd7","Type":"ContainerStarted","Data":"febf266849376b478571b2eb6ac7eb4078d520b1872d4b3dfb7755eab7d6c140"} Jun 03 15:40:44.252408 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.252393 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5qq54" event={"ID":"65aae031-fa35-47fd-bdb3-ede2d2255c04","Type":"ContainerStarted","Data":"dcf4317d960b2e783545fb3df7b9976f01ff3bf9ffd3727a5671566f272fb2d1"} Jun 03 15:40:44.253177 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.253161 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qr4lb" event={"ID":"b6888c28-3ce4-430b-95d7-928a55f82992","Type":"ContainerStarted","Data":"b04cef7b9122cf619d548629ef9bfb907d0095dba81accb41d99c0c367b2df3c"} Jun 03 15:40:44.253914 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.253899 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" event={"ID":"6284ebc4-f9c4-427d-9788-45e117df6a55","Type":"ContainerStarted","Data":"595242f25a80d97dfa9bb2a7136941687ebfb570f04e55f5aa216b2f18e7be94"} Jun 03 15:40:44.255183 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.255166 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-233.ec2.internal" event={"ID":"c8fd5fecc6875c8582ac03c1e0e534ca","Type":"ContainerStarted","Data":"4a50730bd7a10d359d7593ca3fb25d208c1b04e0509241196f1a0659af2e72b3"} Jun 03 15:40:44.256308 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.256109 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s72xm" event={"ID":"f83cc80e-2a78-4924-89f0-73513fdeebe7","Type":"ContainerStarted","Data":"27df38b6088ca9b6f36da048e81d71f2e8165ac3492b0157cca60b33b7befc5f"} Jun 03 15:40:44.270052 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.269963 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-233.ec2.internal" podStartSLOduration=2.269951736 podStartE2EDuration="2.269951736s" podCreationTimestamp="2026-06-03 15:40:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:40:44.269604071 +0000 UTC m=+3.507351612" watchObservedRunningTime="2026-06-03 15:40:44.269951736 +0000 UTC m=+3.507699275" Jun 03 15:40:44.766955 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.766299 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:44.766955 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:44.766455 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:44.766955 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:44.766524 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs podName:1c22f0a9-6788-4c37-89a6-5ab6de86ef60 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:46.766502652 +0000 UTC m=+6.004250175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs") pod "network-metrics-daemon-llzgd" (UID: "1c22f0a9-6788-4c37-89a6-5ab6de86ef60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:44.867260 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:44.867219 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n79j8\" (UniqueName: \"kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8\") pod \"network-check-target-9cxct\" (UID: \"e58e24e8-e014-4d36-bd6f-5b10482fde22\") " pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:44.867445 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:44.867363 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:40:44.867445 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:44.867388 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:40:44.867445 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:44.867401 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n79j8 for pod openshift-network-diagnostics/network-check-target-9cxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:44.867598 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:44.867468 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8 podName:e58e24e8-e014-4d36-bd6f-5b10482fde22 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:46.867449001 +0000 UTC m=+6.105196527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n79j8" (UniqueName: "kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8") pod "network-check-target-9cxct" (UID: "e58e24e8-e014-4d36-bd6f-5b10482fde22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:45.243891 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:45.243822 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:45.244327 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:45.243972 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:40:45.278759 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:45.278699 2566 generic.go:358] "Generic (PLEG): container finished" podID="98d44e77ea7f249f79b0474b960a99c3" containerID="abbc50c134027b61b10e6ff02105390e5611e98b4812b1ea0e124d17fe3d68d6" exitCode=0 Jun 03 15:40:45.279348 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:45.279318 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" event={"ID":"98d44e77ea7f249f79b0474b960a99c3","Type":"ContainerDied","Data":"abbc50c134027b61b10e6ff02105390e5611e98b4812b1ea0e124d17fe3d68d6"} Jun 03 15:40:46.242235 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:46.242202 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:46.242404 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:46.242328 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:40:46.297434 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:46.297396 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" event={"ID":"98d44e77ea7f249f79b0474b960a99c3","Type":"ContainerStarted","Data":"629b4820a86a0b46d8cfc33701d74dbfd118bfde77d3d70b6fcfdd6b13b971a9"} Jun 03 15:40:46.311955 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:46.311904 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-233.ec2.internal" podStartSLOduration=4.311885484 podStartE2EDuration="4.311885484s" podCreationTimestamp="2026-06-03 15:40:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:40:46.311525605 +0000 UTC m=+5.549273146" watchObservedRunningTime="2026-06-03 15:40:46.311885484 +0000 UTC m=+5.549633024" Jun 03 15:40:46.785068 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:46.785024 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:46.785249 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:46.785189 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:46.785310 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:46.785271 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs podName:1c22f0a9-6788-4c37-89a6-5ab6de86ef60 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:50.785245699 +0000 UTC m=+10.022993224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs") pod "network-metrics-daemon-llzgd" (UID: "1c22f0a9-6788-4c37-89a6-5ab6de86ef60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:46.886420 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:46.885781 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n79j8\" (UniqueName: \"kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8\") pod \"network-check-target-9cxct\" (UID: \"e58e24e8-e014-4d36-bd6f-5b10482fde22\") " pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:46.886420 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:46.886002 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:40:46.886420 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:46.886020 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:40:46.886420 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:46.886032 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n79j8 for pod openshift-network-diagnostics/network-check-target-9cxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:46.886420 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:46.886079 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8 podName:e58e24e8-e014-4d36-bd6f-5b10482fde22 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:50.886064332 +0000 UTC m=+10.123811849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n79j8" (UniqueName: "kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8") pod "network-check-target-9cxct" (UID: "e58e24e8-e014-4d36-bd6f-5b10482fde22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:47.242357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:47.242084 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:47.242357 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:47.242231 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:40:48.242181 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:48.242144 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:48.242649 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:48.242278 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:40:48.723048 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:48.722967 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lrjqd"] Jun 03 15:40:48.725821 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:48.725797 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:48.725937 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:48.725880 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:40:48.799605 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:48.799575 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60e89a0d-ca13-4ed3-834f-440d973a813f-dbus\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:48.799833 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:48.799614 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:48.799833 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:48.799679 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60e89a0d-ca13-4ed3-834f-440d973a813f-kubelet-config\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:48.900640 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:48.900605 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60e89a0d-ca13-4ed3-834f-440d973a813f-kubelet-config\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:48.900836 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:48.900658 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60e89a0d-ca13-4ed3-834f-440d973a813f-dbus\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:48.900836 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:48.900693 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:48.900937 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:48.900836 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:48.900937 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:48.900896 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret podName:60e89a0d-ca13-4ed3-834f-440d973a813f nodeName:}" failed. No retries permitted until 2026-06-03 15:40:49.400877617 +0000 UTC m=+8.638625149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret") pod "global-pull-secret-syncer-lrjqd" (UID: "60e89a0d-ca13-4ed3-834f-440d973a813f") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:48.901162 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:48.901142 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60e89a0d-ca13-4ed3-834f-440d973a813f-kubelet-config\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:48.901301 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:48.901285 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60e89a0d-ca13-4ed3-834f-440d973a813f-dbus\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:49.241595 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:49.241564 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:49.241807 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:49.241704 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:40:49.404600 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:49.404518 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:49.405092 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:49.404659 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:49.405092 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:49.404756 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret podName:60e89a0d-ca13-4ed3-834f-440d973a813f nodeName:}" failed. No retries permitted until 2026-06-03 15:40:50.404732939 +0000 UTC m=+9.642480472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret") pod "global-pull-secret-syncer-lrjqd" (UID: "60e89a0d-ca13-4ed3-834f-440d973a813f") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:50.241231 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:50.241194 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:50.241231 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:50.241218 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:50.241496 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:50.241311 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:40:50.241496 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:50.241431 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:40:50.412118 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:50.412089 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:50.412588 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:50.412203 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:50.412588 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:50.412272 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret podName:60e89a0d-ca13-4ed3-834f-440d973a813f nodeName:}" failed. No retries permitted until 2026-06-03 15:40:52.412251929 +0000 UTC m=+11.649999452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret") pod "global-pull-secret-syncer-lrjqd" (UID: "60e89a0d-ca13-4ed3-834f-440d973a813f") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:50.814969 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:50.814923 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:50.815156 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:50.815037 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:50.815156 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:50.815124 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs podName:1c22f0a9-6788-4c37-89a6-5ab6de86ef60 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:58.815092046 +0000 UTC m=+18.052839565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs") pod "network-metrics-daemon-llzgd" (UID: "1c22f0a9-6788-4c37-89a6-5ab6de86ef60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:50.916253 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:50.916217 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n79j8\" (UniqueName: \"kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8\") pod \"network-check-target-9cxct\" (UID: \"e58e24e8-e014-4d36-bd6f-5b10482fde22\") " pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:50.916423 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:50.916351 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:40:50.916423 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:50.916367 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:40:50.916423 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:50.916379 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n79j8 for pod openshift-network-diagnostics/network-check-target-9cxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:50.916594 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:50.916428 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8 podName:e58e24e8-e014-4d36-bd6f-5b10482fde22 nodeName:}" failed. No retries permitted until 2026-06-03 15:40:58.916414097 +0000 UTC m=+18.154161618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n79j8" (UniqueName: "kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8") pod "network-check-target-9cxct" (UID: "e58e24e8-e014-4d36-bd6f-5b10482fde22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:51.242149 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:51.242080 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:51.242295 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:51.242170 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:40:52.241742 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:52.241318 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:52.241742 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:52.241329 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:52.241742 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:52.241421 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:40:52.241742 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:52.241526 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:40:52.426215 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:52.426173 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:52.426383 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:52.426317 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:52.426435 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:52.426383 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret podName:60e89a0d-ca13-4ed3-834f-440d973a813f nodeName:}" failed. No retries permitted until 2026-06-03 15:40:56.426365134 +0000 UTC m=+15.664112654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret") pod "global-pull-secret-syncer-lrjqd" (UID: "60e89a0d-ca13-4ed3-834f-440d973a813f") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:53.242286 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:53.242252 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:53.242711 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:53.242383 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:40:54.241463 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.241244 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:54.241909 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:54.241595 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:40:54.241909 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.241385 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:54.241909 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:54.241686 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:40:54.312783 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.312749 2566 generic.go:358] "Generic (PLEG): container finished" podID="f83cc80e-2a78-4924-89f0-73513fdeebe7" containerID="dedd37421bb2650c6ebc48764e6a8bf43a7150afba21c6c0acf0b1acb51af0a2" exitCode=0 Jun 03 15:40:54.313289 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.312834 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s72xm" event={"ID":"f83cc80e-2a78-4924-89f0-73513fdeebe7","Type":"ContainerDied","Data":"dedd37421bb2650c6ebc48764e6a8bf43a7150afba21c6c0acf0b1acb51af0a2"} Jun 03 15:40:54.314211 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.314130 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4b5p" event={"ID":"04f1a986-af91-4f11-8331-24d0a44eed34","Type":"ContainerStarted","Data":"4c3a0455cb31c57543d3883364335ff0b9031bb95db1a0e329c0431b8fad499f"} Jun 03 15:40:54.316624 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.316591 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qxccn" event={"ID":"24e0b295-848d-456f-8447-6cb5878a49fb","Type":"ContainerStarted","Data":"bb10e953cdd44641ec54fc8a6165139bc1cf95bb93fd2640d11016f6f45a5f05"} Jun 03 15:40:54.317930 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.317911 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9cht2" event={"ID":"72947292-2b7f-49f2-ba4c-91b67b294dd7","Type":"ContainerStarted","Data":"e21fda91de238b34407adb6e84d92c7d06a5801f41664d3fbef12cd54fd1c853"} Jun 03 15:40:54.319606 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.319585 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qr4lb" event={"ID":"b6888c28-3ce4-430b-95d7-928a55f82992","Type":"ContainerStarted","Data":"4b8857f50336c34b13ca1bb2ba4a8f33de45a039a1f42f67b70c13ee0d1644c4"} Jun 03 15:40:54.320869 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.320851 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" event={"ID":"6284ebc4-f9c4-427d-9788-45e117df6a55","Type":"ContainerStarted","Data":"8564e58c3f44408dc6fe72c1bb3f03ab7e6bbd5d38eee83f1e9f9eca21a7a080"} Jun 03 15:40:54.350330 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.350285 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qxccn" podStartSLOduration=3.375287521 podStartE2EDuration="13.350269718s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="2026-06-03 15:40:44.002054387 +0000 UTC m=+3.239801917" lastFinishedPulling="2026-06-03 15:40:53.977036597 +0000 UTC m=+13.214784114" observedRunningTime="2026-06-03 15:40:54.349636012 +0000 UTC m=+13.587383551" watchObservedRunningTime="2026-06-03 15:40:54.350269718 +0000 UTC m=+13.588017256" Jun 03 15:40:54.365071 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.365037 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9cht2" podStartSLOduration=3.3923513339999998 podStartE2EDuration="13.365027239s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="2026-06-03 15:40:44.018403871 +0000 UTC m=+3.256151402" lastFinishedPulling="2026-06-03 15:40:53.991079778 +0000 UTC m=+13.228827307" observedRunningTime="2026-06-03 15:40:54.364871639 +0000 UTC m=+13.602619179" watchObservedRunningTime="2026-06-03 15:40:54.365027239 +0000 UTC m=+13.602774778" Jun 03 15:40:54.377790 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:54.377749 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qr4lb" podStartSLOduration=3.4163743269999998 podStartE2EDuration="13.37773826s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="2026-06-03 15:40:44.012074297 +0000 UTC m=+3.249821828" lastFinishedPulling="2026-06-03 15:40:53.973438244 +0000 UTC m=+13.211185761" observedRunningTime="2026-06-03 15:40:54.377531224 +0000 UTC m=+13.615278764" watchObservedRunningTime="2026-06-03 15:40:54.37773826 +0000 UTC m=+13.615485799" Jun 03 15:40:55.242337 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:55.242298 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:55.242497 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:55.242442 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:40:55.325687 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:55.325653 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ht4w5" event={"ID":"44641150-4d93-42b3-bf38-725c47722bab","Type":"ContainerStarted","Data":"70479ea363dbd7028adcc05c8b97870aef355a70827d8a157b2e20867f17a703"} Jun 03 15:40:55.342022 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:55.341477 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-p4b5p" podStartSLOduration=4.378374443 podStartE2EDuration="14.341458982s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="2026-06-03 15:40:44.013953114 +0000 UTC m=+3.251700634" lastFinishedPulling="2026-06-03 15:40:53.977037642 +0000 UTC m=+13.214785173" observedRunningTime="2026-06-03 15:40:54.390196492 +0000 UTC m=+13.627944032" watchObservedRunningTime="2026-06-03 15:40:55.341458982 +0000 UTC m=+14.579206528" Jun 03 15:40:56.241537 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:56.241492 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:56.241709 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:56.241626 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:56.241789 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:56.241750 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:40:56.241789 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:56.241626 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:40:56.458274 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:56.458236 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:56.458874 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:56.458380 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:56.458874 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:56.458437 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret podName:60e89a0d-ca13-4ed3-834f-440d973a813f nodeName:}" failed. No retries permitted until 2026-06-03 15:41:04.458422981 +0000 UTC m=+23.696170502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret") pod "global-pull-secret-syncer-lrjqd" (UID: "60e89a0d-ca13-4ed3-834f-440d973a813f") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:40:57.042136 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:57.042100 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:40:57.043001 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:57.042973 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:40:57.057587 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:57.057529 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ht4w5" podStartSLOduration=6.090261613 podStartE2EDuration="16.057515644s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="2026-06-03 15:40:44.015436199 +0000 UTC m=+3.253183729" lastFinishedPulling="2026-06-03 15:40:53.982690229 +0000 UTC m=+13.220437760" observedRunningTime="2026-06-03 15:40:55.34233569 +0000 UTC m=+14.580083230" watchObservedRunningTime="2026-06-03 15:40:57.057515644 +0000 UTC m=+16.295263186" Jun 03 15:40:57.242014 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:57.241979 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:57.242184 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:57.242114 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:40:58.241376 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:58.241343 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:40:58.241376 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:58.241361 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:58.242023 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:58.241442 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:40:58.242023 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:58.241563 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:40:58.877899 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:58.877869 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:58.878050 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:58.878028 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:58.878111 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:58.878101 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs podName:1c22f0a9-6788-4c37-89a6-5ab6de86ef60 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:14.878085513 +0000 UTC m=+34.115833035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs") pod "network-metrics-daemon-llzgd" (UID: "1c22f0a9-6788-4c37-89a6-5ab6de86ef60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:40:58.978285 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:58.978171 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n79j8\" (UniqueName: \"kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8\") pod \"network-check-target-9cxct\" (UID: \"e58e24e8-e014-4d36-bd6f-5b10482fde22\") " pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:40:58.978476 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:58.978361 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:40:58.978476 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:58.978381 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:40:58.978476 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:58.978390 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n79j8 for pod openshift-network-diagnostics/network-check-target-9cxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:58.978476 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:58.978449 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8 podName:e58e24e8-e014-4d36-bd6f-5b10482fde22 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:14.978431529 +0000 UTC m=+34.216179079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n79j8" (UniqueName: "kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8") pod "network-check-target-9cxct" (UID: "e58e24e8-e014-4d36-bd6f-5b10482fde22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:40:59.241607 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:40:59.241535 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:40:59.242032 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:40:59.241672 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:41:00.242305 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:00.242075 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:00.242868 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:00.242105 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:00.242868 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:00.242411 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:41:00.242868 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:00.242474 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:41:01.242256 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:01.242224 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:01.242434 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:01.242365 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:41:02.242276 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:02.242237 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:02.242458 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:02.242278 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:02.242458 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:02.242379 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:41:02.242861 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:02.242499 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:41:03.241486 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:03.241454 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:03.241702 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:03.241559 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:41:04.241248 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:04.241214 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:04.241814 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:04.241214 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:04.241814 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:04.241341 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:41:04.241814 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:04.241441 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:41:04.515030 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:04.514952 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:04.515189 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:04.515103 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:41:04.515189 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:04.515172 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret podName:60e89a0d-ca13-4ed3-834f-440d973a813f nodeName:}" failed. No retries permitted until 2026-06-03 15:41:20.515152126 +0000 UTC m=+39.752899644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret") pod "global-pull-secret-syncer-lrjqd" (UID: "60e89a0d-ca13-4ed3-834f-440d973a813f") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:41:05.241438 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:05.241410 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:05.241784 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:05.241510 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:41:05.486626 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:05.486523 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 15:41:06.230899 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.230607 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T15:41:05.486538741Z","UUID":"b5632703-417c-46cd-8745-50d889816f39","Handler":null,"Name":"","Endpoint":""} Jun 03 15:41:06.233141 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.233065 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 15:41:06.233141 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.233097 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 15:41:06.241191 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.241164 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:06.241337 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.241218 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:06.241337 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:06.241309 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:41:06.241455 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:06.241410 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:41:06.347143 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.347109 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" event={"ID":"c1363edd-7664-461f-97f1-7343ef69e469","Type":"ContainerStarted","Data":"d3215fde3d0b8929b7be4d8d1df3515a314b588fc987ca05b3a25596e5a439ee"} Jun 03 15:41:06.347246 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.347154 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" event={"ID":"c1363edd-7664-461f-97f1-7343ef69e469","Type":"ContainerStarted","Data":"bdc1271592a994fa43185e387e3933a250aeaf4eea42fbeb524a12dea9fb4ab2"} Jun 03 15:41:06.347246 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.347166 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" event={"ID":"c1363edd-7664-461f-97f1-7343ef69e469","Type":"ContainerStarted","Data":"edb2a088a03a56580d3e0e50a2c004dc415f32b40059a4495feb63669c689bb7"} Jun 03 15:41:06.347246 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.347176 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" event={"ID":"c1363edd-7664-461f-97f1-7343ef69e469","Type":"ContainerStarted","Data":"1ee1a31e3864dcb6e2ec9dd061ea00bdd7a3618580d5b4d0f9fb5cb4475b3366"} Jun 03 15:41:06.347246 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.347187 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" event={"ID":"c1363edd-7664-461f-97f1-7343ef69e469","Type":"ContainerStarted","Data":"f2776d381da363eaed8c3cc52891516e254a9593cdebb536e9f9fa442fc03148"} Jun 03 15:41:06.347246 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.347197 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" event={"ID":"c1363edd-7664-461f-97f1-7343ef69e469","Type":"ContainerStarted","Data":"fde9de549ae774f48f2f29d7645854e5970723ad0be3262b86a99752bdbe52b8"} Jun 03 15:41:06.348397 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.348367 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5qq54" event={"ID":"65aae031-fa35-47fd-bdb3-ede2d2255c04","Type":"ContainerStarted","Data":"1639f9e1866021d836bc9d9400d58a03f4eb6d8f0ac9dadb16e78d144a239292"} Jun 03 15:41:06.349955 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.349933 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" event={"ID":"6284ebc4-f9c4-427d-9788-45e117df6a55","Type":"ContainerStarted","Data":"4e7f750be134bc0a3705cea465b36b0602eb08b913beaae4f45bb8ae16e4219d"} Jun 03 15:41:06.351424 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.351399 2566 generic.go:358] "Generic (PLEG): container finished" podID="f83cc80e-2a78-4924-89f0-73513fdeebe7" containerID="8f0c4ecbb2f80621d273f13df0adaaf9fc7595486fe346b452f20f78491000e9" exitCode=0 Jun 03 15:41:06.351522 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.351441 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s72xm" event={"ID":"f83cc80e-2a78-4924-89f0-73513fdeebe7","Type":"ContainerDied","Data":"8f0c4ecbb2f80621d273f13df0adaaf9fc7595486fe346b452f20f78491000e9"} Jun 03 15:41:06.377200 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:06.377162 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-5qq54" podStartSLOduration=4.103256592 podStartE2EDuration="25.377150314s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="2026-06-03 15:40:44.018329558 +0000 UTC m=+3.256077074" lastFinishedPulling="2026-06-03 15:41:05.292223261 +0000 UTC m=+24.529970796" observedRunningTime="2026-06-03 15:41:06.376888772 +0000 UTC m=+25.614636311" watchObservedRunningTime="2026-06-03 15:41:06.377150314 +0000 UTC m=+25.614897853" Jun 03 15:41:07.241921 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:07.241894 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:07.242383 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:07.241998 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:41:07.354590 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:07.354554 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" event={"ID":"6284ebc4-f9c4-427d-9788-45e117df6a55","Type":"ContainerStarted","Data":"a37e0a49b15f255e6bf5441d6d2e1811fd43d75feefe61f20903d92dd4c5c7d6"} Jun 03 15:41:07.356297 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:07.356274 2566 generic.go:358] "Generic (PLEG): container finished" podID="f83cc80e-2a78-4924-89f0-73513fdeebe7" containerID="267db56a563bdbc9b33ceb3a5a3db4429f17312a6680eed35ec01e72f4d696a8" exitCode=0 Jun 03 15:41:07.356412 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:07.356355 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s72xm" event={"ID":"f83cc80e-2a78-4924-89f0-73513fdeebe7","Type":"ContainerDied","Data":"267db56a563bdbc9b33ceb3a5a3db4429f17312a6680eed35ec01e72f4d696a8"} Jun 03 15:41:07.375274 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:07.375239 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dkwlw" podStartSLOduration=4.085090199 podStartE2EDuration="26.375229166s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="2026-06-03 15:40:44.011156385 +0000 UTC m=+3.248903915" lastFinishedPulling="2026-06-03 15:41:06.301295354 +0000 UTC m=+25.539042882" observedRunningTime="2026-06-03 15:41:07.374772892 +0000 UTC m=+26.612520432" watchObservedRunningTime="2026-06-03 15:41:07.375229166 +0000 UTC m=+26.612976704" Jun 03 15:41:08.241200 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:08.241171 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:08.241320 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:08.241295 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:41:08.241365 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:08.241336 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:08.241429 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:08.241413 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:41:08.360285 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:08.360260 2566 generic.go:358] "Generic (PLEG): container finished" podID="f83cc80e-2a78-4924-89f0-73513fdeebe7" containerID="c951edf1698e6352d8678c6ce09806ffb5b7e97606176c772a996decfe20f52f" exitCode=0 Jun 03 15:41:08.360630 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:08.360334 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s72xm" event={"ID":"f83cc80e-2a78-4924-89f0-73513fdeebe7","Type":"ContainerDied","Data":"c951edf1698e6352d8678c6ce09806ffb5b7e97606176c772a996decfe20f52f"} Jun 03 15:41:08.363491 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:08.363466 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" event={"ID":"c1363edd-7664-461f-97f1-7343ef69e469","Type":"ContainerStarted","Data":"827b86017d542f2e3ab536fe08eccfe1356fe9a350a2ce9290743686e3cbf7b3"} Jun 03 15:41:09.242255 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:09.242228 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:09.242446 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:09.242358 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:41:10.242011 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:10.241835 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:10.242557 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:10.241835 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:10.242557 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:10.242081 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:41:10.242557 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:10.242153 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:41:10.370537 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:10.370502 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" event={"ID":"c1363edd-7664-461f-97f1-7343ef69e469","Type":"ContainerStarted","Data":"4ed2398d2c83f956ff1f93ce08541681a877ddfcba1842e2e233ee1f18e14d0f"} Jun 03 15:41:10.370843 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:10.370822 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:41:10.370942 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:10.370851 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:41:10.370942 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:10.370860 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:41:10.388383 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:10.388355 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:41:10.389547 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:10.389519 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:41:10.404444 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:10.404394 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" podStartSLOduration=8.101869911 podStartE2EDuration="29.404378339s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="2026-06-03 15:40:44.013090486 +0000 UTC m=+3.250838017" lastFinishedPulling="2026-06-03 15:41:05.315598918 +0000 UTC m=+24.553346445" observedRunningTime="2026-06-03 15:41:10.403877001 +0000 UTC m=+29.641624541" watchObservedRunningTime="2026-06-03 15:41:10.404378339 +0000 UTC m=+29.642125880" Jun 03 15:41:11.207813 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:11.200356 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:41:11.207813 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:11.200516 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 15:41:11.207813 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:11.201690 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qxccn" Jun 03 15:41:11.243928 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:11.243889 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:11.244373 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:11.244022 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:41:12.174099 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:12.174027 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrjqd"] Jun 03 15:41:12.174809 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:12.174786 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:12.174902 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:12.174806 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-llzgd"] Jun 03 15:41:12.174902 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:12.174892 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:12.175002 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:12.174902 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:41:12.175002 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:12.174969 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:41:12.176431 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:12.176409 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9cxct"] Jun 03 15:41:12.176549 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:12.176529 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:12.176638 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:12.176620 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:41:13.241996 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:13.241960 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:13.242355 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:13.242060 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:41:14.241976 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:14.241940 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:14.241976 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:14.241970 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:14.242503 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:14.242077 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:41:14.242503 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:14.242206 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:41:14.894274 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:14.894184 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:14.894435 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:14.894316 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:41:14.894435 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:14.894375 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs podName:1c22f0a9-6788-4c37-89a6-5ab6de86ef60 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:46.894360368 +0000 UTC m=+66.132107886 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs") pod "network-metrics-daemon-llzgd" (UID: "1c22f0a9-6788-4c37-89a6-5ab6de86ef60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:41:14.995586 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:14.995537 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n79j8\" (UniqueName: \"kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8\") pod \"network-check-target-9cxct\" (UID: \"e58e24e8-e014-4d36-bd6f-5b10482fde22\") " pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:14.995776 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:14.995744 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:41:14.995776 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:14.995765 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:41:14.995888 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:14.995779 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n79j8 for pod openshift-network-diagnostics/network-check-target-9cxct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:41:14.995888 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:14.995846 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8 podName:e58e24e8-e014-4d36-bd6f-5b10482fde22 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:46.995828003 +0000 UTC m=+66.233575522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n79j8" (UniqueName: "kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8") pod "network-check-target-9cxct" (UID: "e58e24e8-e014-4d36-bd6f-5b10482fde22") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:41:15.242249 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:15.242219 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:15.242708 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:15.242344 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:41:16.241966 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:16.241937 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:16.242104 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:16.242050 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrjqd" podUID="60e89a0d-ca13-4ed3-834f-440d973a813f" Jun 03 15:41:16.242149 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:16.242103 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:16.242220 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:16.242199 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:41:17.241902 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:17.241716 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:17.242549 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:17.241964 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cxct" podUID="e58e24e8-e014-4d36-bd6f-5b10482fde22" Jun 03 15:41:17.385091 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:17.385008 2566 generic.go:358] "Generic (PLEG): container finished" podID="f83cc80e-2a78-4924-89f0-73513fdeebe7" containerID="7f71893c75f3cdd7c1a7cadc2417c4783a02ed725b1e0ca5c8ea50e3c374361e" exitCode=0 Jun 03 15:41:17.385091 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:17.385048 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s72xm" event={"ID":"f83cc80e-2a78-4924-89f0-73513fdeebe7","Type":"ContainerDied","Data":"7f71893c75f3cdd7c1a7cadc2417c4783a02ed725b1e0ca5c8ea50e3c374361e"} Jun 03 15:41:18.127700 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.127672 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-233.ec2.internal" event="NodeReady" Jun 03 15:41:18.127857 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.127821 2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 15:41:18.165551 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.165523 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84b87c9f58-fspwj"] Jun 03 15:41:18.194316 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.194295 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc"] Jun 03 15:41:18.194469 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.194452 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.196996 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.196959 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 15:41:18.196996 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.196988 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 15:41:18.197161 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.197065 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 15:41:18.197161 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.197109 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4ph84\"" Jun 03 15:41:18.208461 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.208437 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 15:41:18.214351 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.214331 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc"] Jun 03 15:41:18.214351 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.214354 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84b87c9f58-fspwj"] Jun 03 15:41:18.214487 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.214365 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6jw7w"] Jun 03 15:41:18.214487 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.214479 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:18.217083 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.217064 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9wth5\"" Jun 03 15:41:18.217204 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.217083 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 15:41:18.217204 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.217067 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 15:41:18.236401 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.236378 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hgfm9"] Jun 03 15:41:18.236528 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.236513 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.238782 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.238766 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 15:41:18.239106 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.239092 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 15:41:18.239175 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.239161 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2z9xs\"" Jun 03 15:41:18.255282 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.255264 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6jw7w"] Jun 03 15:41:18.255282 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.255284 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hgfm9"] Jun 03 15:41:18.255766 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.255403 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:18.255766 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.255424 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:18.255766 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.255492 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:18.257947 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.257915 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 15:41:18.257947 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.257935 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q8ntl\"" Jun 03 15:41:18.258107 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.257957 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:41:18.258107 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.257971 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 15:41:18.258107 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.258010 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:41:18.258243 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.258193 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f2mct\"" Jun 03 15:41:18.258243 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.258239 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 15:41:18.320006 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.319979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-installation-pull-secrets\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.320120 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320008 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae750873-93db-4ebd-8d5d-990e0c4b62c3-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:18.320120 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320051 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-trusted-ca\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.320120 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320068 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-bound-sa-token\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.320120 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320112 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2smc5\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-kube-api-access-2smc5\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.320321 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320189 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/064365c0-34c0-4700-b4a6-cb817ef192cb-ca-trust-extracted\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.320321 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320236 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.320321 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:18.320321 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320291 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-image-registry-private-configuration\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.320321 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-certificates\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.320523 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-config-volume\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.320523 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320366 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-tmp-dir\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.320523 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rvbf\" (UniqueName: \"kubernetes.io/projected/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-kube-api-access-9rvbf\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.320523 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.320422 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.389599 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.389545 2566 generic.go:358] "Generic (PLEG): container finished" podID="f83cc80e-2a78-4924-89f0-73513fdeebe7" containerID="aeb692151d21526357ebf6ab8fbb9f01743a23424dd580c6212abb684db81e76" exitCode=0 Jun 03 15:41:18.389599 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.389591 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s72xm" event={"ID":"f83cc80e-2a78-4924-89f0-73513fdeebe7","Type":"ContainerDied","Data":"aeb692151d21526357ebf6ab8fbb9f01743a23424dd580c6212abb684db81e76"} Jun 03 15:41:18.420964 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.420945 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-image-registry-private-configuration\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.421037 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.420973 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-certificates\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.421037 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.420995 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-config-volume\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.421037 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421024 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-tmp-dir\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.421167 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421048 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rvbf\" (UniqueName: \"kubernetes.io/projected/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-kube-api-access-9rvbf\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.421167 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421082 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.421167 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421110 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:18.421167 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421141 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-installation-pull-secrets\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.421343 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.421226 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:41:18.421343 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.421245 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84b87c9f58-fspwj: secret "image-registry-tls" not found Jun 03 15:41:18.421343 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.421311 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls podName:064365c0-34c0-4700-b4a6-cb817ef192cb nodeName:}" failed. No retries permitted until 2026-06-03 15:41:18.921289048 +0000 UTC m=+38.159036584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls") pod "image-registry-84b87c9f58-fspwj" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb") : secret "image-registry-tls" not found Jun 03 15:41:18.421492 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421401 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-tmp-dir\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.421492 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421448 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae750873-93db-4ebd-8d5d-990e0c4b62c3-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:18.421591 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421513 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-trusted-ca\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.421591 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421539 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-bound-sa-token\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.421591 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421563 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2smc5\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-kube-api-access-2smc5\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.421766 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421604 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/064365c0-34c0-4700-b4a6-cb817ef192cb-ca-trust-extracted\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.421766 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421634 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-config-volume\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.421766 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421634 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhzhc\" (UniqueName: \"kubernetes.io/projected/cf2341d0-e5ac-46b5-af12-20dadc47c445-kube-api-access-xhzhc\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:18.421766 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421661 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-certificates\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.421766 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421707 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.421766 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.421760 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:18.422046 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.421844 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:41:18.422046 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.421901 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert podName:ae750873-93db-4ebd-8d5d-990e0c4b62c3 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:18.92188403 +0000 UTC m=+38.159631564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-nwqfc" (UID: "ae750873-93db-4ebd-8d5d-990e0c4b62c3") : secret "networking-console-plugin-cert" not found Jun 03 15:41:18.422046 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.421956 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:18.422046 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.421986 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls podName:d80b1c9c-ed86-407b-a9c8-aa8ce7277222 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:18.921976 +0000 UTC m=+38.159723517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls") pod "dns-default-6jw7w" (UID: "d80b1c9c-ed86-407b-a9c8-aa8ce7277222") : secret "dns-default-metrics-tls" not found Jun 03 15:41:18.422237 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.422112 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae750873-93db-4ebd-8d5d-990e0c4b62c3-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:18.422395 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.422378 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/064365c0-34c0-4700-b4a6-cb817ef192cb-ca-trust-extracted\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.422528 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.422508 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-trusted-ca\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.426654 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.426187 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-installation-pull-secrets\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.426812 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.426795 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-image-registry-private-configuration\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.430353 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.430328 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rvbf\" (UniqueName: \"kubernetes.io/projected/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-kube-api-access-9rvbf\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.432999 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.432929 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-bound-sa-token\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.434214 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.434190 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2smc5\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-kube-api-access-2smc5\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.522881 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.522852 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xhzhc\" (UniqueName: \"kubernetes.io/projected/cf2341d0-e5ac-46b5-af12-20dadc47c445-kube-api-access-xhzhc\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:18.522978 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.522962 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:18.523135 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.523108 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:18.523204 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.523170 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert podName:cf2341d0-e5ac-46b5-af12-20dadc47c445 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:19.023150546 +0000 UTC m=+38.260898071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert") pod "ingress-canary-hgfm9" (UID: "cf2341d0-e5ac-46b5-af12-20dadc47c445") : secret "canary-serving-cert" not found Jun 03 15:41:18.531144 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.531119 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhzhc\" (UniqueName: \"kubernetes.io/projected/cf2341d0-e5ac-46b5-af12-20dadc47c445-kube-api-access-xhzhc\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:18.926881 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.926840 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:18.926881 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.926886 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:18.927139 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.926988 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:41:18.927139 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.926987 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:18.927139 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:18.927022 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:18.927139 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.927046 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert podName:ae750873-93db-4ebd-8d5d-990e0c4b62c3 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:19.927028835 +0000 UTC m=+39.164776351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-nwqfc" (UID: "ae750873-93db-4ebd-8d5d-990e0c4b62c3") : secret "networking-console-plugin-cert" not found Jun 03 15:41:18.927139 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.927095 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls podName:d80b1c9c-ed86-407b-a9c8-aa8ce7277222 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:19.927085099 +0000 UTC m=+39.164832628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls") pod "dns-default-6jw7w" (UID: "d80b1c9c-ed86-407b-a9c8-aa8ce7277222") : secret "dns-default-metrics-tls" not found Jun 03 15:41:18.927139 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.927108 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:41:18.927139 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.927122 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84b87c9f58-fspwj: secret "image-registry-tls" not found Jun 03 15:41:18.927380 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:18.927166 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls podName:064365c0-34c0-4700-b4a6-cb817ef192cb nodeName:}" failed. No retries permitted until 2026-06-03 15:41:19.927151539 +0000 UTC m=+39.164899061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls") pod "image-registry-84b87c9f58-fspwj" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb") : secret "image-registry-tls" not found Jun 03 15:41:19.028393 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:19.028363 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:19.028531 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:19.028497 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:19.028589 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:19.028557 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert podName:cf2341d0-e5ac-46b5-af12-20dadc47c445 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:20.028539555 +0000 UTC m=+39.266287085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert") pod "ingress-canary-hgfm9" (UID: "cf2341d0-e5ac-46b5-af12-20dadc47c445") : secret "canary-serving-cert" not found Jun 03 15:41:19.242107 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:19.242080 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:19.244709 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:19.244680 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7qpdh\"" Jun 03 15:41:19.244925 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:19.244781 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:41:19.244925 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:19.244812 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:41:19.397335 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:19.397305 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s72xm" event={"ID":"f83cc80e-2a78-4924-89f0-73513fdeebe7","Type":"ContainerStarted","Data":"0c0540d27a551519773c95abaa90d095c4f5fa39017e89f543b74309667b5d5d"} Jun 03 15:41:19.420017 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:19.419974 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s72xm" podStartSLOduration=6.07347117 podStartE2EDuration="38.41996145s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="2026-06-03 15:40:44.015900181 +0000 UTC m=+3.253647698" lastFinishedPulling="2026-06-03 15:41:16.362390458 +0000 UTC m=+35.600137978" observedRunningTime="2026-06-03 15:41:19.419133204 +0000 UTC m=+38.656880744" watchObservedRunningTime="2026-06-03 15:41:19.41996145 +0000 UTC m=+38.657708988" Jun 03 15:41:19.935264 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:19.935221 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:19.935437 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:19.935274 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:19.935437 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:19.935314 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:19.935437 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:19.935364 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:19.935437 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:19.935424 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:41:19.935437 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:19.935436 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls podName:d80b1c9c-ed86-407b-a9c8-aa8ce7277222 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:21.935420887 +0000 UTC m=+41.173168404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls") pod "dns-default-6jw7w" (UID: "d80b1c9c-ed86-407b-a9c8-aa8ce7277222") : secret "dns-default-metrics-tls" not found Jun 03 15:41:19.935659 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:19.935458 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:41:19.935659 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:19.935473 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84b87c9f58-fspwj: secret "image-registry-tls" not found Jun 03 15:41:19.935659 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:19.935482 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert podName:ae750873-93db-4ebd-8d5d-990e0c4b62c3 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:21.935469672 +0000 UTC m=+41.173217188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-nwqfc" (UID: "ae750873-93db-4ebd-8d5d-990e0c4b62c3") : secret "networking-console-plugin-cert" not found Jun 03 15:41:19.935659 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:19.935561 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls podName:064365c0-34c0-4700-b4a6-cb817ef192cb nodeName:}" failed. No retries permitted until 2026-06-03 15:41:21.935546604 +0000 UTC m=+41.173294137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls") pod "image-registry-84b87c9f58-fspwj" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb") : secret "image-registry-tls" not found Jun 03 15:41:20.035978 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:20.035949 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:20.036063 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:20.036056 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:20.036105 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:20.036096 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert podName:cf2341d0-e5ac-46b5-af12-20dadc47c445 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:22.036085497 +0000 UTC m=+41.273833015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert") pod "ingress-canary-hgfm9" (UID: "cf2341d0-e5ac-46b5-af12-20dadc47c445") : secret "canary-serving-cert" not found Jun 03 15:41:20.541196 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:20.540920 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:20.543553 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:20.543534 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60e89a0d-ca13-4ed3-834f-440d973a813f-original-pull-secret\") pod \"global-pull-secret-syncer-lrjqd\" (UID: \"60e89a0d-ca13-4ed3-834f-440d973a813f\") " pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:20.674581 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:20.674545 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrjqd" Jun 03 15:41:20.846227 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:20.846200 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrjqd"] Jun 03 15:41:20.849945 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:41:20.849919 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e89a0d_ca13_4ed3_834f_440d973a813f.slice/crio-2d95432ee65499d39942e4164dcb40e38248c475dad71343daec83f085913d46 WatchSource:0}: Error finding container 2d95432ee65499d39942e4164dcb40e38248c475dad71343daec83f085913d46: Status 404 returned error can't find the container with id 2d95432ee65499d39942e4164dcb40e38248c475dad71343daec83f085913d46 Jun 03 15:41:21.401970 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:21.401934 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrjqd" event={"ID":"60e89a0d-ca13-4ed3-834f-440d973a813f","Type":"ContainerStarted","Data":"2d95432ee65499d39942e4164dcb40e38248c475dad71343daec83f085913d46"} Jun 03 15:41:21.952651 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:21.952601 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:21.952651 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:21.952646 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:21.953237 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:21.952688 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:21.953237 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:21.952775 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:21.953237 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:21.952841 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls podName:d80b1c9c-ed86-407b-a9c8-aa8ce7277222 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:25.952822753 +0000 UTC m=+45.190570342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls") pod "dns-default-6jw7w" (UID: "d80b1c9c-ed86-407b-a9c8-aa8ce7277222") : secret "dns-default-metrics-tls" not found Jun 03 15:41:21.953237 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:21.952852 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:41:21.953237 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:21.952863 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84b87c9f58-fspwj: secret "image-registry-tls" not found Jun 03 15:41:21.953237 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:21.952897 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls podName:064365c0-34c0-4700-b4a6-cb817ef192cb nodeName:}" failed. No retries permitted until 2026-06-03 15:41:25.952885135 +0000 UTC m=+45.190632667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls") pod "image-registry-84b87c9f58-fspwj" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb") : secret "image-registry-tls" not found Jun 03 15:41:21.953237 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:21.952946 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:41:21.953237 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:21.952975 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert podName:ae750873-93db-4ebd-8d5d-990e0c4b62c3 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:25.952966151 +0000 UTC m=+45.190713668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-nwqfc" (UID: "ae750873-93db-4ebd-8d5d-990e0c4b62c3") : secret "networking-console-plugin-cert" not found Jun 03 15:41:22.054241 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:22.054203 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:22.054420 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:22.054376 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:22.054465 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:22.054453 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert podName:cf2341d0-e5ac-46b5-af12-20dadc47c445 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:26.05443289 +0000 UTC m=+45.292180421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert") pod "ingress-canary-hgfm9" (UID: "cf2341d0-e5ac-46b5-af12-20dadc47c445") : secret "canary-serving-cert" not found Jun 03 15:41:25.986256 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:25.986199 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:25.986256 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:25.986266 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:25.986844 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:25.986310 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:25.986844 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:25.986367 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:25.986844 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:25.986409 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:41:25.986844 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:25.986420 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84b87c9f58-fspwj: secret "image-registry-tls" not found Jun 03 15:41:25.986844 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:25.986427 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:41:25.986844 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:25.986434 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls podName:d80b1c9c-ed86-407b-a9c8-aa8ce7277222 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:33.986413622 +0000 UTC m=+53.224161141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls") pod "dns-default-6jw7w" (UID: "d80b1c9c-ed86-407b-a9c8-aa8ce7277222") : secret "dns-default-metrics-tls" not found Jun 03 15:41:25.986844 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:25.986538 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls podName:064365c0-34c0-4700-b4a6-cb817ef192cb nodeName:}" failed. No retries permitted until 2026-06-03 15:41:33.9865261 +0000 UTC m=+53.224273617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls") pod "image-registry-84b87c9f58-fspwj" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb") : secret "image-registry-tls" not found Jun 03 15:41:25.986844 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:25.986548 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert podName:ae750873-93db-4ebd-8d5d-990e0c4b62c3 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:33.98654253 +0000 UTC m=+53.224290050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-nwqfc" (UID: "ae750873-93db-4ebd-8d5d-990e0c4b62c3") : secret "networking-console-plugin-cert" not found Jun 03 15:41:26.086909 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:26.086882 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:26.087035 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:26.087016 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:26.087103 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:26.087093 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert podName:cf2341d0-e5ac-46b5-af12-20dadc47c445 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:34.087063861 +0000 UTC m=+53.324811384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert") pod "ingress-canary-hgfm9" (UID: "cf2341d0-e5ac-46b5-af12-20dadc47c445") : secret "canary-serving-cert" not found Jun 03 15:41:26.413115 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:26.413036 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrjqd" event={"ID":"60e89a0d-ca13-4ed3-834f-440d973a813f","Type":"ContainerStarted","Data":"94600a04629a60d2d13a51545cc7e743756cf8a611396b00bce9cf808ccadbc0"} Jun 03 15:41:26.432780 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:26.432714 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lrjqd" podStartSLOduration=33.906323234 podStartE2EDuration="38.432701248s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:41:20.853821202 +0000 UTC m=+40.091568737" lastFinishedPulling="2026-06-03 15:41:25.380199234 +0000 UTC m=+44.617946751" observedRunningTime="2026-06-03 15:41:26.431892499 +0000 UTC m=+45.669640037" watchObservedRunningTime="2026-06-03 15:41:26.432701248 +0000 UTC m=+45.670448786" Jun 03 15:41:34.044612 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:34.044566 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:34.045172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:34.044626 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:34.045172 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:34.044707 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:41:34.045172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:34.044739 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:34.045172 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:34.044711 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:41:34.045172 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:34.044816 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84b87c9f58-fspwj: secret "image-registry-tls" not found Jun 03 15:41:34.045172 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:34.044826 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:34.045172 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:34.044800 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert podName:ae750873-93db-4ebd-8d5d-990e0c4b62c3 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:50.044782696 +0000 UTC m=+69.282530213 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-nwqfc" (UID: "ae750873-93db-4ebd-8d5d-990e0c4b62c3") : secret "networking-console-plugin-cert" not found Jun 03 15:41:34.045172 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:34.044872 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls podName:d80b1c9c-ed86-407b-a9c8-aa8ce7277222 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:50.044857208 +0000 UTC m=+69.282604725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls") pod "dns-default-6jw7w" (UID: "d80b1c9c-ed86-407b-a9c8-aa8ce7277222") : secret "dns-default-metrics-tls" not found Jun 03 15:41:34.045172 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:34.044899 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls podName:064365c0-34c0-4700-b4a6-cb817ef192cb nodeName:}" failed. No retries permitted until 2026-06-03 15:41:50.044888127 +0000 UTC m=+69.282635651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls") pod "image-registry-84b87c9f58-fspwj" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb") : secret "image-registry-tls" not found Jun 03 15:41:34.145813 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:34.145784 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:34.145954 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:34.145865 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:34.145954 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:34.145904 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert podName:cf2341d0-e5ac-46b5-af12-20dadc47c445 nodeName:}" failed. No retries permitted until 2026-06-03 15:41:50.145890394 +0000 UTC m=+69.383637910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert") pod "ingress-canary-hgfm9" (UID: "cf2341d0-e5ac-46b5-af12-20dadc47c445") : secret "canary-serving-cert" not found Jun 03 15:41:42.396415 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:42.396384 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gqgl" Jun 03 15:41:46.939683 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:46.939640 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:41:46.942965 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:46.942949 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:41:46.950102 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:46.950082 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 15:41:46.950165 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:46.950155 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs podName:1c22f0a9-6788-4c37-89a6-5ab6de86ef60 nodeName:}" failed. No retries permitted until 2026-06-03 15:42:50.950138772 +0000 UTC m=+130.187886288 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs") pod "network-metrics-daemon-llzgd" (UID: "1c22f0a9-6788-4c37-89a6-5ab6de86ef60") : secret "metrics-daemon-secret" not found Jun 03 15:41:47.040584 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:47.040554 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n79j8\" (UniqueName: \"kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8\") pod \"network-check-target-9cxct\" (UID: \"e58e24e8-e014-4d36-bd6f-5b10482fde22\") " pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:47.043495 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:47.043479 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:41:47.054025 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:47.054003 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:41:47.066256 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:47.066232 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n79j8\" (UniqueName: \"kubernetes.io/projected/e58e24e8-e014-4d36-bd6f-5b10482fde22-kube-api-access-n79j8\") pod \"network-check-target-9cxct\" (UID: \"e58e24e8-e014-4d36-bd6f-5b10482fde22\") " pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:47.153837 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:47.153808 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7qpdh\"" Jun 03 15:41:47.161960 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:47.161945 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:47.298119 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:47.298088 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9cxct"] Jun 03 15:41:47.301386 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:41:47.301355 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode58e24e8_e014_4d36_bd6f_5b10482fde22.slice/crio-b7aef487f32ffd4d95ed5d41e9a140d264023ffe4f0916d19721dc90fde31867 WatchSource:0}: Error finding container b7aef487f32ffd4d95ed5d41e9a140d264023ffe4f0916d19721dc90fde31867: Status 404 returned error can't find the container with id b7aef487f32ffd4d95ed5d41e9a140d264023ffe4f0916d19721dc90fde31867 Jun 03 15:41:47.453962 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:47.453928 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9cxct" event={"ID":"e58e24e8-e014-4d36-bd6f-5b10482fde22","Type":"ContainerStarted","Data":"b7aef487f32ffd4d95ed5d41e9a140d264023ffe4f0916d19721dc90fde31867"} Jun 03 15:41:50.064585 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:50.064543 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:41:50.064585 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:50.064585 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:41:50.065252 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:50.064629 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:41:50.065252 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:50.064709 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:41:50.065252 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:50.064749 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:41:50.065252 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:50.064762 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84b87c9f58-fspwj: secret "image-registry-tls" not found Jun 03 15:41:50.065252 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:50.064801 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls podName:d80b1c9c-ed86-407b-a9c8-aa8ce7277222 nodeName:}" failed. No retries permitted until 2026-06-03 15:42:22.06477924 +0000 UTC m=+101.302526768 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls") pod "dns-default-6jw7w" (UID: "d80b1c9c-ed86-407b-a9c8-aa8ce7277222") : secret "dns-default-metrics-tls" not found Jun 03 15:41:50.065252 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:50.064815 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:41:50.065252 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:50.064818 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls podName:064365c0-34c0-4700-b4a6-cb817ef192cb nodeName:}" failed. No retries permitted until 2026-06-03 15:42:22.064811898 +0000 UTC m=+101.302559419 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls") pod "image-registry-84b87c9f58-fspwj" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb") : secret "image-registry-tls" not found Jun 03 15:41:50.065252 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:50.064867 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert podName:ae750873-93db-4ebd-8d5d-990e0c4b62c3 nodeName:}" failed. No retries permitted until 2026-06-03 15:42:22.064854655 +0000 UTC m=+101.302602174 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-nwqfc" (UID: "ae750873-93db-4ebd-8d5d-990e0c4b62c3") : secret "networking-console-plugin-cert" not found Jun 03 15:41:50.165690 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:50.165653 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:41:50.165889 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:50.165840 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:41:50.165952 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:41:50.165923 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert podName:cf2341d0-e5ac-46b5-af12-20dadc47c445 nodeName:}" failed. No retries permitted until 2026-06-03 15:42:22.165900318 +0000 UTC m=+101.403647846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert") pod "ingress-canary-hgfm9" (UID: "cf2341d0-e5ac-46b5-af12-20dadc47c445") : secret "canary-serving-cert" not found Jun 03 15:41:51.463098 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:51.463053 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9cxct" event={"ID":"e58e24e8-e014-4d36-bd6f-5b10482fde22","Type":"ContainerStarted","Data":"9f35b90217b0c72ac6888c8735ca5df29163b523350b80729a786a00b2492067"} Jun 03 15:41:51.463459 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:51.463225 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:41:51.481733 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:41:51.481668 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9cxct" podStartSLOduration=67.030673579 podStartE2EDuration="1m10.481654529s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="2026-06-03 15:41:47.303917669 +0000 UTC m=+66.541665186" lastFinishedPulling="2026-06-03 15:41:50.754898618 +0000 UTC m=+69.992646136" observedRunningTime="2026-06-03 15:41:51.481157839 +0000 UTC m=+70.718905379" watchObservedRunningTime="2026-06-03 15:41:51.481654529 +0000 UTC m=+70.719402068" Jun 03 15:42:22.089040 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:42:22.089006 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:42:22.089476 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:42:22.089048 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:42:22.089476 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:42:22.089074 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:42:22.089476 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:42:22.089164 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:42:22.089476 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:42:22.089171 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:42:22.089476 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:42:22.089173 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:42:22.089476 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:42:22.089188 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84b87c9f58-fspwj: secret "image-registry-tls" not found Jun 03 15:42:22.089476 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:42:22.089238 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert podName:ae750873-93db-4ebd-8d5d-990e0c4b62c3 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:26.089221118 +0000 UTC m=+165.326968635 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-nwqfc" (UID: "ae750873-93db-4ebd-8d5d-990e0c4b62c3") : secret "networking-console-plugin-cert" not found Jun 03 15:42:22.089476 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:42:22.089253 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls podName:064365c0-34c0-4700-b4a6-cb817ef192cb nodeName:}" failed. No retries permitted until 2026-06-03 15:43:26.089246766 +0000 UTC m=+165.326994283 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls") pod "image-registry-84b87c9f58-fspwj" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb") : secret "image-registry-tls" not found Jun 03 15:42:22.089476 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:42:22.089264 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls podName:d80b1c9c-ed86-407b-a9c8-aa8ce7277222 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:26.089258495 +0000 UTC m=+165.327006013 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls") pod "dns-default-6jw7w" (UID: "d80b1c9c-ed86-407b-a9c8-aa8ce7277222") : secret "dns-default-metrics-tls" not found Jun 03 15:42:22.189359 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:42:22.189334 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:42:22.189442 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:42:22.189431 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:42:22.189520 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:42:22.189473 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert podName:cf2341d0-e5ac-46b5-af12-20dadc47c445 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:26.189460512 +0000 UTC m=+165.427208029 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert") pod "ingress-canary-hgfm9" (UID: "cf2341d0-e5ac-46b5-af12-20dadc47c445") : secret "canary-serving-cert" not found Jun 03 15:42:22.467680 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:42:22.467657 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9cxct" Jun 03 15:42:50.991567 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:42:50.991535 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:42:50.992020 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:42:50.991681 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 15:42:50.992020 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:42:50.991769 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs podName:1c22f0a9-6788-4c37-89a6-5ab6de86ef60 nodeName:}" failed. No retries permitted until 2026-06-03 15:44:52.991752965 +0000 UTC m=+252.229500487 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs") pod "network-metrics-daemon-llzgd" (UID: "1c22f0a9-6788-4c37-89a6-5ab6de86ef60") : secret "metrics-daemon-secret" not found Jun 03 15:43:00.047705 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.047666 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w55p5"] Jun 03 15:43:00.049494 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.049477 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w55p5" Jun 03 15:43:00.052484 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.052459 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:43:00.052599 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.052519 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 15:43:00.053620 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.053604 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9dhw4\"" Jun 03 15:43:00.063337 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.063313 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w55p5"] Jun 03 15:43:00.156112 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.156080 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtbp4\" (UniqueName: \"kubernetes.io/projected/55ee0b74-0b48-4807-b2fa-bc262b5684be-kube-api-access-mtbp4\") pod \"volume-data-source-validator-7598fd5bd-w55p5\" (UID: \"55ee0b74-0b48-4807-b2fa-bc262b5684be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w55p5" Jun 03 15:43:00.159938 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.159912 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7"] Jun 03 15:43:00.161938 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.161924 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:00.168614 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.168584 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 15:43:00.168795 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.168779 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 15:43:00.168885 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.168862 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jrvmd\"" Jun 03 15:43:00.169148 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.169133 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:43:00.177629 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.177607 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64c87cbd65-8xckp"] Jun 03 15:43:00.179407 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.179391 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7"] Jun 03 15:43:00.179498 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.179476 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.184414 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.184397 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 15:43:00.184663 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.184644 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-d4hdp\"" Jun 03 15:43:00.185132 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.185098 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 15:43:00.185273 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.185204 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 15:43:00.185273 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.185208 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 15:43:00.185456 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.185443 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 15:43:00.185736 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.185703 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 15:43:00.209366 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.209344 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64c87cbd65-8xckp"] Jun 03 15:43:00.256682 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.256652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xcjn7\" (UID: \"d1cdd370-5583-451d-a555-adb7052b603f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:00.256814 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.256759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnczn\" (UniqueName: \"kubernetes.io/projected/d1cdd370-5583-451d-a555-adb7052b603f-kube-api-access-gnczn\") pod \"cluster-samples-operator-755bbf9bfb-xcjn7\" (UID: \"d1cdd370-5583-451d-a555-adb7052b603f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:00.256876 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.256820 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtbp4\" (UniqueName: \"kubernetes.io/projected/55ee0b74-0b48-4807-b2fa-bc262b5684be-kube-api-access-mtbp4\") pod \"volume-data-source-validator-7598fd5bd-w55p5\" (UID: \"55ee0b74-0b48-4807-b2fa-bc262b5684be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w55p5" Jun 03 15:43:00.284308 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.284286 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtbp4\" (UniqueName: \"kubernetes.io/projected/55ee0b74-0b48-4807-b2fa-bc262b5684be-kube-api-access-mtbp4\") pod \"volume-data-source-validator-7598fd5bd-w55p5\" (UID: \"55ee0b74-0b48-4807-b2fa-bc262b5684be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w55p5" Jun 03 15:43:00.357388 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.357332 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnczn\" (UniqueName: \"kubernetes.io/projected/d1cdd370-5583-451d-a555-adb7052b603f-kube-api-access-gnczn\") pod \"cluster-samples-operator-755bbf9bfb-xcjn7\" (UID: \"d1cdd370-5583-451d-a555-adb7052b603f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:00.357388 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.357381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.357575 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.357399 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.357575 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.357418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-default-certificate\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.357575 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.357469 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-stats-auth\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.357575 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.357496 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w55p5" Jun 03 15:43:00.357575 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.357546 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xcjn7\" (UID: \"d1cdd370-5583-451d-a555-adb7052b603f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:00.357794 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.357595 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4rnq\" (UniqueName: \"kubernetes.io/projected/d10fe152-c199-408e-9552-04e3be42bb28-kube-api-access-x4rnq\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.357794 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:00.357628 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:43:00.357794 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:00.357689 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls podName:d1cdd370-5583-451d-a555-adb7052b603f nodeName:}" failed. No retries permitted until 2026-06-03 15:43:00.857671551 +0000 UTC m=+140.095419069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-xcjn7" (UID: "d1cdd370-5583-451d-a555-adb7052b603f") : secret "samples-operator-tls" not found Jun 03 15:43:00.367787 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.367763 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnczn\" (UniqueName: \"kubernetes.io/projected/d1cdd370-5583-451d-a555-adb7052b603f-kube-api-access-gnczn\") pod \"cluster-samples-operator-755bbf9bfb-xcjn7\" (UID: \"d1cdd370-5583-451d-a555-adb7052b603f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:00.458574 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.458549 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4rnq\" (UniqueName: \"kubernetes.io/projected/d10fe152-c199-408e-9552-04e3be42bb28-kube-api-access-x4rnq\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.458750 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.458636 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.458750 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.458671 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.458750 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.458701 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-default-certificate\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.458750 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.458743 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-stats-auth\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.458952 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:00.458828 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:00.95880544 +0000 UTC m=+140.196552972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : configmap references non-existent config key: service-ca.crt Jun 03 15:43:00.458952 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:00.458829 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:43:00.458952 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:00.458868 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:00.958861144 +0000 UTC m=+140.196608660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : secret "router-metrics-certs-default" not found Jun 03 15:43:00.461353 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.461325 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-default-certificate\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.461478 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.461463 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-stats-auth\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.471080 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.471058 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4rnq\" (UniqueName: \"kubernetes.io/projected/d10fe152-c199-408e-9552-04e3be42bb28-kube-api-access-x4rnq\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.494188 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.494167 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w55p5"] Jun 03 15:43:00.496807 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:00.496780 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ee0b74_0b48_4807_b2fa_bc262b5684be.slice/crio-952b46ec69da2e366cef1ce8f86f69bc4535e619fd0b9fd0e8727f108fdaaaba WatchSource:0}: Error finding container 952b46ec69da2e366cef1ce8f86f69bc4535e619fd0b9fd0e8727f108fdaaaba: Status 404 returned error can't find the container with id 952b46ec69da2e366cef1ce8f86f69bc4535e619fd0b9fd0e8727f108fdaaaba Jun 03 15:43:00.593063 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.593035 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w55p5" event={"ID":"55ee0b74-0b48-4807-b2fa-bc262b5684be","Type":"ContainerStarted","Data":"952b46ec69da2e366cef1ce8f86f69bc4535e619fd0b9fd0e8727f108fdaaaba"} Jun 03 15:43:00.862047 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.862018 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xcjn7\" (UID: \"d1cdd370-5583-451d-a555-adb7052b603f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:00.862235 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:00.862201 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:43:00.862344 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:00.862325 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls podName:d1cdd370-5583-451d-a555-adb7052b603f nodeName:}" failed. No retries permitted until 2026-06-03 15:43:01.862301567 +0000 UTC m=+141.100049087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-xcjn7" (UID: "d1cdd370-5583-451d-a555-adb7052b603f") : secret "samples-operator-tls" not found Jun 03 15:43:00.963351 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.963324 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.963472 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:00.963355 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:00.963472 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:00.963463 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:43:00.963550 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:00.963473 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:01.963457576 +0000 UTC m=+141.201205096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : configmap references non-existent config key: service-ca.crt Jun 03 15:43:00.963550 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:00.963500 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:01.963489901 +0000 UTC m=+141.201237417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : secret "router-metrics-certs-default" not found Jun 03 15:43:01.869554 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:01.869520 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xcjn7\" (UID: \"d1cdd370-5583-451d-a555-adb7052b603f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:01.869977 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:01.869635 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:43:01.869977 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:01.869688 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls podName:d1cdd370-5583-451d-a555-adb7052b603f nodeName:}" failed. No retries permitted until 2026-06-03 15:43:03.869675636 +0000 UTC m=+143.107423158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-xcjn7" (UID: "d1cdd370-5583-451d-a555-adb7052b603f") : secret "samples-operator-tls" not found Jun 03 15:43:01.970589 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:01.970549 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:01.970589 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:01.970589 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:01.970816 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:01.970692 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:43:01.970816 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:01.970751 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:03.970714546 +0000 UTC m=+143.208462074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : configmap references non-existent config key: service-ca.crt Jun 03 15:43:01.970816 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:01.970780 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:03.970767771 +0000 UTC m=+143.208515299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : secret "router-metrics-certs-default" not found Jun 03 15:43:03.605405 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:03.605359 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w55p5" event={"ID":"55ee0b74-0b48-4807-b2fa-bc262b5684be","Type":"ContainerStarted","Data":"dff8a4e916efafad696c51daeab96d38ecb26d23853c2686820f43b63c5949f9"} Jun 03 15:43:03.630425 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:03.630376 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w55p5" podStartSLOduration=1.498647509 podStartE2EDuration="3.630362909s" podCreationTimestamp="2026-06-03 15:43:00 +0000 UTC" firstStartedPulling="2026-06-03 15:43:00.498442382 +0000 UTC m=+139.736189898" lastFinishedPulling="2026-06-03 15:43:02.630157778 +0000 UTC m=+141.867905298" observedRunningTime="2026-06-03 15:43:03.628944381 +0000 UTC m=+142.866691920" watchObservedRunningTime="2026-06-03 15:43:03.630362909 +0000 UTC m=+142.868110448" Jun 03 15:43:03.885499 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:03.885417 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xcjn7\" (UID: \"d1cdd370-5583-451d-a555-adb7052b603f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:03.885636 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:03.885552 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:43:03.885636 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:03.885616 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls podName:d1cdd370-5583-451d-a555-adb7052b603f nodeName:}" failed. No retries permitted until 2026-06-03 15:43:07.885602694 +0000 UTC m=+147.123350215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-xcjn7" (UID: "d1cdd370-5583-451d-a555-adb7052b603f") : secret "samples-operator-tls" not found Jun 03 15:43:03.986860 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:03.986830 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:03.987043 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:03.986869 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:03.987043 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:03.986977 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:07.986960551 +0000 UTC m=+147.224708075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : configmap references non-existent config key: service-ca.crt Jun 03 15:43:03.987043 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:03.986978 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:43:03.987043 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:03.987033 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:07.98701674 +0000 UTC m=+147.224764257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : secret "router-metrics-certs-default" not found Jun 03 15:43:04.779202 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.779164 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q"] Jun 03 15:43:04.782132 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.782114 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" Jun 03 15:43:04.787414 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.787387 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 15:43:04.787505 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.787440 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 15:43:04.788449 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.788431 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nmcqc\"" Jun 03 15:43:04.788534 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.788429 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 15:43:04.791405 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.791391 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:43:04.795929 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.795912 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snb6b\" (UniqueName: \"kubernetes.io/projected/8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa-kube-api-access-snb6b\") pod \"service-ca-operator-69877444c-2nh7q\" (UID: \"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" Jun 03 15:43:04.795985 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.795939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa-serving-cert\") pod \"service-ca-operator-69877444c-2nh7q\" (UID: \"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" Jun 03 15:43:04.795985 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.795955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa-config\") pod \"service-ca-operator-69877444c-2nh7q\" (UID: \"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" Jun 03 15:43:04.804266 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.804242 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q"] Jun 03 15:43:04.897175 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.897146 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snb6b\" (UniqueName: \"kubernetes.io/projected/8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa-kube-api-access-snb6b\") pod \"service-ca-operator-69877444c-2nh7q\" (UID: \"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" Jun 03 15:43:04.897175 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.897175 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa-serving-cert\") pod \"service-ca-operator-69877444c-2nh7q\" (UID: \"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" Jun 03 15:43:04.897293 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.897195 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa-config\") pod \"service-ca-operator-69877444c-2nh7q\" (UID: \"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" Jun 03 15:43:04.897793 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.897775 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa-config\") pod \"service-ca-operator-69877444c-2nh7q\" (UID: \"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" Jun 03 15:43:04.899485 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.899465 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa-serving-cert\") pod \"service-ca-operator-69877444c-2nh7q\" (UID: \"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" Jun 03 15:43:04.907749 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:04.907713 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snb6b\" (UniqueName: \"kubernetes.io/projected/8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa-kube-api-access-snb6b\") pod \"service-ca-operator-69877444c-2nh7q\" (UID: \"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" Jun 03 15:43:05.090429 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:05.090361 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" Jun 03 15:43:05.211899 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:05.211870 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q"] Jun 03 15:43:05.215071 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:05.215048 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7f54e6_52fb_4176_bb60_8bf0ba9edaaa.slice/crio-da623a390e29f9759b51a28974de9c61dd92405e058be914a0da5c6415b6fcdf WatchSource:0}: Error finding container da623a390e29f9759b51a28974de9c61dd92405e058be914a0da5c6415b6fcdf: Status 404 returned error can't find the container with id da623a390e29f9759b51a28974de9c61dd92405e058be914a0da5c6415b6fcdf Jun 03 15:43:05.609669 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:05.609630 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" event={"ID":"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa","Type":"ContainerStarted","Data":"da623a390e29f9759b51a28974de9c61dd92405e058be914a0da5c6415b6fcdf"} Jun 03 15:43:06.656315 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:06.656283 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd"] Jun 03 15:43:06.659568 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:06.659544 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd" Jun 03 15:43:06.662962 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:06.662938 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-67hs2\"" Jun 03 15:43:06.663103 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:06.662942 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 15:43:06.663808 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:06.663778 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 15:43:06.670738 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:06.670696 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd"] Jun 03 15:43:06.709265 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:06.709236 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-884zp\" (UniqueName: \"kubernetes.io/projected/6589971e-9447-4d10-8242-99e9eed6d2ad-kube-api-access-884zp\") pod \"migrator-96c6f749-hqsgd\" (UID: \"6589971e-9447-4d10-8242-99e9eed6d2ad\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd" Jun 03 15:43:06.757520 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:06.757498 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4b5p_04f1a986-af91-4f11-8331-24d0a44eed34/dns-node-resolver/0.log" Jun 03 15:43:06.810355 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:06.810335 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-884zp\" (UniqueName: \"kubernetes.io/projected/6589971e-9447-4d10-8242-99e9eed6d2ad-kube-api-access-884zp\") pod \"migrator-96c6f749-hqsgd\" (UID: \"6589971e-9447-4d10-8242-99e9eed6d2ad\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd" Jun 03 15:43:06.819853 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:06.819833 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-884zp\" (UniqueName: \"kubernetes.io/projected/6589971e-9447-4d10-8242-99e9eed6d2ad-kube-api-access-884zp\") pod \"migrator-96c6f749-hqsgd\" (UID: \"6589971e-9447-4d10-8242-99e9eed6d2ad\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd" Jun 03 15:43:06.969112 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:06.969084 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd" Jun 03 15:43:07.114708 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:07.114678 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd"] Jun 03 15:43:07.118016 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:07.117989 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6589971e_9447_4d10_8242_99e9eed6d2ad.slice/crio-599394bbec4f3cac57cd374c335726b92ff664b9c927f03f2322bf45af5c8c10 WatchSource:0}: Error finding container 599394bbec4f3cac57cd374c335726b92ff664b9c927f03f2322bf45af5c8c10: Status 404 returned error can't find the container with id 599394bbec4f3cac57cd374c335726b92ff664b9c927f03f2322bf45af5c8c10 Jun 03 15:43:07.615835 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:07.615780 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd" event={"ID":"6589971e-9447-4d10-8242-99e9eed6d2ad","Type":"ContainerStarted","Data":"599394bbec4f3cac57cd374c335726b92ff664b9c927f03f2322bf45af5c8c10"} Jun 03 15:43:07.753957 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:07.753939 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qr4lb_b6888c28-3ce4-430b-95d7-928a55f82992/node-ca/0.log" Jun 03 15:43:07.919039 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:07.918959 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xcjn7\" (UID: \"d1cdd370-5583-451d-a555-adb7052b603f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:07.919210 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:07.919107 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:43:07.919210 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:07.919181 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls podName:d1cdd370-5583-451d-a555-adb7052b603f nodeName:}" failed. No retries permitted until 2026-06-03 15:43:15.91916102 +0000 UTC m=+155.156908539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-xcjn7" (UID: "d1cdd370-5583-451d-a555-adb7052b603f") : secret "samples-operator-tls" not found Jun 03 15:43:08.020047 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:08.020007 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:08.020213 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:08.020125 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:08.020213 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:08.020168 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:43:08.020339 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:08.020247 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:16.020225978 +0000 UTC m=+155.257973507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : secret "router-metrics-certs-default" not found Jun 03 15:43:08.020339 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:08.020267 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:16.020257519 +0000 UTC m=+155.258005041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : configmap references non-existent config key: service-ca.crt Jun 03 15:43:08.620060 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:08.620020 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" event={"ID":"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa","Type":"ContainerStarted","Data":"99c342bb2f6b4cd37c0511a4e648596f8e2b529f1960c4de3ef4adec64e1bfc1"} Jun 03 15:43:08.645025 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:08.644983 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" podStartSLOduration=2.176908696 podStartE2EDuration="4.644966146s" podCreationTimestamp="2026-06-03 15:43:04 +0000 UTC" firstStartedPulling="2026-06-03 15:43:05.216947079 +0000 UTC m=+144.454694595" lastFinishedPulling="2026-06-03 15:43:07.685004516 +0000 UTC m=+146.922752045" observedRunningTime="2026-06-03 15:43:08.644449215 +0000 UTC m=+147.882196765" watchObservedRunningTime="2026-06-03 15:43:08.644966146 +0000 UTC m=+147.882713679" Jun 03 15:43:09.627643 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:09.627599 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd" event={"ID":"6589971e-9447-4d10-8242-99e9eed6d2ad","Type":"ContainerStarted","Data":"351ed01e136e2af26050931abc3650d6f3789d1f59667853f87cf379021a7ce4"} Jun 03 15:43:09.628030 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:09.627646 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd" event={"ID":"6589971e-9447-4d10-8242-99e9eed6d2ad","Type":"ContainerStarted","Data":"1965196bdfaaaf291ae6b79eb94f6b51c0b017fcbf26a6f806a3cbcd0806318a"} Jun 03 15:43:09.656688 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:09.656644 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-hqsgd" podStartSLOduration=1.9778866800000001 podStartE2EDuration="3.656632322s" podCreationTimestamp="2026-06-03 15:43:06 +0000 UTC" firstStartedPulling="2026-06-03 15:43:07.119831649 +0000 UTC m=+146.357579179" lastFinishedPulling="2026-06-03 15:43:08.798577295 +0000 UTC m=+148.036324821" observedRunningTime="2026-06-03 15:43:09.65620796 +0000 UTC m=+148.893955499" watchObservedRunningTime="2026-06-03 15:43:09.656632322 +0000 UTC m=+148.894379907" Jun 03 15:43:11.177500 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.177472 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-sqwbz"] Jun 03 15:43:11.180349 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.180333 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-sqwbz" Jun 03 15:43:11.184597 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.184577 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 15:43:11.184699 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.184577 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 15:43:11.184985 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.184966 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 15:43:11.185225 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.185209 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-65mwd\"" Jun 03 15:43:11.185316 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.185256 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 15:43:11.196144 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.196124 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-sqwbz"] Jun 03 15:43:11.243659 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.243627 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/884020fc-1421-44fe-b7f7-fe0e89d7a510-signing-key\") pod \"service-ca-685df94d57-sqwbz\" (UID: \"884020fc-1421-44fe-b7f7-fe0e89d7a510\") " pod="openshift-service-ca/service-ca-685df94d57-sqwbz" Jun 03 15:43:11.243842 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.243812 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/884020fc-1421-44fe-b7f7-fe0e89d7a510-signing-cabundle\") pod \"service-ca-685df94d57-sqwbz\" (UID: \"884020fc-1421-44fe-b7f7-fe0e89d7a510\") " pod="openshift-service-ca/service-ca-685df94d57-sqwbz" Jun 03 15:43:11.243971 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.243939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d7cd\" (UniqueName: \"kubernetes.io/projected/884020fc-1421-44fe-b7f7-fe0e89d7a510-kube-api-access-5d7cd\") pod \"service-ca-685df94d57-sqwbz\" (UID: \"884020fc-1421-44fe-b7f7-fe0e89d7a510\") " pod="openshift-service-ca/service-ca-685df94d57-sqwbz" Jun 03 15:43:11.344623 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.344582 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5d7cd\" (UniqueName: \"kubernetes.io/projected/884020fc-1421-44fe-b7f7-fe0e89d7a510-kube-api-access-5d7cd\") pod \"service-ca-685df94d57-sqwbz\" (UID: \"884020fc-1421-44fe-b7f7-fe0e89d7a510\") " pod="openshift-service-ca/service-ca-685df94d57-sqwbz" Jun 03 15:43:11.344762 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.344680 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/884020fc-1421-44fe-b7f7-fe0e89d7a510-signing-key\") pod \"service-ca-685df94d57-sqwbz\" (UID: \"884020fc-1421-44fe-b7f7-fe0e89d7a510\") " pod="openshift-service-ca/service-ca-685df94d57-sqwbz" Jun 03 15:43:11.344819 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.344803 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/884020fc-1421-44fe-b7f7-fe0e89d7a510-signing-cabundle\") pod \"service-ca-685df94d57-sqwbz\" (UID: \"884020fc-1421-44fe-b7f7-fe0e89d7a510\") " pod="openshift-service-ca/service-ca-685df94d57-sqwbz" Jun 03 15:43:11.345427 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.345409 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/884020fc-1421-44fe-b7f7-fe0e89d7a510-signing-cabundle\") pod \"service-ca-685df94d57-sqwbz\" (UID: \"884020fc-1421-44fe-b7f7-fe0e89d7a510\") " pod="openshift-service-ca/service-ca-685df94d57-sqwbz" Jun 03 15:43:11.347049 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.347034 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/884020fc-1421-44fe-b7f7-fe0e89d7a510-signing-key\") pod \"service-ca-685df94d57-sqwbz\" (UID: \"884020fc-1421-44fe-b7f7-fe0e89d7a510\") " pod="openshift-service-ca/service-ca-685df94d57-sqwbz" Jun 03 15:43:11.354789 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.354769 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d7cd\" (UniqueName: \"kubernetes.io/projected/884020fc-1421-44fe-b7f7-fe0e89d7a510-kube-api-access-5d7cd\") pod \"service-ca-685df94d57-sqwbz\" (UID: \"884020fc-1421-44fe-b7f7-fe0e89d7a510\") " pod="openshift-service-ca/service-ca-685df94d57-sqwbz" Jun 03 15:43:11.488316 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.488288 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-sqwbz" Jun 03 15:43:11.616981 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.616946 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-sqwbz"] Jun 03 15:43:11.622091 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:11.622064 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884020fc_1421_44fe_b7f7_fe0e89d7a510.slice/crio-84c4e9d94c6c221fe9fe5f9c332d08d4cc3332f5288e90af6492f11268802beb WatchSource:0}: Error finding container 84c4e9d94c6c221fe9fe5f9c332d08d4cc3332f5288e90af6492f11268802beb: Status 404 returned error can't find the container with id 84c4e9d94c6c221fe9fe5f9c332d08d4cc3332f5288e90af6492f11268802beb Jun 03 15:43:11.633351 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:11.633325 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-sqwbz" event={"ID":"884020fc-1421-44fe-b7f7-fe0e89d7a510","Type":"ContainerStarted","Data":"84c4e9d94c6c221fe9fe5f9c332d08d4cc3332f5288e90af6492f11268802beb"} Jun 03 15:43:12.637160 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:12.637123 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-sqwbz" event={"ID":"884020fc-1421-44fe-b7f7-fe0e89d7a510","Type":"ContainerStarted","Data":"9c1f80a59724f17e46ba8ef9922fb9143cde536c5ff3c91e5facdf780c596a96"} Jun 03 15:43:12.665196 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:12.665149 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-sqwbz" podStartSLOduration=1.665135411 podStartE2EDuration="1.665135411s" podCreationTimestamp="2026-06-03 15:43:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:43:12.662933193 +0000 UTC m=+151.900680736" watchObservedRunningTime="2026-06-03 15:43:12.665135411 +0000 UTC m=+151.902882951" Jun 03 15:43:15.984101 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:15.984066 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xcjn7\" (UID: \"d1cdd370-5583-451d-a555-adb7052b603f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:15.986459 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:15.986438 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1cdd370-5583-451d-a555-adb7052b603f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-xcjn7\" (UID: \"d1cdd370-5583-451d-a555-adb7052b603f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:16.070694 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:16.070672 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" Jun 03 15:43:16.084445 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:16.084421 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:16.084530 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:16.084498 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:16.084608 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:16.084589 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:43:16.084644 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:16.084633 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:32.084619268 +0000 UTC m=+171.322366785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : configmap references non-existent config key: service-ca.crt Jun 03 15:43:16.084690 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:16.084659 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs podName:d10fe152-c199-408e-9552-04e3be42bb28 nodeName:}" failed. No retries permitted until 2026-06-03 15:43:32.084639188 +0000 UTC m=+171.322386727 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs") pod "router-default-64c87cbd65-8xckp" (UID: "d10fe152-c199-408e-9552-04e3be42bb28") : secret "router-metrics-certs-default" not found Jun 03 15:43:16.203861 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:16.203831 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7"] Jun 03 15:43:16.650485 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:16.650408 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" event={"ID":"d1cdd370-5583-451d-a555-adb7052b603f","Type":"ContainerStarted","Data":"db4b775f27494e7693bac39a28de36942dc2648e78b7eb096fe0dd8029ec8577"} Jun 03 15:43:18.657460 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:18.657423 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" event={"ID":"d1cdd370-5583-451d-a555-adb7052b603f","Type":"ContainerStarted","Data":"831a45d96104a7203d7717ff6800bb86821f07240cb51f203070608777c78b9c"} Jun 03 15:43:18.657460 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:18.657465 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" event={"ID":"d1cdd370-5583-451d-a555-adb7052b603f","Type":"ContainerStarted","Data":"b173dc405690541e2c6d20fdf59219411177fbefdf6d2ac8bdb5f02dbf62eec0"} Jun 03 15:43:18.685123 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:18.683911 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-xcjn7" podStartSLOduration=16.756631608 podStartE2EDuration="18.683891128s" podCreationTimestamp="2026-06-03 15:43:00 +0000 UTC" firstStartedPulling="2026-06-03 15:43:16.245343741 +0000 UTC m=+155.483091258" lastFinishedPulling="2026-06-03 15:43:18.172603256 +0000 UTC m=+157.410350778" observedRunningTime="2026-06-03 15:43:18.681659225 +0000 UTC m=+157.919406765" watchObservedRunningTime="2026-06-03 15:43:18.683891128 +0000 UTC m=+157.921638670" Jun 03 15:43:21.204509 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:21.204464 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" podUID="064365c0-34c0-4700-b4a6-cb817ef192cb" Jun 03 15:43:21.222606 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:21.222573 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" podUID="ae750873-93db-4ebd-8d5d-990e0c4b62c3" Jun 03 15:43:21.243682 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:21.243648 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6jw7w" podUID="d80b1c9c-ed86-407b-a9c8-aa8ce7277222" Jun 03 15:43:21.264345 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:21.264321 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-llzgd" podUID="1c22f0a9-6788-4c37-89a6-5ab6de86ef60" Jun 03 15:43:21.269484 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:43:21.269459 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-hgfm9" podUID="cf2341d0-e5ac-46b5-af12-20dadc47c445" Jun 03 15:43:21.664670 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:21.664639 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:43:21.664816 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:21.664639 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jw7w" Jun 03 15:43:26.165245 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.165210 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:43:26.165699 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.165269 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:43:26.165699 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.165291 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:43:26.167700 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.167669 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae750873-93db-4ebd-8d5d-990e0c4b62c3-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwqfc\" (UID: \"ae750873-93db-4ebd-8d5d-990e0c4b62c3\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:43:26.167973 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.167953 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d80b1c9c-ed86-407b-a9c8-aa8ce7277222-metrics-tls\") pod \"dns-default-6jw7w\" (UID: \"d80b1c9c-ed86-407b-a9c8-aa8ce7277222\") " pod="openshift-dns/dns-default-6jw7w" Jun 03 15:43:26.168121 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.168100 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"image-registry-84b87c9f58-fspwj\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:43:26.265843 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.265815 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:43:26.268087 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.268068 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf2341d0-e5ac-46b5-af12-20dadc47c445-cert\") pod \"ingress-canary-hgfm9\" (UID: \"cf2341d0-e5ac-46b5-af12-20dadc47c445\") " pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:43:26.469387 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.469361 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4ph84\"" Jun 03 15:43:26.469387 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.469381 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2z9xs\"" Jun 03 15:43:26.476725 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.476706 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:43:26.476824 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.476814 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jw7w" Jun 03 15:43:26.620453 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.620422 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6jw7w"] Jun 03 15:43:26.623869 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:26.623842 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80b1c9c_ed86_407b_a9c8_aa8ce7277222.slice/crio-6076b9d802537562a0c09ab911709b43ffe469079e09de5b6fa8df04fe3a1840 WatchSource:0}: Error finding container 6076b9d802537562a0c09ab911709b43ffe469079e09de5b6fa8df04fe3a1840: Status 404 returned error can't find the container with id 6076b9d802537562a0c09ab911709b43ffe469079e09de5b6fa8df04fe3a1840 Jun 03 15:43:26.640537 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.640515 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84b87c9f58-fspwj"] Jun 03 15:43:26.643429 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:26.643409 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064365c0_34c0_4700_b4a6_cb817ef192cb.slice/crio-319d3833ffd8e83cde0c292739f59acb1ac7f20eab47a7f9772eb4d57f49a36a WatchSource:0}: Error finding container 319d3833ffd8e83cde0c292739f59acb1ac7f20eab47a7f9772eb4d57f49a36a: Status 404 returned error can't find the container with id 319d3833ffd8e83cde0c292739f59acb1ac7f20eab47a7f9772eb4d57f49a36a Jun 03 15:43:26.677703 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.677679 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" event={"ID":"064365c0-34c0-4700-b4a6-cb817ef192cb","Type":"ContainerStarted","Data":"319d3833ffd8e83cde0c292739f59acb1ac7f20eab47a7f9772eb4d57f49a36a"} Jun 03 15:43:26.678828 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:26.678801 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jw7w" event={"ID":"d80b1c9c-ed86-407b-a9c8-aa8ce7277222","Type":"ContainerStarted","Data":"6076b9d802537562a0c09ab911709b43ffe469079e09de5b6fa8df04fe3a1840"} Jun 03 15:43:27.683077 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:27.683034 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" event={"ID":"064365c0-34c0-4700-b4a6-cb817ef192cb","Type":"ContainerStarted","Data":"73dd7cf0ee417284441242468dc336916da8fb331fbdd36ebbdac5d181fd67e3"} Jun 03 15:43:27.683533 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:27.683163 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:43:28.687501 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:28.687414 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jw7w" event={"ID":"d80b1c9c-ed86-407b-a9c8-aa8ce7277222","Type":"ContainerStarted","Data":"beb171cd6bb3ef0de654b2f98858b85d0ac48657735add37944bbf242b59f203"} Jun 03 15:43:28.687501 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:28.687452 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jw7w" event={"ID":"d80b1c9c-ed86-407b-a9c8-aa8ce7277222","Type":"ContainerStarted","Data":"3034a9171d3e61f0d5674e9e0fe56e50f35a584014cb8af413e64ce99051e8b1"} Jun 03 15:43:28.687996 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:28.687743 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6jw7w" Jun 03 15:43:28.709540 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:28.709499 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" podStartSLOduration=167.709488173 podStartE2EDuration="2m47.709488173s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:43:27.711263305 +0000 UTC m=+166.949010844" watchObservedRunningTime="2026-06-03 15:43:28.709488173 +0000 UTC m=+167.947235711" Jun 03 15:43:28.709652 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:28.709592 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-6jw7w" podStartSLOduration=129.057694206 podStartE2EDuration="2m10.709588266s" podCreationTimestamp="2026-06-03 15:41:18 +0000 UTC" firstStartedPulling="2026-06-03 15:43:26.625651873 +0000 UTC m=+165.863399392" lastFinishedPulling="2026-06-03 15:43:28.277545919 +0000 UTC m=+167.515293452" observedRunningTime="2026-06-03 15:43:28.709374941 +0000 UTC m=+167.947122479" watchObservedRunningTime="2026-06-03 15:43:28.709588266 +0000 UTC m=+167.947335816" Jun 03 15:43:31.725003 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.724971 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l22gp"] Jun 03 15:43:31.728116 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.728099 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.732190 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.732169 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 15:43:31.732575 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.732562 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 15:43:31.733015 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.732997 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 15:43:31.733838 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.733823 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2w7fl\"" Jun 03 15:43:31.734160 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.734133 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 15:43:31.754007 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.753989 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l22gp"] Jun 03 15:43:31.806425 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.806397 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jf2d\" (UniqueName: \"kubernetes.io/projected/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-kube-api-access-5jf2d\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.806532 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.806430 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-crio-socket\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.806532 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.806454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.806532 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.806506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.806532 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.806529 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-data-volume\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.906840 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.906813 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.906953 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.906847 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-data-volume\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.906953 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.906916 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jf2d\" (UniqueName: \"kubernetes.io/projected/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-kube-api-access-5jf2d\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.906953 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.906943 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-crio-socket\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.907076 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.907064 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.907207 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.907176 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-crio-socket\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.907335 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.907317 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-data-volume\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.907592 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.907572 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.909328 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.909300 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:31.922343 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:31.922294 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jf2d\" (UniqueName: \"kubernetes.io/projected/6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7-kube-api-access-5jf2d\") pod \"insights-runtime-extractor-l22gp\" (UID: \"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7\") " pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:32.037439 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.037353 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l22gp" Jun 03 15:43:32.108671 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.108638 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:32.108881 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.108694 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:32.109263 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.109242 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d10fe152-c199-408e-9552-04e3be42bb28-service-ca-bundle\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:32.110997 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.110977 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d10fe152-c199-408e-9552-04e3be42bb28-metrics-certs\") pod \"router-default-64c87cbd65-8xckp\" (UID: \"d10fe152-c199-408e-9552-04e3be42bb28\") " pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:32.172595 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.172564 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l22gp"] Jun 03 15:43:32.175287 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:32.175263 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1b4341_2c9a_474d_a1ed_bd8e533ff7b7.slice/crio-e01bbb329503fcad1d6c4213b27a37a900e15990733ad75d6516123838f6e143 WatchSource:0}: Error finding container e01bbb329503fcad1d6c4213b27a37a900e15990733ad75d6516123838f6e143: Status 404 returned error can't find the container with id e01bbb329503fcad1d6c4213b27a37a900e15990733ad75d6516123838f6e143 Jun 03 15:43:32.287693 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.287617 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:32.410711 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.410655 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64c87cbd65-8xckp"] Jun 03 15:43:32.416348 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:32.416324 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10fe152_c199_408e_9552_04e3be42bb28.slice/crio-0d4248bd96890e1c070c1c4f540153cd9000670385865c79cf8653cabf34c057 WatchSource:0}: Error finding container 0d4248bd96890e1c070c1c4f540153cd9000670385865c79cf8653cabf34c057: Status 404 returned error can't find the container with id 0d4248bd96890e1c070c1c4f540153cd9000670385865c79cf8653cabf34c057 Jun 03 15:43:32.699688 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.699612 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l22gp" event={"ID":"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7","Type":"ContainerStarted","Data":"d0816fcda14fe195c7aa29ec9450ee7ef97e11cd1df12d95d3b9ef64d446787c"} Jun 03 15:43:32.699688 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.699651 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l22gp" event={"ID":"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7","Type":"ContainerStarted","Data":"e01bbb329503fcad1d6c4213b27a37a900e15990733ad75d6516123838f6e143"} Jun 03 15:43:32.700761 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.700737 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64c87cbd65-8xckp" event={"ID":"d10fe152-c199-408e-9552-04e3be42bb28","Type":"ContainerStarted","Data":"3c9e197ca096bebd766c6a2b59a3213108166ff4157126ef6e3224c2579a150e"} Jun 03 15:43:32.700863 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:32.700765 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64c87cbd65-8xckp" event={"ID":"d10fe152-c199-408e-9552-04e3be42bb28","Type":"ContainerStarted","Data":"0d4248bd96890e1c070c1c4f540153cd9000670385865c79cf8653cabf34c057"} Jun 03 15:43:33.241585 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:33.241551 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:43:33.248056 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:33.248036 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f2mct\"" Jun 03 15:43:33.252084 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:33.252067 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hgfm9" Jun 03 15:43:33.288256 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:33.288171 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:33.290732 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:33.290695 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:33.355053 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:33.355004 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-64c87cbd65-8xckp" podStartSLOduration=33.354988016 podStartE2EDuration="33.354988016s" podCreationTimestamp="2026-06-03 15:43:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:43:32.77413286 +0000 UTC m=+172.011880398" watchObservedRunningTime="2026-06-03 15:43:33.354988016 +0000 UTC m=+172.592735549" Jun 03 15:43:33.395136 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:33.395111 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hgfm9"] Jun 03 15:43:33.398139 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:33.398115 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf2341d0_e5ac_46b5_af12_20dadc47c445.slice/crio-da27c15dfeb49680eb86f53efd8d888ee0f7ea9270364c977cdfc9aa53321148 WatchSource:0}: Error finding container da27c15dfeb49680eb86f53efd8d888ee0f7ea9270364c977cdfc9aa53321148: Status 404 returned error can't find the container with id da27c15dfeb49680eb86f53efd8d888ee0f7ea9270364c977cdfc9aa53321148 Jun 03 15:43:33.704292 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:33.704223 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l22gp" event={"ID":"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7","Type":"ContainerStarted","Data":"28db48c21ac97bf37813f0a82bd54af5a57f7c4b25cf2906f04482dcd7d29137"} Jun 03 15:43:33.705218 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:33.705193 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hgfm9" event={"ID":"cf2341d0-e5ac-46b5-af12-20dadc47c445","Type":"ContainerStarted","Data":"da27c15dfeb49680eb86f53efd8d888ee0f7ea9270364c977cdfc9aa53321148"} Jun 03 15:43:33.705460 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:33.705450 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:33.706789 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:33.706767 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64c87cbd65-8xckp" Jun 03 15:43:35.241593 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:35.241555 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:43:35.249073 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:35.249052 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9wth5\"" Jun 03 15:43:35.252115 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:35.252099 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" Jun 03 15:43:35.384791 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:35.384761 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc"] Jun 03 15:43:35.387853 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:35.387827 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae750873_93db_4ebd_8d5d_990e0c4b62c3.slice/crio-072105b620740027249bd75a52c95afdf4ba15d0ce67c89148aa8dfa63a9701c WatchSource:0}: Error finding container 072105b620740027249bd75a52c95afdf4ba15d0ce67c89148aa8dfa63a9701c: Status 404 returned error can't find the container with id 072105b620740027249bd75a52c95afdf4ba15d0ce67c89148aa8dfa63a9701c Jun 03 15:43:35.710968 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:35.710942 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" event={"ID":"ae750873-93db-4ebd-8d5d-990e0c4b62c3","Type":"ContainerStarted","Data":"072105b620740027249bd75a52c95afdf4ba15d0ce67c89148aa8dfa63a9701c"} Jun 03 15:43:35.712560 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:35.712527 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l22gp" event={"ID":"6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7","Type":"ContainerStarted","Data":"18dd45a6fdae116db18dd7c8f9241cef7106dabf736d1a61889f36f0e7356959"} Jun 03 15:43:35.713867 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:35.713838 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hgfm9" event={"ID":"cf2341d0-e5ac-46b5-af12-20dadc47c445","Type":"ContainerStarted","Data":"a01f4b2cfcf5b27d92edf1cb9c60d0dfff2bc1c30b12c6980c2670e7506300c8"} Jun 03 15:43:35.740267 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:35.740233 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l22gp" podStartSLOduration=1.962037472 podStartE2EDuration="4.740222717s" podCreationTimestamp="2026-06-03 15:43:31 +0000 UTC" firstStartedPulling="2026-06-03 15:43:32.272385817 +0000 UTC m=+171.510133334" lastFinishedPulling="2026-06-03 15:43:35.050571052 +0000 UTC m=+174.288318579" observedRunningTime="2026-06-03 15:43:35.740010002 +0000 UTC m=+174.977757541" watchObservedRunningTime="2026-06-03 15:43:35.740222717 +0000 UTC m=+174.977970256" Jun 03 15:43:35.766826 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:35.766789 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hgfm9" podStartSLOduration=136.112258429 podStartE2EDuration="2m17.766778273s" podCreationTimestamp="2026-06-03 15:41:18 +0000 UTC" firstStartedPulling="2026-06-03 15:43:33.399994456 +0000 UTC m=+172.637741973" lastFinishedPulling="2026-06-03 15:43:35.054514293 +0000 UTC m=+174.292261817" observedRunningTime="2026-06-03 15:43:35.765673128 +0000 UTC m=+175.003420660" watchObservedRunningTime="2026-06-03 15:43:35.766778273 +0000 UTC m=+175.004525812" Jun 03 15:43:36.242014 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:36.241984 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:43:36.718079 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:36.718045 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" event={"ID":"ae750873-93db-4ebd-8d5d-990e0c4b62c3","Type":"ContainerStarted","Data":"02a26e8df63bd9d3a270fd86ed04ea3ac04f672dbd03af800434c9f9a474829e"} Jun 03 15:43:38.692797 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:38.692768 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6jw7w" Jun 03 15:43:38.727068 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:38.727021 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwqfc" podStartSLOduration=169.489319766 podStartE2EDuration="2m50.727006026s" podCreationTimestamp="2026-06-03 15:40:48 +0000 UTC" firstStartedPulling="2026-06-03 15:43:35.389791775 +0000 UTC m=+174.627539292" lastFinishedPulling="2026-06-03 15:43:36.627478033 +0000 UTC m=+175.865225552" observedRunningTime="2026-06-03 15:43:36.750525039 +0000 UTC m=+175.988272577" watchObservedRunningTime="2026-06-03 15:43:38.727006026 +0000 UTC m=+177.964753583" Jun 03 15:43:40.444417 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.444387 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cff85fc8f-v2tlf"] Jun 03 15:43:40.448639 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.448622 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.453688 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.453662 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 15:43:40.453688 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.453677 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 15:43:40.453905 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.453889 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 15:43:40.454001 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.453920 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 15:43:40.454816 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.454791 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 15:43:40.454893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.454862 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 15:43:40.454949 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.454907 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wxcxx\"" Jun 03 15:43:40.455003 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.454968 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 15:43:40.462428 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.462408 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 15:43:40.476060 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.476040 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cff85fc8f-v2tlf"] Jun 03 15:43:40.584003 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.583972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-serving-cert\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.584003 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.584003 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-service-ca\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.584181 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.584026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-oauth-serving-cert\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.584181 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.584125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hglnh\" (UniqueName: \"kubernetes.io/projected/b2ed2237-c166-46a2-9609-d09305805280-kube-api-access-hglnh\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.584181 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.584163 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-console-config\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.584276 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.584194 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-oauth-config\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.584276 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.584209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-trusted-ca-bundle\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.685420 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.685389 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-serving-cert\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.685420 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.685422 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-service-ca\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.685605 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.685442 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-oauth-serving-cert\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.685605 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.685466 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hglnh\" (UniqueName: \"kubernetes.io/projected/b2ed2237-c166-46a2-9609-d09305805280-kube-api-access-hglnh\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.685605 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.685484 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-console-config\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.685605 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.685517 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-oauth-config\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.685605 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.685571 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-trusted-ca-bundle\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.686289 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.686261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-oauth-serving-cert\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.686409 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.686295 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-console-config\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.686409 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.686266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-service-ca\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.686491 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.686459 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-trusted-ca-bundle\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.688073 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.688054 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-oauth-config\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.688272 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.688252 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-serving-cert\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.702070 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.702016 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hglnh\" (UniqueName: \"kubernetes.io/projected/b2ed2237-c166-46a2-9609-d09305805280-kube-api-access-hglnh\") pod \"console-7cff85fc8f-v2tlf\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.757642 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.757604 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:40.898980 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:40.898941 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cff85fc8f-v2tlf"] Jun 03 15:43:40.904003 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:40.903975 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ed2237_c166_46a2_9609_d09305805280.slice/crio-b5ff44b8bcb7da93c13c44f99cc5ae3770a48bcc5c6347940d4024563063c403 WatchSource:0}: Error finding container b5ff44b8bcb7da93c13c44f99cc5ae3770a48bcc5c6347940d4024563063c403: Status 404 returned error can't find the container with id b5ff44b8bcb7da93c13c44f99cc5ae3770a48bcc5c6347940d4024563063c403 Jun 03 15:43:41.734337 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:41.734296 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cff85fc8f-v2tlf" event={"ID":"b2ed2237-c166-46a2-9609-d09305805280","Type":"ContainerStarted","Data":"b5ff44b8bcb7da93c13c44f99cc5ae3770a48bcc5c6347940d4024563063c403"} Jun 03 15:43:43.740734 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:43.740633 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cff85fc8f-v2tlf" event={"ID":"b2ed2237-c166-46a2-9609-d09305805280","Type":"ContainerStarted","Data":"97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a"} Jun 03 15:43:43.767944 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:43.767773 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7cff85fc8f-v2tlf" podStartSLOduration=1.202869478 podStartE2EDuration="3.767757472s" podCreationTimestamp="2026-06-03 15:43:40 +0000 UTC" firstStartedPulling="2026-06-03 15:43:40.905789506 +0000 UTC m=+180.143537023" lastFinishedPulling="2026-06-03 15:43:43.470677499 +0000 UTC m=+182.708425017" observedRunningTime="2026-06-03 15:43:43.766574185 +0000 UTC m=+183.004321734" watchObservedRunningTime="2026-06-03 15:43:43.767757472 +0000 UTC m=+183.005505011" Jun 03 15:43:44.790229 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.790193 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-25sd5"] Jun 03 15:43:44.792492 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.792465 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:44.797462 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.797431 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 15:43:44.797792 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.797764 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 15:43:44.798546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.798524 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 15:43:44.799168 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.799135 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 15:43:44.799368 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.799341 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 15:43:44.799505 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.799483 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 15:43:44.799582 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.799158 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-blgxq\"" Jun 03 15:43:44.921490 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.921445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c48277cf-010d-4225-a9b7-409a4e3cf8d7-sys\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:44.921490 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.921493 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-tls\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:44.921686 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.921523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c48277cf-010d-4225-a9b7-409a4e3cf8d7-metrics-client-ca\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:44.921686 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.921544 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt8hs\" (UniqueName: \"kubernetes.io/projected/c48277cf-010d-4225-a9b7-409a4e3cf8d7-kube-api-access-qt8hs\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:44.921686 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.921631 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:44.921686 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.921670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-wtmp\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:44.921852 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.921695 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-textfile\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:44.921852 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.921714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c48277cf-010d-4225-a9b7-409a4e3cf8d7-root\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:44.921852 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:44.921772 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023047 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023009 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023047 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023051 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-wtmp\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023069 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-textfile\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023087 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c48277cf-010d-4225-a9b7-409a4e3cf8d7-root\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023115 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023163 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c48277cf-010d-4225-a9b7-409a4e3cf8d7-sys\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023190 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-tls\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023213 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c48277cf-010d-4225-a9b7-409a4e3cf8d7-metrics-client-ca\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023221 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c48277cf-010d-4225-a9b7-409a4e3cf8d7-root\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023233 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-wtmp\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023238 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qt8hs\" (UniqueName: \"kubernetes.io/projected/c48277cf-010d-4225-a9b7-409a4e3cf8d7-kube-api-access-qt8hs\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023734 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023339 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c48277cf-010d-4225-a9b7-409a4e3cf8d7-sys\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.023734 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023456 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-textfile\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.024009 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023850 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.024009 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.023909 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c48277cf-010d-4225-a9b7-409a4e3cf8d7-metrics-client-ca\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.025583 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.025562 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.025688 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.025648 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c48277cf-010d-4225-a9b7-409a4e3cf8d7-node-exporter-tls\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.037733 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.037697 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt8hs\" (UniqueName: \"kubernetes.io/projected/c48277cf-010d-4225-a9b7-409a4e3cf8d7-kube-api-access-qt8hs\") pod \"node-exporter-25sd5\" (UID: \"c48277cf-010d-4225-a9b7-409a4e3cf8d7\") " pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.107178 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.107103 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-25sd5" Jun 03 15:43:45.115227 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:45.115201 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48277cf_010d_4225_a9b7_409a4e3cf8d7.slice/crio-5017c2dafe18cdcbaf4bc38da6a2cd2d3731b52e4b2efb520eb6ab214c7aabd9 WatchSource:0}: Error finding container 5017c2dafe18cdcbaf4bc38da6a2cd2d3731b52e4b2efb520eb6ab214c7aabd9: Status 404 returned error can't find the container with id 5017c2dafe18cdcbaf4bc38da6a2cd2d3731b52e4b2efb520eb6ab214c7aabd9 Jun 03 15:43:45.747088 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:45.747032 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-25sd5" event={"ID":"c48277cf-010d-4225-a9b7-409a4e3cf8d7","Type":"ContainerStarted","Data":"5017c2dafe18cdcbaf4bc38da6a2cd2d3731b52e4b2efb520eb6ab214c7aabd9"} Jun 03 15:43:46.480616 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:46.480582 2566 patch_prober.go:28] interesting pod/image-registry-84b87c9f58-fspwj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 15:43:46.481010 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:46.480638 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" podUID="064365c0-34c0-4700-b4a6-cb817ef192cb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 15:43:46.751765 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:46.751670 2566 generic.go:358] "Generic (PLEG): container finished" podID="c48277cf-010d-4225-a9b7-409a4e3cf8d7" containerID="08f4090002ee9fc5ffb253500cd7787bf1229815f88f13c37232ff3cb16ab60d" exitCode=0 Jun 03 15:43:46.751889 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:46.751761 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-25sd5" event={"ID":"c48277cf-010d-4225-a9b7-409a4e3cf8d7","Type":"ContainerDied","Data":"08f4090002ee9fc5ffb253500cd7787bf1229815f88f13c37232ff3cb16ab60d"} Jun 03 15:43:47.755790 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.755754 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-25sd5" event={"ID":"c48277cf-010d-4225-a9b7-409a4e3cf8d7","Type":"ContainerStarted","Data":"92a2cf192a035ccfc324cd21a8e67ba131142838dc303b67bce2ed4c0c4f76f4"} Jun 03 15:43:47.755790 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.755790 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-25sd5" event={"ID":"c48277cf-010d-4225-a9b7-409a4e3cf8d7","Type":"ContainerStarted","Data":"9361124b9081bb03b98edc6f4cc9f7e9cdc4f185045a88978edab8bfea14c2f5"} Jun 03 15:43:47.806630 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.806571 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-25sd5" podStartSLOduration=2.7558070900000002 podStartE2EDuration="3.806554511s" podCreationTimestamp="2026-06-03 15:43:44 +0000 UTC" firstStartedPulling="2026-06-03 15:43:45.117175075 +0000 UTC m=+184.354922592" lastFinishedPulling="2026-06-03 15:43:46.167922493 +0000 UTC m=+185.405670013" observedRunningTime="2026-06-03 15:43:47.806035474 +0000 UTC m=+187.043783012" watchObservedRunningTime="2026-06-03 15:43:47.806554511 +0000 UTC m=+187.044302051" Jun 03 15:43:47.901834 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.901806 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6fb7fc764d-rsg94"] Jun 03 15:43:47.904394 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.904378 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:47.908406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.908378 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 15:43:47.908737 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.908692 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 15:43:47.908846 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.908740 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 15:43:47.909027 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.909012 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-atnmi52bkjqlr\"" Jun 03 15:43:47.909086 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.909066 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qh54b\"" Jun 03 15:43:47.910080 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.910052 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 15:43:47.910643 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.910629 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 15:43:47.925696 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:47.925668 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fb7fc764d-rsg94"] Jun 03 15:43:48.047609 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.047512 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.047609 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.047560 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98fvq\" (UniqueName: \"kubernetes.io/projected/65029175-2136-4df0-af63-d33288f33245-kube-api-access-98fvq\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.047609 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.047584 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.047921 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.047684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-tls\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.047921 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.047752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.047921 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.047773 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-grpc-tls\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.047921 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.047799 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.047921 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.047814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65029175-2136-4df0-af63-d33288f33245-metrics-client-ca\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.148577 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.148544 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.148739 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.148589 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98fvq\" (UniqueName: \"kubernetes.io/projected/65029175-2136-4df0-af63-d33288f33245-kube-api-access-98fvq\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.148739 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.148617 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.148739 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.148674 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-tls\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.148739 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.148700 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.148965 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.148743 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-grpc-tls\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.148965 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.148783 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.148965 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.148806 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65029175-2136-4df0-af63-d33288f33245-metrics-client-ca\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.149663 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.149638 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65029175-2136-4df0-af63-d33288f33245-metrics-client-ca\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.151708 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.151675 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-grpc-tls\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.151825 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.151792 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.151942 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.151919 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-tls\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.152002 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.151981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.152037 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.151997 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.152037 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.152020 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/65029175-2136-4df0-af63-d33288f33245-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.158823 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.158799 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98fvq\" (UniqueName: \"kubernetes.io/projected/65029175-2136-4df0-af63-d33288f33245-kube-api-access-98fvq\") pod \"thanos-querier-6fb7fc764d-rsg94\" (UID: \"65029175-2136-4df0-af63-d33288f33245\") " pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.214210 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.214185 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:48.367028 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.367007 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fb7fc764d-rsg94"] Jun 03 15:43:48.368948 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:48.368920 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65029175_2136_4df0_af63_d33288f33245.slice/crio-ffc88f7f63f930f44ff03733b94a54c7640f9d80c2a9841d1476e65acca6f66b WatchSource:0}: Error finding container ffc88f7f63f930f44ff03733b94a54c7640f9d80c2a9841d1476e65acca6f66b: Status 404 returned error can't find the container with id ffc88f7f63f930f44ff03733b94a54c7640f9d80c2a9841d1476e65acca6f66b Jun 03 15:43:48.691566 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.691490 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:43:48.759762 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:48.759712 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" event={"ID":"65029175-2136-4df0-af63-d33288f33245","Type":"ContainerStarted","Data":"ffc88f7f63f930f44ff03733b94a54c7640f9d80c2a9841d1476e65acca6f66b"} Jun 03 15:43:49.494027 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:49.493994 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw"] Jun 03 15:43:49.496483 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:49.496461 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw" Jun 03 15:43:49.499676 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:49.499637 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 15:43:49.499676 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:49.499640 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-g7j56\"" Jun 03 15:43:49.511020 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:49.511000 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw"] Jun 03 15:43:49.662314 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:49.662284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6c4c34d-bb35-4c0d-83f1-947b19d10f55-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-ls2bw\" (UID: \"c6c4c34d-bb35-4c0d-83f1-947b19d10f55\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw" Jun 03 15:43:49.763065 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:49.762995 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6c4c34d-bb35-4c0d-83f1-947b19d10f55-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-ls2bw\" (UID: \"c6c4c34d-bb35-4c0d-83f1-947b19d10f55\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw" Jun 03 15:43:49.765503 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:49.765484 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c6c4c34d-bb35-4c0d-83f1-947b19d10f55-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-ls2bw\" (UID: \"c6c4c34d-bb35-4c0d-83f1-947b19d10f55\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw" Jun 03 15:43:49.808975 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:49.808941 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw" Jun 03 15:43:49.953538 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:49.953507 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw"] Jun 03 15:43:49.956860 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:49.956832 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c4c34d_bb35_4c0d_83f1_947b19d10f55.slice/crio-4df9b5c039c5d1828dbc3457a60c6be2c3fc4ab407ffb4473a5468909c7e77c3 WatchSource:0}: Error finding container 4df9b5c039c5d1828dbc3457a60c6be2c3fc4ab407ffb4473a5468909c7e77c3: Status 404 returned error can't find the container with id 4df9b5c039c5d1828dbc3457a60c6be2c3fc4ab407ffb4473a5468909c7e77c3 Jun 03 15:43:50.757746 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:50.757704 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:50.757841 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:50.757755 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:50.762712 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:50.762693 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:50.766685 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:50.766664 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" event={"ID":"65029175-2136-4df0-af63-d33288f33245","Type":"ContainerStarted","Data":"31c1ef9c88cc91a11b24025b9f0f006403f7c45bc728d82e02b64d5309ab6b40"} Jun 03 15:43:50.767004 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:50.766692 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" event={"ID":"65029175-2136-4df0-af63-d33288f33245","Type":"ContainerStarted","Data":"a11c48b4b1cfc9bf3827e694c7e31a30b0ea08922ae7263d7aa03de50b032eda"} Jun 03 15:43:50.767004 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:50.766709 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" event={"ID":"65029175-2136-4df0-af63-d33288f33245","Type":"ContainerStarted","Data":"388cd113d517868cf4c9498546cc36cf68563ab67c5dec89d117ab8ed4f908ab"} Jun 03 15:43:50.767785 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:50.767759 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw" event={"ID":"c6c4c34d-bb35-4c0d-83f1-947b19d10f55","Type":"ContainerStarted","Data":"4df9b5c039c5d1828dbc3457a60c6be2c3fc4ab407ffb4473a5468909c7e77c3"} Jun 03 15:43:50.772979 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:50.772957 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:43:52.020940 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.020900 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f685d8dd5-6hsvw"] Jun 03 15:43:52.025900 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.025875 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f685d8dd5-6hsvw"] Jun 03 15:43:52.026025 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.025996 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.183692 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.183666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-oauth-config\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.183801 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.183712 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-serving-cert\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.183865 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.183800 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-trusted-ca-bundle\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.183865 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.183831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cnwv\" (UniqueName: \"kubernetes.io/projected/9969c7d1-b89d-4102-bf22-133a9adab16a-kube-api-access-9cnwv\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.183947 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.183898 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-oauth-serving-cert\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.183947 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.183925 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-service-ca\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.184024 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.183968 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-console-config\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.285349 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.285281 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-trusted-ca-bundle\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.285349 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.285317 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnwv\" (UniqueName: \"kubernetes.io/projected/9969c7d1-b89d-4102-bf22-133a9adab16a-kube-api-access-9cnwv\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.285349 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.285341 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-oauth-serving-cert\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.285560 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.285357 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-service-ca\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.285560 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.285493 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-console-config\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.285641 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.285575 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-oauth-config\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.285641 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.285609 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-serving-cert\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.286115 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.286080 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-oauth-serving-cert\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.286249 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.286089 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-service-ca\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.286249 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.286226 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-console-config\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.286490 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.286316 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-trusted-ca-bundle\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.288149 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.288125 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-oauth-config\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.288149 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.288141 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-serving-cert\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.297281 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.297262 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnwv\" (UniqueName: \"kubernetes.io/projected/9969c7d1-b89d-4102-bf22-133a9adab16a-kube-api-access-9cnwv\") pod \"console-7f685d8dd5-6hsvw\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.356074 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.356049 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:43:52.493104 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.493074 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f685d8dd5-6hsvw"] Jun 03 15:43:52.496113 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:43:52.496086 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9969c7d1_b89d_4102_bf22_133a9adab16a.slice/crio-9813d2b0bc6a3bbe109ae2bcb08b17688a4cb5a923f650caa5ae8b798f7e8daf WatchSource:0}: Error finding container 9813d2b0bc6a3bbe109ae2bcb08b17688a4cb5a923f650caa5ae8b798f7e8daf: Status 404 returned error can't find the container with id 9813d2b0bc6a3bbe109ae2bcb08b17688a4cb5a923f650caa5ae8b798f7e8daf Jun 03 15:43:52.777325 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.777285 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f685d8dd5-6hsvw" event={"ID":"9969c7d1-b89d-4102-bf22-133a9adab16a","Type":"ContainerStarted","Data":"ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f"} Jun 03 15:43:52.777325 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.777331 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f685d8dd5-6hsvw" event={"ID":"9969c7d1-b89d-4102-bf22-133a9adab16a","Type":"ContainerStarted","Data":"9813d2b0bc6a3bbe109ae2bcb08b17688a4cb5a923f650caa5ae8b798f7e8daf"} Jun 03 15:43:52.779557 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.779524 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" event={"ID":"65029175-2136-4df0-af63-d33288f33245","Type":"ContainerStarted","Data":"403765e08f90897a0b9de3e7a7e83a0978ba1dac9a954d29c900b0fa4dec0a41"} Jun 03 15:43:52.779557 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.779555 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" event={"ID":"65029175-2136-4df0-af63-d33288f33245","Type":"ContainerStarted","Data":"07628be943a0cff8131f65b6ced4fbab1322cb7e8c3bf7a8208f0b380a8d1e03"} Jun 03 15:43:52.779731 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.779568 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" event={"ID":"65029175-2136-4df0-af63-d33288f33245","Type":"ContainerStarted","Data":"b2fab5d51a68c57cbfebfe2051943915c333bb92033512b2bb15d1ebddd2fd82"} Jun 03 15:43:52.779731 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.779702 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:43:52.780651 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.780633 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw" event={"ID":"c6c4c34d-bb35-4c0d-83f1-947b19d10f55","Type":"ContainerStarted","Data":"befb6ab47097acfa59884c026eaea21f7d36c65132dbd46920a964836f70423e"} Jun 03 15:43:52.780834 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.780818 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw" Jun 03 15:43:52.785284 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.785266 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw" Jun 03 15:43:52.807310 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.803270 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f685d8dd5-6hsvw" podStartSLOduration=1.803256733 podStartE2EDuration="1.803256733s" podCreationTimestamp="2026-06-03 15:43:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:43:52.803224568 +0000 UTC m=+192.040972108" watchObservedRunningTime="2026-06-03 15:43:52.803256733 +0000 UTC m=+192.041004278" Jun 03 15:43:52.852559 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.852513 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" podStartSLOduration=2.252995416 podStartE2EDuration="5.852501209s" podCreationTimestamp="2026-06-03 15:43:47 +0000 UTC" firstStartedPulling="2026-06-03 15:43:48.37070586 +0000 UTC m=+187.608453376" lastFinishedPulling="2026-06-03 15:43:51.970211636 +0000 UTC m=+191.207959169" observedRunningTime="2026-06-03 15:43:52.851298042 +0000 UTC m=+192.089045591" watchObservedRunningTime="2026-06-03 15:43:52.852501209 +0000 UTC m=+192.090248748" Jun 03 15:43:52.880058 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:52.880023 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-ls2bw" podStartSLOduration=1.865852545 podStartE2EDuration="3.880013228s" podCreationTimestamp="2026-06-03 15:43:49 +0000 UTC" firstStartedPulling="2026-06-03 15:43:49.958714469 +0000 UTC m=+189.196461986" lastFinishedPulling="2026-06-03 15:43:51.972875148 +0000 UTC m=+191.210622669" observedRunningTime="2026-06-03 15:43:52.877621107 +0000 UTC m=+192.115368646" watchObservedRunningTime="2026-06-03 15:43:52.880013228 +0000 UTC m=+192.117760766" Jun 03 15:43:53.654356 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:53.654319 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84b87c9f58-fspwj"] Jun 03 15:43:56.402934 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:56.402893 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f685d8dd5-6hsvw"] Jun 03 15:43:58.789938 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:43:58.789905 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6fb7fc764d-rsg94" Jun 03 15:44:02.356385 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:02.356350 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:44:07.237777 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:07.237735 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cff85fc8f-v2tlf"] Jun 03 15:44:18.675708 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:18.675635 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" podUID="064365c0-34c0-4700-b4a6-cb817ef192cb" containerName="registry" containerID="cri-o://73dd7cf0ee417284441242468dc336916da8fb331fbdd36ebbdac5d181fd67e3" gracePeriod=30 Jun 03 15:44:18.688434 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:18.688406 2566 patch_prober.go:28] interesting pod/image-registry-84b87c9f58-fspwj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jun 03 15:44:18.688551 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:18.688465 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" podUID="064365c0-34c0-4700-b4a6-cb817ef192cb" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jun 03 15:44:18.858086 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:18.858058 2566 generic.go:358] "Generic (PLEG): container finished" podID="064365c0-34c0-4700-b4a6-cb817ef192cb" containerID="73dd7cf0ee417284441242468dc336916da8fb331fbdd36ebbdac5d181fd67e3" exitCode=0 Jun 03 15:44:18.858211 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:18.858115 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" event={"ID":"064365c0-34c0-4700-b4a6-cb817ef192cb","Type":"ContainerDied","Data":"73dd7cf0ee417284441242468dc336916da8fb331fbdd36ebbdac5d181fd67e3"} Jun 03 15:44:18.925360 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:18.925339 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:44:19.006854 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.006826 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2smc5\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-kube-api-access-2smc5\") pod \"064365c0-34c0-4700-b4a6-cb817ef192cb\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " Jun 03 15:44:19.006990 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.006870 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/064365c0-34c0-4700-b4a6-cb817ef192cb-ca-trust-extracted\") pod \"064365c0-34c0-4700-b4a6-cb817ef192cb\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " Jun 03 15:44:19.006990 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.006896 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-image-registry-private-configuration\") pod \"064365c0-34c0-4700-b4a6-cb817ef192cb\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " Jun 03 15:44:19.006990 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.006924 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") pod \"064365c0-34c0-4700-b4a6-cb817ef192cb\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " Jun 03 15:44:19.006990 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.006947 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-trusted-ca\") pod \"064365c0-34c0-4700-b4a6-cb817ef192cb\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " Jun 03 15:44:19.006990 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.006975 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-bound-sa-token\") pod \"064365c0-34c0-4700-b4a6-cb817ef192cb\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " Jun 03 15:44:19.007281 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.007002 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-certificates\") pod \"064365c0-34c0-4700-b4a6-cb817ef192cb\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " Jun 03 15:44:19.007281 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.007030 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-installation-pull-secrets\") pod \"064365c0-34c0-4700-b4a6-cb817ef192cb\" (UID: \"064365c0-34c0-4700-b4a6-cb817ef192cb\") " Jun 03 15:44:19.007647 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.007583 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "064365c0-34c0-4700-b4a6-cb817ef192cb" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:19.007647 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.007627 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "064365c0-34c0-4700-b4a6-cb817ef192cb" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:19.010085 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.010057 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-kube-api-access-2smc5" (OuterVolumeSpecName: "kube-api-access-2smc5") pod "064365c0-34c0-4700-b4a6-cb817ef192cb" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb"). InnerVolumeSpecName "kube-api-access-2smc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:44:19.010085 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.010058 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "064365c0-34c0-4700-b4a6-cb817ef192cb" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:44:19.010206 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.010132 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "064365c0-34c0-4700-b4a6-cb817ef192cb" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:44:19.010206 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.010161 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "064365c0-34c0-4700-b4a6-cb817ef192cb" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:44:19.010380 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.010268 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "064365c0-34c0-4700-b4a6-cb817ef192cb" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:44:19.016277 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.016254 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/064365c0-34c0-4700-b4a6-cb817ef192cb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "064365c0-34c0-4700-b4a6-cb817ef192cb" (UID: "064365c0-34c0-4700-b4a6-cb817ef192cb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:44:19.107614 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.107584 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-bound-sa-token\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:19.107614 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.107610 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-certificates\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:19.107795 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.107622 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-installation-pull-secrets\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:19.107795 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.107631 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2smc5\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-kube-api-access-2smc5\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:19.107795 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.107640 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/064365c0-34c0-4700-b4a6-cb817ef192cb-ca-trust-extracted\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:19.107795 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.107649 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/064365c0-34c0-4700-b4a6-cb817ef192cb-image-registry-private-configuration\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:19.107795 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.107658 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/064365c0-34c0-4700-b4a6-cb817ef192cb-registry-tls\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:19.107795 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.107666 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/064365c0-34c0-4700-b4a6-cb817ef192cb-trusted-ca\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:19.862338 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.862305 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" event={"ID":"064365c0-34c0-4700-b4a6-cb817ef192cb","Type":"ContainerDied","Data":"319d3833ffd8e83cde0c292739f59acb1ac7f20eab47a7f9772eb4d57f49a36a"} Jun 03 15:44:19.862751 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.862342 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84b87c9f58-fspwj" Jun 03 15:44:19.862751 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.862346 2566 scope.go:117] "RemoveContainer" containerID="73dd7cf0ee417284441242468dc336916da8fb331fbdd36ebbdac5d181fd67e3" Jun 03 15:44:19.885706 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.885684 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84b87c9f58-fspwj"] Jun 03 15:44:19.888968 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:19.888950 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-84b87c9f58-fspwj"] Jun 03 15:44:21.245965 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.245931 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="064365c0-34c0-4700-b4a6-cb817ef192cb" path="/var/lib/kubelet/pods/064365c0-34c0-4700-b4a6-cb817ef192cb/volumes" Jun 03 15:44:21.422687 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.422650 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f685d8dd5-6hsvw" podUID="9969c7d1-b89d-4102-bf22-133a9adab16a" containerName="console" containerID="cri-o://ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f" gracePeriod=15 Jun 03 15:44:21.663946 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.663926 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f685d8dd5-6hsvw_9969c7d1-b89d-4102-bf22-133a9adab16a/console/0.log" Jun 03 15:44:21.664061 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.663985 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:44:21.730080 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730048 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-oauth-config\") pod \"9969c7d1-b89d-4102-bf22-133a9adab16a\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " Jun 03 15:44:21.730231 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730112 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-console-config\") pod \"9969c7d1-b89d-4102-bf22-133a9adab16a\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " Jun 03 15:44:21.730231 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730158 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-service-ca\") pod \"9969c7d1-b89d-4102-bf22-133a9adab16a\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " Jun 03 15:44:21.730231 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730192 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-serving-cert\") pod \"9969c7d1-b89d-4102-bf22-133a9adab16a\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " Jun 03 15:44:21.730231 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730215 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-trusted-ca-bundle\") pod \"9969c7d1-b89d-4102-bf22-133a9adab16a\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " Jun 03 15:44:21.730417 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730242 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cnwv\" (UniqueName: \"kubernetes.io/projected/9969c7d1-b89d-4102-bf22-133a9adab16a-kube-api-access-9cnwv\") pod \"9969c7d1-b89d-4102-bf22-133a9adab16a\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " Jun 03 15:44:21.730417 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730402 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-oauth-serving-cert\") pod \"9969c7d1-b89d-4102-bf22-133a9adab16a\" (UID: \"9969c7d1-b89d-4102-bf22-133a9adab16a\") " Jun 03 15:44:21.730645 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730586 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-service-ca" (OuterVolumeSpecName: "service-ca") pod "9969c7d1-b89d-4102-bf22-133a9adab16a" (UID: "9969c7d1-b89d-4102-bf22-133a9adab16a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:21.730645 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730582 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-console-config" (OuterVolumeSpecName: "console-config") pod "9969c7d1-b89d-4102-bf22-133a9adab16a" (UID: "9969c7d1-b89d-4102-bf22-133a9adab16a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:21.731115 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730656 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9969c7d1-b89d-4102-bf22-133a9adab16a" (UID: "9969c7d1-b89d-4102-bf22-133a9adab16a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:21.731115 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730687 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-console-config\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:21.731115 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.730703 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-service-ca\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:21.731291 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.731112 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9969c7d1-b89d-4102-bf22-133a9adab16a" (UID: "9969c7d1-b89d-4102-bf22-133a9adab16a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:21.732519 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.732494 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9969c7d1-b89d-4102-bf22-133a9adab16a-kube-api-access-9cnwv" (OuterVolumeSpecName: "kube-api-access-9cnwv") pod "9969c7d1-b89d-4102-bf22-133a9adab16a" (UID: "9969c7d1-b89d-4102-bf22-133a9adab16a"). InnerVolumeSpecName "kube-api-access-9cnwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:44:21.732605 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.732523 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9969c7d1-b89d-4102-bf22-133a9adab16a" (UID: "9969c7d1-b89d-4102-bf22-133a9adab16a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:44:21.732605 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.732553 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9969c7d1-b89d-4102-bf22-133a9adab16a" (UID: "9969c7d1-b89d-4102-bf22-133a9adab16a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:44:21.831225 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.831165 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-serving-cert\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:21.831225 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.831195 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-trusted-ca-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:21.831225 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.831208 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cnwv\" (UniqueName: \"kubernetes.io/projected/9969c7d1-b89d-4102-bf22-133a9adab16a-kube-api-access-9cnwv\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:21.831406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.831218 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9969c7d1-b89d-4102-bf22-133a9adab16a-oauth-serving-cert\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:21.831406 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.831254 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9969c7d1-b89d-4102-bf22-133a9adab16a-console-oauth-config\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:21.869507 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.869486 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f685d8dd5-6hsvw_9969c7d1-b89d-4102-bf22-133a9adab16a/console/0.log" Jun 03 15:44:21.869619 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.869526 2566 generic.go:358] "Generic (PLEG): container finished" podID="9969c7d1-b89d-4102-bf22-133a9adab16a" containerID="ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f" exitCode=2 Jun 03 15:44:21.869619 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.869599 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f685d8dd5-6hsvw" Jun 03 15:44:21.869690 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.869618 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f685d8dd5-6hsvw" event={"ID":"9969c7d1-b89d-4102-bf22-133a9adab16a","Type":"ContainerDied","Data":"ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f"} Jun 03 15:44:21.869690 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.869658 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f685d8dd5-6hsvw" event={"ID":"9969c7d1-b89d-4102-bf22-133a9adab16a","Type":"ContainerDied","Data":"9813d2b0bc6a3bbe109ae2bcb08b17688a4cb5a923f650caa5ae8b798f7e8daf"} Jun 03 15:44:21.869690 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.869674 2566 scope.go:117] "RemoveContainer" containerID="ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f" Jun 03 15:44:21.877971 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.877954 2566 scope.go:117] "RemoveContainer" containerID="ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f" Jun 03 15:44:21.878217 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:44:21.878196 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f\": container with ID starting with ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f not found: ID does not exist" containerID="ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f" Jun 03 15:44:21.878278 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.878224 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f"} err="failed to get container status \"ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f\": rpc error: code = NotFound desc = could not find container \"ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f\": container with ID starting with ab238aaeb431aabb7abfe4a36a1f9c6b15f0305bb725303be5c143e85cdc095f not found: ID does not exist" Jun 03 15:44:21.891281 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.891261 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f685d8dd5-6hsvw"] Jun 03 15:44:21.893921 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:21.893903 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f685d8dd5-6hsvw"] Jun 03 15:44:23.246050 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:23.246019 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9969c7d1-b89d-4102-bf22-133a9adab16a" path="/var/lib/kubelet/pods/9969c7d1-b89d-4102-bf22-133a9adab16a/volumes" Jun 03 15:44:32.259033 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.258993 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7cff85fc8f-v2tlf" podUID="b2ed2237-c166-46a2-9609-d09305805280" containerName="console" containerID="cri-o://97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a" gracePeriod=15 Jun 03 15:44:32.493878 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.493855 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7cff85fc8f-v2tlf_b2ed2237-c166-46a2-9609-d09305805280/console/0.log" Jun 03 15:44:32.494001 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.493925 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:44:32.611205 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.611115 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hglnh\" (UniqueName: \"kubernetes.io/projected/b2ed2237-c166-46a2-9609-d09305805280-kube-api-access-hglnh\") pod \"b2ed2237-c166-46a2-9609-d09305805280\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " Jun 03 15:44:32.611205 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.611154 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-trusted-ca-bundle\") pod \"b2ed2237-c166-46a2-9609-d09305805280\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " Jun 03 15:44:32.611205 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.611190 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-service-ca\") pod \"b2ed2237-c166-46a2-9609-d09305805280\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " Jun 03 15:44:32.611205 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.611206 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-oauth-serving-cert\") pod \"b2ed2237-c166-46a2-9609-d09305805280\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " Jun 03 15:44:32.611505 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.611230 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-oauth-config\") pod \"b2ed2237-c166-46a2-9609-d09305805280\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " Jun 03 15:44:32.611505 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.611258 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-console-config\") pod \"b2ed2237-c166-46a2-9609-d09305805280\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " Jun 03 15:44:32.611505 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.611297 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-serving-cert\") pod \"b2ed2237-c166-46a2-9609-d09305805280\" (UID: \"b2ed2237-c166-46a2-9609-d09305805280\") " Jun 03 15:44:32.611660 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.611613 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-service-ca" (OuterVolumeSpecName: "service-ca") pod "b2ed2237-c166-46a2-9609-d09305805280" (UID: "b2ed2237-c166-46a2-9609-d09305805280"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:32.611660 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.611633 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b2ed2237-c166-46a2-9609-d09305805280" (UID: "b2ed2237-c166-46a2-9609-d09305805280"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:32.611660 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.611639 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-console-config" (OuterVolumeSpecName: "console-config") pod "b2ed2237-c166-46a2-9609-d09305805280" (UID: "b2ed2237-c166-46a2-9609-d09305805280"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:32.611660 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.611648 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b2ed2237-c166-46a2-9609-d09305805280" (UID: "b2ed2237-c166-46a2-9609-d09305805280"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:44:32.613428 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.613404 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ed2237-c166-46a2-9609-d09305805280-kube-api-access-hglnh" (OuterVolumeSpecName: "kube-api-access-hglnh") pod "b2ed2237-c166-46a2-9609-d09305805280" (UID: "b2ed2237-c166-46a2-9609-d09305805280"). InnerVolumeSpecName "kube-api-access-hglnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:44:32.613533 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.613503 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b2ed2237-c166-46a2-9609-d09305805280" (UID: "b2ed2237-c166-46a2-9609-d09305805280"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:44:32.613588 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.613548 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b2ed2237-c166-46a2-9609-d09305805280" (UID: "b2ed2237-c166-46a2-9609-d09305805280"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:44:32.712316 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.712285 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-trusted-ca-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:32.712316 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.712312 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-service-ca\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:32.712316 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.712322 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-oauth-serving-cert\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:32.712515 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.712330 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-oauth-config\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:32.712515 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.712339 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2ed2237-c166-46a2-9609-d09305805280-console-config\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:32.712515 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.712348 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2ed2237-c166-46a2-9609-d09305805280-console-serving-cert\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:32.712515 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.712356 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hglnh\" (UniqueName: \"kubernetes.io/projected/b2ed2237-c166-46a2-9609-d09305805280-kube-api-access-hglnh\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:44:32.908112 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.908032 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7cff85fc8f-v2tlf_b2ed2237-c166-46a2-9609-d09305805280/console/0.log" Jun 03 15:44:32.908112 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.908070 2566 generic.go:358] "Generic (PLEG): container finished" podID="b2ed2237-c166-46a2-9609-d09305805280" containerID="97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a" exitCode=2 Jun 03 15:44:32.908112 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.908099 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cff85fc8f-v2tlf" event={"ID":"b2ed2237-c166-46a2-9609-d09305805280","Type":"ContainerDied","Data":"97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a"} Jun 03 15:44:32.908370 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.908137 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cff85fc8f-v2tlf" event={"ID":"b2ed2237-c166-46a2-9609-d09305805280","Type":"ContainerDied","Data":"b5ff44b8bcb7da93c13c44f99cc5ae3770a48bcc5c6347940d4024563063c403"} Jun 03 15:44:32.908370 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.908153 2566 scope.go:117] "RemoveContainer" containerID="97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a" Jun 03 15:44:32.908370 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.908168 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cff85fc8f-v2tlf" Jun 03 15:44:32.917687 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.917671 2566 scope.go:117] "RemoveContainer" containerID="97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a" Jun 03 15:44:32.917962 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:44:32.917944 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a\": container with ID starting with 97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a not found: ID does not exist" containerID="97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a" Jun 03 15:44:32.918047 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.917968 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a"} err="failed to get container status \"97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a\": rpc error: code = NotFound desc = could not find container \"97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a\": container with ID starting with 97a567bda45b8e06fe5c89e5ebfa64d1eadb2c807b0f184e0fcf06b727ac174a not found: ID does not exist" Jun 03 15:44:32.932175 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.932154 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cff85fc8f-v2tlf"] Jun 03 15:44:32.939086 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:32.939068 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cff85fc8f-v2tlf"] Jun 03 15:44:33.245736 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:33.245688 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ed2237-c166-46a2-9609-d09305805280" path="/var/lib/kubelet/pods/b2ed2237-c166-46a2-9609-d09305805280/volumes" Jun 03 15:44:43.937256 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:43.937223 2566 generic.go:358] "Generic (PLEG): container finished" podID="8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa" containerID="99c342bb2f6b4cd37c0511a4e648596f8e2b529f1960c4de3ef4adec64e1bfc1" exitCode=0 Jun 03 15:44:43.937638 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:43.937261 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" event={"ID":"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa","Type":"ContainerDied","Data":"99c342bb2f6b4cd37c0511a4e648596f8e2b529f1960c4de3ef4adec64e1bfc1"} Jun 03 15:44:43.937638 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:43.937598 2566 scope.go:117] "RemoveContainer" containerID="99c342bb2f6b4cd37c0511a4e648596f8e2b529f1960c4de3ef4adec64e1bfc1" Jun 03 15:44:44.942207 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:44.942168 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-2nh7q" event={"ID":"8c7f54e6-52fb-4176-bb60-8bf0ba9edaaa","Type":"ContainerStarted","Data":"908a2cf786933a35f9e1262447441da2c8af953bc812f54cb477daa561a9e2b8"} Jun 03 15:44:53.070102 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:53.070063 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:44:53.072769 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:53.072744 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c22f0a9-6788-4c37-89a6-5ab6de86ef60-metrics-certs\") pod \"network-metrics-daemon-llzgd\" (UID: \"1c22f0a9-6788-4c37-89a6-5ab6de86ef60\") " pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:44:53.347427 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:53.347339 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q8ntl\"" Jun 03 15:44:53.353219 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:53.353186 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-llzgd" Jun 03 15:44:53.506469 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:53.506441 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-llzgd"] Jun 03 15:44:53.967457 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:53.967416 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-llzgd" event={"ID":"1c22f0a9-6788-4c37-89a6-5ab6de86ef60","Type":"ContainerStarted","Data":"d78f72616b22190d1611ca5f6349f49af3d1c89a1a40549d2add8f4a16a1d1e6"} Jun 03 15:44:54.971483 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:54.971442 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-llzgd" event={"ID":"1c22f0a9-6788-4c37-89a6-5ab6de86ef60","Type":"ContainerStarted","Data":"93e1d93a40493c8cf009620789053a7da397e826056f18ade25ff8b978541dc9"} Jun 03 15:44:54.971882 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:54.971490 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-llzgd" event={"ID":"1c22f0a9-6788-4c37-89a6-5ab6de86ef60","Type":"ContainerStarted","Data":"bc7181b81c234e27c8e9dbf9d5fb349c77b8ed885585438aa3161131a6f26df3"} Jun 03 15:44:54.992366 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:44:54.992323 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-llzgd" podStartSLOduration=252.951892878 podStartE2EDuration="4m13.992311491s" podCreationTimestamp="2026-06-03 15:40:41 +0000 UTC" firstStartedPulling="2026-06-03 15:44:53.524280715 +0000 UTC m=+252.762028231" lastFinishedPulling="2026-06-03 15:44:54.564699325 +0000 UTC m=+253.802446844" observedRunningTime="2026-06-03 15:44:54.9909789 +0000 UTC m=+254.228726439" watchObservedRunningTime="2026-06-03 15:44:54.992311491 +0000 UTC m=+254.230059029" Jun 03 15:45:07.468172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.468135 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:45:07.468549 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.468403 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9969c7d1-b89d-4102-bf22-133a9adab16a" containerName="console" Jun 03 15:45:07.468549 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.468414 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9969c7d1-b89d-4102-bf22-133a9adab16a" containerName="console" Jun 03 15:45:07.468549 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.468422 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ed2237-c166-46a2-9609-d09305805280" containerName="console" Jun 03 15:45:07.468549 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.468428 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ed2237-c166-46a2-9609-d09305805280" containerName="console" Jun 03 15:45:07.468549 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.468436 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064365c0-34c0-4700-b4a6-cb817ef192cb" containerName="registry" Jun 03 15:45:07.468549 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.468441 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="064365c0-34c0-4700-b4a6-cb817ef192cb" containerName="registry" Jun 03 15:45:07.468549 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.468484 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2ed2237-c166-46a2-9609-d09305805280" containerName="console" Jun 03 15:45:07.468549 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.468492 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9969c7d1-b89d-4102-bf22-133a9adab16a" containerName="console" Jun 03 15:45:07.468549 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.468501 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="064365c0-34c0-4700-b4a6-cb817ef192cb" containerName="registry" Jun 03 15:45:07.472981 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.472964 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.475817 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.475789 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 15:45:07.475961 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.475793 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 15:45:07.476039 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.475965 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 15:45:07.476039 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.475989 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 15:45:07.476039 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.476000 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 15:45:07.476196 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.476115 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 15:45:07.476196 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.476126 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 15:45:07.476196 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.476133 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c45vv\"" Jun 03 15:45:07.476342 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.476244 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 15:45:07.482089 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.482068 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 15:45:07.486050 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.486029 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:45:07.573132 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573132 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573130 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/184539f1-23b7-40ef-9889-58ec8fbfce20-tls-assets\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573314 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573149 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/184539f1-23b7-40ef-9889-58ec8fbfce20-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573314 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573174 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vvz6\" (UniqueName: \"kubernetes.io/projected/184539f1-23b7-40ef-9889-58ec8fbfce20-kube-api-access-7vvz6\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573314 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573211 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/184539f1-23b7-40ef-9889-58ec8fbfce20-config-out\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573314 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573233 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-config-volume\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573314 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573251 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573314 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573267 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/184539f1-23b7-40ef-9889-58ec8fbfce20-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573314 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-web-config\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573529 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573321 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573529 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573387 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573529 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/184539f1-23b7-40ef-9889-58ec8fbfce20-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.573529 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.573476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.674888 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.674850 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-web-config\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.674888 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.674887 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.675138 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.674908 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.675138 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.674941 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/184539f1-23b7-40ef-9889-58ec8fbfce20-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.675138 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.674962 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.675138 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.674990 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.675138 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.675009 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/184539f1-23b7-40ef-9889-58ec8fbfce20-tls-assets\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.675138 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.675027 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/184539f1-23b7-40ef-9889-58ec8fbfce20-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.675138 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.675050 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vvz6\" (UniqueName: \"kubernetes.io/projected/184539f1-23b7-40ef-9889-58ec8fbfce20-kube-api-access-7vvz6\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.675664 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.675634 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/184539f1-23b7-40ef-9889-58ec8fbfce20-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.675907 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.675886 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/184539f1-23b7-40ef-9889-58ec8fbfce20-config-out\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.676680 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.676062 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/184539f1-23b7-40ef-9889-58ec8fbfce20-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.676680 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.676064 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-config-volume\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.676680 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.676220 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.676680 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.676248 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/184539f1-23b7-40ef-9889-58ec8fbfce20-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.678296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.678270 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-web-config\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.678414 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.678375 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.678562 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.678540 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.678663 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.678643 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/184539f1-23b7-40ef-9889-58ec8fbfce20-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.678943 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.678923 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/184539f1-23b7-40ef-9889-58ec8fbfce20-tls-assets\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.679027 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.678956 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.679122 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.679102 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-config-volume\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.679861 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.679833 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.679989 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.679969 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/184539f1-23b7-40ef-9889-58ec8fbfce20-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.680468 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.680453 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/184539f1-23b7-40ef-9889-58ec8fbfce20-config-out\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.685364 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.685345 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vvz6\" (UniqueName: \"kubernetes.io/projected/184539f1-23b7-40ef-9889-58ec8fbfce20-kube-api-access-7vvz6\") pod \"alertmanager-main-0\" (UID: \"184539f1-23b7-40ef-9889-58ec8fbfce20\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.782920 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.782824 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:45:07.924187 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:07.924150 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:45:07.927371 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:45:07.927342 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184539f1_23b7_40ef_9889_58ec8fbfce20.slice/crio-41e4aea57e56314fdc0b924033ac2e578a980a4f0b7579a9309aaa07c49e18cf WatchSource:0}: Error finding container 41e4aea57e56314fdc0b924033ac2e578a980a4f0b7579a9309aaa07c49e18cf: Status 404 returned error can't find the container with id 41e4aea57e56314fdc0b924033ac2e578a980a4f0b7579a9309aaa07c49e18cf Jun 03 15:45:08.011813 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:08.011773 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"184539f1-23b7-40ef-9889-58ec8fbfce20","Type":"ContainerStarted","Data":"41e4aea57e56314fdc0b924033ac2e578a980a4f0b7579a9309aaa07c49e18cf"} Jun 03 15:45:09.016349 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:09.016324 2566 generic.go:358] "Generic (PLEG): container finished" podID="184539f1-23b7-40ef-9889-58ec8fbfce20" containerID="75d94dd999f3b99a6c1ade80a6bb11beacc833ece0d2a78b0ebd44a8d50e638a" exitCode=0 Jun 03 15:45:09.016675 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:09.016377 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"184539f1-23b7-40ef-9889-58ec8fbfce20","Type":"ContainerDied","Data":"75d94dd999f3b99a6c1ade80a6bb11beacc833ece0d2a78b0ebd44a8d50e638a"} Jun 03 15:45:11.025334 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:11.025304 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"184539f1-23b7-40ef-9889-58ec8fbfce20","Type":"ContainerStarted","Data":"9334896d125df0251026b263cb9f39531a4b1ae87346951e32fd3c560e6f9ac9"} Jun 03 15:45:11.025334 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:11.025339 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"184539f1-23b7-40ef-9889-58ec8fbfce20","Type":"ContainerStarted","Data":"1b68bb9d696d5017afc89aad2307a7e5bd86cdf1d5ce423ac84aaf217f58f9a7"} Jun 03 15:45:11.025739 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:11.025348 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"184539f1-23b7-40ef-9889-58ec8fbfce20","Type":"ContainerStarted","Data":"bbd9144f07587d0580f17ea1a058a065f62b87a58b6b1d1af3b770c9ca415478"} Jun 03 15:45:11.025739 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:11.025357 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"184539f1-23b7-40ef-9889-58ec8fbfce20","Type":"ContainerStarted","Data":"8b6131842fdf817bf0fddf8d6f21c2594ac691fdfcb4c52c5ac118d8a159281c"} Jun 03 15:45:11.025739 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:11.025367 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"184539f1-23b7-40ef-9889-58ec8fbfce20","Type":"ContainerStarted","Data":"7d9d58572585ec455297be427456cafae095f19971c74b1345215f92214cfc44"} Jun 03 15:45:11.025739 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:11.025375 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"184539f1-23b7-40ef-9889-58ec8fbfce20","Type":"ContainerStarted","Data":"badfdf16be747579ace55b7a76a69838254349cab0c6dcce4d844deaf18af526"} Jun 03 15:45:11.070404 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:11.070347 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.585861987 podStartE2EDuration="4.070331159s" podCreationTimestamp="2026-06-03 15:45:07 +0000 UTC" firstStartedPulling="2026-06-03 15:45:07.929613137 +0000 UTC m=+267.167360654" lastFinishedPulling="2026-06-03 15:45:10.414082294 +0000 UTC m=+269.651829826" observedRunningTime="2026-06-03 15:45:11.067493144 +0000 UTC m=+270.305240682" watchObservedRunningTime="2026-06-03 15:45:11.070331159 +0000 UTC m=+270.308078698" Jun 03 15:45:16.507907 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.507869 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-74bc69b4d5-rwpl7"] Jun 03 15:45:16.511422 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.511404 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.515788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.515757 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 15:45:16.515788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.515759 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 15:45:16.516038 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.516022 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 15:45:16.516276 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.516256 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 15:45:16.516347 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.516300 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wxcxx\"" Jun 03 15:45:16.516347 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.516335 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 15:45:16.516432 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.516299 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 15:45:16.516669 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.516654 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 15:45:16.522903 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.522880 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 15:45:16.523472 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.523450 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74bc69b4d5-rwpl7"] Jun 03 15:45:16.651267 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.651231 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-serving-cert\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.651426 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.651280 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-oauth-config\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.651426 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.651299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-oauth-serving-cert\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.651426 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.651351 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlqcx\" (UniqueName: \"kubernetes.io/projected/e329c490-8d9d-410a-b31b-e8d4ea5328ba-kube-api-access-wlqcx\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.651426 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.651381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-config\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.651426 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.651421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-trusted-ca-bundle\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.651579 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.651468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-service-ca\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.752564 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.752529 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqcx\" (UniqueName: \"kubernetes.io/projected/e329c490-8d9d-410a-b31b-e8d4ea5328ba-kube-api-access-wlqcx\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.752756 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.752574 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-config\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.752756 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.752616 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-trusted-ca-bundle\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.752756 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.752636 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-service-ca\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.752756 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.752666 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-serving-cert\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.752756 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.752707 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-oauth-config\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.752998 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.752861 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-oauth-serving-cert\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.753484 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.753443 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-service-ca\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.753764 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.753549 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-oauth-serving-cert\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.753764 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.753577 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-trusted-ca-bundle\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.753764 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.753627 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-config\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.755460 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.755427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-oauth-config\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.755460 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.755449 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-serving-cert\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.762946 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.762897 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlqcx\" (UniqueName: \"kubernetes.io/projected/e329c490-8d9d-410a-b31b-e8d4ea5328ba-kube-api-access-wlqcx\") pod \"console-74bc69b4d5-rwpl7\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.821285 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.821259 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:16.969148 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:16.969122 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74bc69b4d5-rwpl7"] Jun 03 15:45:16.971756 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:45:16.971715 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode329c490_8d9d_410a_b31b_e8d4ea5328ba.slice/crio-ab9c792517c153165ccf852aecec76c8c5c129dbbb06f0a590bf02b0911294b5 WatchSource:0}: Error finding container ab9c792517c153165ccf852aecec76c8c5c129dbbb06f0a590bf02b0911294b5: Status 404 returned error can't find the container with id ab9c792517c153165ccf852aecec76c8c5c129dbbb06f0a590bf02b0911294b5 Jun 03 15:45:17.043640 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:17.043604 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bc69b4d5-rwpl7" event={"ID":"e329c490-8d9d-410a-b31b-e8d4ea5328ba","Type":"ContainerStarted","Data":"fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c"} Jun 03 15:45:17.043792 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:17.043652 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bc69b4d5-rwpl7" event={"ID":"e329c490-8d9d-410a-b31b-e8d4ea5328ba","Type":"ContainerStarted","Data":"ab9c792517c153165ccf852aecec76c8c5c129dbbb06f0a590bf02b0911294b5"} Jun 03 15:45:17.068497 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:17.068440 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-74bc69b4d5-rwpl7" podStartSLOduration=1.068420969 podStartE2EDuration="1.068420969s" podCreationTimestamp="2026-06-03 15:45:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:45:17.067989705 +0000 UTC m=+276.305737243" watchObservedRunningTime="2026-06-03 15:45:17.068420969 +0000 UTC m=+276.306168511" Jun 03 15:45:26.821805 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:26.821770 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:26.821805 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:26.821807 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:26.826574 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:26.826548 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:27.076268 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:27.076178 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:45:41.161441 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:41.161407 2566 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 15:45:54.497634 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.497593 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn"] Jun 03 15:45:54.502824 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.502808 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:45:54.505571 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.505554 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:45:54.505666 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.505558 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:45:54.506380 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.506365 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw27v\"" Jun 03 15:45:54.508955 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.508935 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn"] Jun 03 15:45:54.619224 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.619177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:45:54.619389 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.619238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:45:54.619389 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.619281 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlwzs\" (UniqueName: \"kubernetes.io/projected/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-kube-api-access-vlwzs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:45:54.720303 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.720270 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:45:54.720303 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.720304 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlwzs\" (UniqueName: \"kubernetes.io/projected/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-kube-api-access-vlwzs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:45:54.720491 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.720362 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:45:54.720686 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.720665 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:45:54.720754 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.720737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:45:54.729464 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.729432 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlwzs\" (UniqueName: \"kubernetes.io/projected/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-kube-api-access-vlwzs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:45:54.813012 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.812958 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:45:54.948178 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.948148 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn"] Jun 03 15:45:54.951968 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:45:54.951937 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be3bf97_4dff_41cc_b258_49b9f7c6fa73.slice/crio-4cd75e20e203e45547dac6e2d719a854e0899635f68204581c326826fd3bea71 WatchSource:0}: Error finding container 4cd75e20e203e45547dac6e2d719a854e0899635f68204581c326826fd3bea71: Status 404 returned error can't find the container with id 4cd75e20e203e45547dac6e2d719a854e0899635f68204581c326826fd3bea71 Jun 03 15:45:54.954242 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:54.954226 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:45:55.154240 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:45:55.154158 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" event={"ID":"2be3bf97-4dff-41cc-b258-49b9f7c6fa73","Type":"ContainerStarted","Data":"4cd75e20e203e45547dac6e2d719a854e0899635f68204581c326826fd3bea71"} Jun 03 15:46:04.181999 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:04.181956 2566 generic.go:358] "Generic (PLEG): container finished" podID="2be3bf97-4dff-41cc-b258-49b9f7c6fa73" containerID="0e37075e09592edfb71c3afed1da24ed67798ef4583bf0e4decb13564087d6a5" exitCode=0 Jun 03 15:46:04.182412 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:04.182012 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" event={"ID":"2be3bf97-4dff-41cc-b258-49b9f7c6fa73","Type":"ContainerDied","Data":"0e37075e09592edfb71c3afed1da24ed67798ef4583bf0e4decb13564087d6a5"} Jun 03 15:46:07.192534 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:07.192499 2566 generic.go:358] "Generic (PLEG): container finished" podID="2be3bf97-4dff-41cc-b258-49b9f7c6fa73" containerID="edc050f4acad67cc5bff255e3c33cabcabc07af05b3457f4c74b13df6ae91eef" exitCode=0 Jun 03 15:46:07.192952 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:07.192543 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" event={"ID":"2be3bf97-4dff-41cc-b258-49b9f7c6fa73","Type":"ContainerDied","Data":"edc050f4acad67cc5bff255e3c33cabcabc07af05b3457f4c74b13df6ae91eef"} Jun 03 15:46:15.219049 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:15.219014 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" event={"ID":"2be3bf97-4dff-41cc-b258-49b9f7c6fa73","Type":"ContainerStarted","Data":"6341280d094af4ff61ffc7130e8b6711c6c3f5603e67e96a10a8d743a6aa2741"} Jun 03 15:46:15.239541 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:15.239484 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" podStartSLOduration=1.069836783 podStartE2EDuration="21.239468246s" podCreationTimestamp="2026-06-03 15:45:54 +0000 UTC" firstStartedPulling="2026-06-03 15:45:54.9543524 +0000 UTC m=+314.192099916" lastFinishedPulling="2026-06-03 15:46:15.123983861 +0000 UTC m=+334.361731379" observedRunningTime="2026-06-03 15:46:15.237633984 +0000 UTC m=+334.475381535" watchObservedRunningTime="2026-06-03 15:46:15.239468246 +0000 UTC m=+334.477215786" Jun 03 15:46:16.224456 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:16.224425 2566 generic.go:358] "Generic (PLEG): container finished" podID="2be3bf97-4dff-41cc-b258-49b9f7c6fa73" containerID="6341280d094af4ff61ffc7130e8b6711c6c3f5603e67e96a10a8d743a6aa2741" exitCode=0 Jun 03 15:46:16.224870 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:16.224469 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" event={"ID":"2be3bf97-4dff-41cc-b258-49b9f7c6fa73","Type":"ContainerDied","Data":"6341280d094af4ff61ffc7130e8b6711c6c3f5603e67e96a10a8d743a6aa2741"} Jun 03 15:46:17.352417 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:17.352395 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:46:17.408344 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:17.408316 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-bundle\") pod \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " Jun 03 15:46:17.408471 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:17.408354 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-util\") pod \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " Jun 03 15:46:17.408471 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:17.408378 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlwzs\" (UniqueName: \"kubernetes.io/projected/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-kube-api-access-vlwzs\") pod \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\" (UID: \"2be3bf97-4dff-41cc-b258-49b9f7c6fa73\") " Jun 03 15:46:17.409027 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:17.408967 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-bundle" (OuterVolumeSpecName: "bundle") pod "2be3bf97-4dff-41cc-b258-49b9f7c6fa73" (UID: "2be3bf97-4dff-41cc-b258-49b9f7c6fa73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:46:17.410646 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:17.410621 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-kube-api-access-vlwzs" (OuterVolumeSpecName: "kube-api-access-vlwzs") pod "2be3bf97-4dff-41cc-b258-49b9f7c6fa73" (UID: "2be3bf97-4dff-41cc-b258-49b9f7c6fa73"). InnerVolumeSpecName "kube-api-access-vlwzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:46:17.412801 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:17.412782 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-util" (OuterVolumeSpecName: "util") pod "2be3bf97-4dff-41cc-b258-49b9f7c6fa73" (UID: "2be3bf97-4dff-41cc-b258-49b9f7c6fa73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:46:17.509793 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:17.509705 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:46:17.509793 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:17.509753 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-util\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:46:17.509793 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:17.509765 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlwzs\" (UniqueName: \"kubernetes.io/projected/2be3bf97-4dff-41cc-b258-49b9f7c6fa73-kube-api-access-vlwzs\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:46:18.231294 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:18.231253 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" event={"ID":"2be3bf97-4dff-41cc-b258-49b9f7c6fa73","Type":"ContainerDied","Data":"4cd75e20e203e45547dac6e2d719a854e0899635f68204581c326826fd3bea71"} Jun 03 15:46:18.231294 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:18.231290 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4cd75e20e203e45547dac6e2d719a854e0899635f68204581c326826fd3bea71" Jun 03 15:46:18.231483 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:18.231304 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpfgsn" Jun 03 15:46:22.682077 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.682045 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx"] Jun 03 15:46:22.682485 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.682349 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be3bf97-4dff-41cc-b258-49b9f7c6fa73" containerName="util" Jun 03 15:46:22.682485 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.682359 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be3bf97-4dff-41cc-b258-49b9f7c6fa73" containerName="util" Jun 03 15:46:22.682485 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.682371 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be3bf97-4dff-41cc-b258-49b9f7c6fa73" containerName="pull" Jun 03 15:46:22.682485 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.682376 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be3bf97-4dff-41cc-b258-49b9f7c6fa73" containerName="pull" Jun 03 15:46:22.682485 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.682383 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be3bf97-4dff-41cc-b258-49b9f7c6fa73" containerName="extract" Jun 03 15:46:22.682485 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.682389 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be3bf97-4dff-41cc-b258-49b9f7c6fa73" containerName="extract" Jun 03 15:46:22.682485 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.682431 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="2be3bf97-4dff-41cc-b258-49b9f7c6fa73" containerName="extract" Jun 03 15:46:22.686956 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.686933 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx" Jun 03 15:46:22.690139 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.690121 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4hdzp\"" Jun 03 15:46:22.690352 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.690336 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:46:22.690430 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.690415 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 15:46:22.696918 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.696896 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx"] Jun 03 15:46:22.854160 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.854127 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h2mx\" (UniqueName: \"kubernetes.io/projected/bc90b7e3-e29b-43fe-af5d-a381e9e2214a-kube-api-access-9h2mx\") pod \"cert-manager-operator-controller-manager-54b9655956-b6pvx\" (UID: \"bc90b7e3-e29b-43fe-af5d-a381e9e2214a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx" Jun 03 15:46:22.854325 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.854227 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc90b7e3-e29b-43fe-af5d-a381e9e2214a-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-b6pvx\" (UID: \"bc90b7e3-e29b-43fe-af5d-a381e9e2214a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx" Jun 03 15:46:22.955492 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.955410 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc90b7e3-e29b-43fe-af5d-a381e9e2214a-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-b6pvx\" (UID: \"bc90b7e3-e29b-43fe-af5d-a381e9e2214a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx" Jun 03 15:46:22.955492 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.955465 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9h2mx\" (UniqueName: \"kubernetes.io/projected/bc90b7e3-e29b-43fe-af5d-a381e9e2214a-kube-api-access-9h2mx\") pod \"cert-manager-operator-controller-manager-54b9655956-b6pvx\" (UID: \"bc90b7e3-e29b-43fe-af5d-a381e9e2214a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx" Jun 03 15:46:22.955798 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.955777 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc90b7e3-e29b-43fe-af5d-a381e9e2214a-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-b6pvx\" (UID: \"bc90b7e3-e29b-43fe-af5d-a381e9e2214a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx" Jun 03 15:46:22.971569 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.971540 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h2mx\" (UniqueName: \"kubernetes.io/projected/bc90b7e3-e29b-43fe-af5d-a381e9e2214a-kube-api-access-9h2mx\") pod \"cert-manager-operator-controller-manager-54b9655956-b6pvx\" (UID: \"bc90b7e3-e29b-43fe-af5d-a381e9e2214a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx" Jun 03 15:46:22.996520 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:22.996497 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx" Jun 03 15:46:23.150044 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:23.150012 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx"] Jun 03 15:46:23.154137 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:46:23.154111 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc90b7e3_e29b_43fe_af5d_a381e9e2214a.slice/crio-afd30fc2d0d817df9bd015357c12225f234861e53ba08880f2b69edfb9e0b9f2 WatchSource:0}: Error finding container afd30fc2d0d817df9bd015357c12225f234861e53ba08880f2b69edfb9e0b9f2: Status 404 returned error can't find the container with id afd30fc2d0d817df9bd015357c12225f234861e53ba08880f2b69edfb9e0b9f2 Jun 03 15:46:23.247005 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:23.246975 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx" event={"ID":"bc90b7e3-e29b-43fe-af5d-a381e9e2214a","Type":"ContainerStarted","Data":"afd30fc2d0d817df9bd015357c12225f234861e53ba08880f2b69edfb9e0b9f2"} Jun 03 15:46:25.255482 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:25.255439 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx" event={"ID":"bc90b7e3-e29b-43fe-af5d-a381e9e2214a","Type":"ContainerStarted","Data":"cddf6738a32645fc71d7900816807831cb2fd1f8b949f631ea3a0f38574e7a04"} Jun 03 15:46:25.296236 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:25.296078 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b6pvx" podStartSLOduration=1.627256462 podStartE2EDuration="3.296059671s" podCreationTimestamp="2026-06-03 15:46:22 +0000 UTC" firstStartedPulling="2026-06-03 15:46:23.157371473 +0000 UTC m=+342.395118993" lastFinishedPulling="2026-06-03 15:46:24.826174686 +0000 UTC m=+344.063922202" observedRunningTime="2026-06-03 15:46:25.293329995 +0000 UTC m=+344.531077545" watchObservedRunningTime="2026-06-03 15:46:25.296059671 +0000 UTC m=+344.533807213" Jun 03 15:46:27.067163 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.067133 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm"] Jun 03 15:46:27.069673 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.069653 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:27.072759 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.072710 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:46:27.073620 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.073601 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw27v\"" Jun 03 15:46:27.073620 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.073612 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:46:27.080287 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.080259 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm"] Jun 03 15:46:27.193039 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.193009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6tcn\" (UniqueName: \"kubernetes.io/projected/72818e97-e535-41bf-afec-312928b1750b-kube-api-access-b6tcn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:27.193039 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.193049 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:27.193232 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.193088 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:27.293985 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.293943 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:27.294137 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.294006 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6tcn\" (UniqueName: \"kubernetes.io/projected/72818e97-e535-41bf-afec-312928b1750b-kube-api-access-b6tcn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:27.294137 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.294032 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:27.294320 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.294299 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:27.294357 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.294328 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:27.308310 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.308278 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6tcn\" (UniqueName: \"kubernetes.io/projected/72818e97-e535-41bf-afec-312928b1750b-kube-api-access-b6tcn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:27.379525 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.379449 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:27.520035 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.520013 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm"] Jun 03 15:46:27.522463 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:46:27.522428 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72818e97_e535_41bf_afec_312928b1750b.slice/crio-0ff0d1afd554e9452b330a6f9ced99bb1d7551fb61de3fd1d98ca6b4e8a0f57d WatchSource:0}: Error finding container 0ff0d1afd554e9452b330a6f9ced99bb1d7551fb61de3fd1d98ca6b4e8a0f57d: Status 404 returned error can't find the container with id 0ff0d1afd554e9452b330a6f9ced99bb1d7551fb61de3fd1d98ca6b4e8a0f57d Jun 03 15:46:27.532773 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.532751 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-f2g29"] Jun 03 15:46:27.534970 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.534953 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" Jun 03 15:46:27.542695 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.542678 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 15:46:27.543308 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.543285 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vjnxn\"" Jun 03 15:46:27.543595 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.543573 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 15:46:27.560899 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.560873 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-f2g29"] Jun 03 15:46:27.696819 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.696791 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5a34b6d-0c50-4f28-a07e-4479502b5b1f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-f2g29\" (UID: \"f5a34b6d-0c50-4f28-a07e-4479502b5b1f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" Jun 03 15:46:27.696956 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.696852 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb2kz\" (UniqueName: \"kubernetes.io/projected/f5a34b6d-0c50-4f28-a07e-4479502b5b1f-kube-api-access-tb2kz\") pod \"cert-manager-webhook-587ccfb98-f2g29\" (UID: \"f5a34b6d-0c50-4f28-a07e-4479502b5b1f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" Jun 03 15:46:27.798062 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.798027 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5a34b6d-0c50-4f28-a07e-4479502b5b1f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-f2g29\" (UID: \"f5a34b6d-0c50-4f28-a07e-4479502b5b1f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" Jun 03 15:46:27.798242 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.798089 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tb2kz\" (UniqueName: \"kubernetes.io/projected/f5a34b6d-0c50-4f28-a07e-4479502b5b1f-kube-api-access-tb2kz\") pod \"cert-manager-webhook-587ccfb98-f2g29\" (UID: \"f5a34b6d-0c50-4f28-a07e-4479502b5b1f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" Jun 03 15:46:27.809276 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.809252 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5a34b6d-0c50-4f28-a07e-4479502b5b1f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-f2g29\" (UID: \"f5a34b6d-0c50-4f28-a07e-4479502b5b1f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" Jun 03 15:46:27.811066 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.811043 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb2kz\" (UniqueName: \"kubernetes.io/projected/f5a34b6d-0c50-4f28-a07e-4479502b5b1f-kube-api-access-tb2kz\") pod \"cert-manager-webhook-587ccfb98-f2g29\" (UID: \"f5a34b6d-0c50-4f28-a07e-4479502b5b1f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" Jun 03 15:46:27.886924 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:27.886900 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" Jun 03 15:46:28.022243 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:28.022208 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-f2g29"] Jun 03 15:46:28.026275 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:46:28.026246 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5a34b6d_0c50_4f28_a07e_4479502b5b1f.slice/crio-50f1a58a0aa5866242f5e929f9185f492cde6c1d234abf6af8d6d2db4c49d4e2 WatchSource:0}: Error finding container 50f1a58a0aa5866242f5e929f9185f492cde6c1d234abf6af8d6d2db4c49d4e2: Status 404 returned error can't find the container with id 50f1a58a0aa5866242f5e929f9185f492cde6c1d234abf6af8d6d2db4c49d4e2 Jun 03 15:46:28.265258 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:28.265219 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" event={"ID":"f5a34b6d-0c50-4f28-a07e-4479502b5b1f","Type":"ContainerStarted","Data":"50f1a58a0aa5866242f5e929f9185f492cde6c1d234abf6af8d6d2db4c49d4e2"} Jun 03 15:46:28.266473 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:28.266448 2566 generic.go:358] "Generic (PLEG): container finished" podID="72818e97-e535-41bf-afec-312928b1750b" containerID="d17ca4969a276e21e37a0858828fd1170334f5e42e0965a3c668fafafef0d7e6" exitCode=0 Jun 03 15:46:28.266600 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:28.266487 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" event={"ID":"72818e97-e535-41bf-afec-312928b1750b","Type":"ContainerDied","Data":"d17ca4969a276e21e37a0858828fd1170334f5e42e0965a3c668fafafef0d7e6"} Jun 03 15:46:28.266600 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:28.266506 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" event={"ID":"72818e97-e535-41bf-afec-312928b1750b","Type":"ContainerStarted","Data":"0ff0d1afd554e9452b330a6f9ced99bb1d7551fb61de3fd1d98ca6b4e8a0f57d"} Jun 03 15:46:29.711944 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:29.711902 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-rvdst"] Jun 03 15:46:29.717052 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:29.717029 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-rvdst" Jun 03 15:46:29.719918 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:29.719538 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ckbf9\"" Jun 03 15:46:29.723293 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:29.723268 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-rvdst"] Jun 03 15:46:29.814340 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:29.814298 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d51341f-7c46-4e5b-9a5d-daee18d6d052-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-rvdst\" (UID: \"6d51341f-7c46-4e5b-9a5d-daee18d6d052\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rvdst" Jun 03 15:46:29.814508 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:29.814348 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m6j7\" (UniqueName: \"kubernetes.io/projected/6d51341f-7c46-4e5b-9a5d-daee18d6d052-kube-api-access-6m6j7\") pod \"cert-manager-cainjector-68b757865b-rvdst\" (UID: \"6d51341f-7c46-4e5b-9a5d-daee18d6d052\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rvdst" Jun 03 15:46:29.915868 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:29.915836 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d51341f-7c46-4e5b-9a5d-daee18d6d052-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-rvdst\" (UID: \"6d51341f-7c46-4e5b-9a5d-daee18d6d052\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rvdst" Jun 03 15:46:29.916030 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:29.915884 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6m6j7\" (UniqueName: \"kubernetes.io/projected/6d51341f-7c46-4e5b-9a5d-daee18d6d052-kube-api-access-6m6j7\") pod \"cert-manager-cainjector-68b757865b-rvdst\" (UID: \"6d51341f-7c46-4e5b-9a5d-daee18d6d052\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rvdst" Jun 03 15:46:29.927061 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:29.927034 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m6j7\" (UniqueName: \"kubernetes.io/projected/6d51341f-7c46-4e5b-9a5d-daee18d6d052-kube-api-access-6m6j7\") pod \"cert-manager-cainjector-68b757865b-rvdst\" (UID: \"6d51341f-7c46-4e5b-9a5d-daee18d6d052\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rvdst" Jun 03 15:46:29.927214 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:29.927097 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d51341f-7c46-4e5b-9a5d-daee18d6d052-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-rvdst\" (UID: \"6d51341f-7c46-4e5b-9a5d-daee18d6d052\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rvdst" Jun 03 15:46:30.028699 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:30.028624 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-rvdst" Jun 03 15:46:31.357659 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:31.357619 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-rvdst"] Jun 03 15:46:31.360884 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:46:31.360583 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d51341f_7c46_4e5b_9a5d_daee18d6d052.slice/crio-91ea44de7c5e5ee7e7fa0adb3f1a55453a2dfe4202aa1e99bce6a405faf50718 WatchSource:0}: Error finding container 91ea44de7c5e5ee7e7fa0adb3f1a55453a2dfe4202aa1e99bce6a405faf50718: Status 404 returned error can't find the container with id 91ea44de7c5e5ee7e7fa0adb3f1a55453a2dfe4202aa1e99bce6a405faf50718 Jun 03 15:46:32.284163 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:32.284128 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" event={"ID":"f5a34b6d-0c50-4f28-a07e-4479502b5b1f","Type":"ContainerStarted","Data":"9dc371bb6a8cbd2edd345a69464fce9d0c3fe45260534bde6c4719460bb20986"} Jun 03 15:46:32.284340 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:32.284185 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" Jun 03 15:46:32.285710 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:32.285685 2566 generic.go:358] "Generic (PLEG): container finished" podID="72818e97-e535-41bf-afec-312928b1750b" containerID="981cd96eec220b67e33ce3a7422dc5a793bafdc4630832ba7727212e734989c0" exitCode=0 Jun 03 15:46:32.285837 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:32.285778 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" event={"ID":"72818e97-e535-41bf-afec-312928b1750b","Type":"ContainerDied","Data":"981cd96eec220b67e33ce3a7422dc5a793bafdc4630832ba7727212e734989c0"} Jun 03 15:46:32.287124 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:32.287100 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-rvdst" event={"ID":"6d51341f-7c46-4e5b-9a5d-daee18d6d052","Type":"ContainerStarted","Data":"652711989ec798979bc2c2470bc56c7fa0c658a7d227f7b9f28308464f306f09"} Jun 03 15:46:32.287225 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:32.287132 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-rvdst" event={"ID":"6d51341f-7c46-4e5b-9a5d-daee18d6d052","Type":"ContainerStarted","Data":"91ea44de7c5e5ee7e7fa0adb3f1a55453a2dfe4202aa1e99bce6a405faf50718"} Jun 03 15:46:32.302540 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:32.302006 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" podStartSLOduration=2.115405554 podStartE2EDuration="5.301991468s" podCreationTimestamp="2026-06-03 15:46:27 +0000 UTC" firstStartedPulling="2026-06-03 15:46:28.028003531 +0000 UTC m=+347.265751047" lastFinishedPulling="2026-06-03 15:46:31.214589442 +0000 UTC m=+350.452336961" observedRunningTime="2026-06-03 15:46:32.301937045 +0000 UTC m=+351.539684586" watchObservedRunningTime="2026-06-03 15:46:32.301991468 +0000 UTC m=+351.539739010" Jun 03 15:46:32.341223 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:32.341171 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-rvdst" podStartSLOduration=3.341153111 podStartE2EDuration="3.341153111s" podCreationTimestamp="2026-06-03 15:46:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:46:32.337839813 +0000 UTC m=+351.575587333" watchObservedRunningTime="2026-06-03 15:46:32.341153111 +0000 UTC m=+351.578900651" Jun 03 15:46:33.291925 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:33.291891 2566 generic.go:358] "Generic (PLEG): container finished" podID="72818e97-e535-41bf-afec-312928b1750b" containerID="c2dd8737cff428c12336f8fffba4d9a2fc7d1586c2d29e4f1a7d9305f6a68dc6" exitCode=0 Jun 03 15:46:33.292340 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:33.291988 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" event={"ID":"72818e97-e535-41bf-afec-312928b1750b","Type":"ContainerDied","Data":"c2dd8737cff428c12336f8fffba4d9a2fc7d1586c2d29e4f1a7d9305f6a68dc6"} Jun 03 15:46:34.414423 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:34.414402 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:34.556888 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:34.556805 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6tcn\" (UniqueName: \"kubernetes.io/projected/72818e97-e535-41bf-afec-312928b1750b-kube-api-access-b6tcn\") pod \"72818e97-e535-41bf-afec-312928b1750b\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " Jun 03 15:46:34.556888 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:34.556853 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-util\") pod \"72818e97-e535-41bf-afec-312928b1750b\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " Jun 03 15:46:34.557090 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:34.556972 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-bundle\") pod \"72818e97-e535-41bf-afec-312928b1750b\" (UID: \"72818e97-e535-41bf-afec-312928b1750b\") " Jun 03 15:46:34.557336 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:34.557310 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-bundle" (OuterVolumeSpecName: "bundle") pod "72818e97-e535-41bf-afec-312928b1750b" (UID: "72818e97-e535-41bf-afec-312928b1750b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:46:34.558966 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:34.558945 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72818e97-e535-41bf-afec-312928b1750b-kube-api-access-b6tcn" (OuterVolumeSpecName: "kube-api-access-b6tcn") pod "72818e97-e535-41bf-afec-312928b1750b" (UID: "72818e97-e535-41bf-afec-312928b1750b"). InnerVolumeSpecName "kube-api-access-b6tcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:46:34.560946 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:34.560916 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-util" (OuterVolumeSpecName: "util") pod "72818e97-e535-41bf-afec-312928b1750b" (UID: "72818e97-e535-41bf-afec-312928b1750b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:46:34.658395 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:34.658366 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6tcn\" (UniqueName: \"kubernetes.io/projected/72818e97-e535-41bf-afec-312928b1750b-kube-api-access-b6tcn\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:46:34.658395 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:34.658392 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-util\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:46:34.658395 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:34.658402 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72818e97-e535-41bf-afec-312928b1750b-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:46:35.299471 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:35.299440 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" event={"ID":"72818e97-e535-41bf-afec-312928b1750b","Type":"ContainerDied","Data":"0ff0d1afd554e9452b330a6f9ced99bb1d7551fb61de3fd1d98ca6b4e8a0f57d"} Jun 03 15:46:35.299471 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:35.299456 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frqpqm" Jun 03 15:46:35.299471 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:35.299473 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ff0d1afd554e9452b330a6f9ced99bb1d7551fb61de3fd1d98ca6b4e8a0f57d" Jun 03 15:46:38.294155 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:38.294125 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-f2g29" Jun 03 15:46:43.863112 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.863077 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm"] Jun 03 15:46:43.863596 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.863412 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72818e97-e535-41bf-afec-312928b1750b" containerName="pull" Jun 03 15:46:43.863596 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.863425 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="72818e97-e535-41bf-afec-312928b1750b" containerName="pull" Jun 03 15:46:43.863596 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.863448 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72818e97-e535-41bf-afec-312928b1750b" containerName="extract" Jun 03 15:46:43.863596 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.863453 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="72818e97-e535-41bf-afec-312928b1750b" containerName="extract" Jun 03 15:46:43.863596 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.863461 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72818e97-e535-41bf-afec-312928b1750b" containerName="util" Jun 03 15:46:43.863596 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.863466 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="72818e97-e535-41bf-afec-312928b1750b" containerName="util" Jun 03 15:46:43.863596 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.863519 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="72818e97-e535-41bf-afec-312928b1750b" containerName="extract" Jun 03 15:46:43.913761 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.913710 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm"] Jun 03 15:46:43.913903 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.913809 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm" Jun 03 15:46:43.916698 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.916673 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-thksd\"" Jun 03 15:46:43.916698 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.916689 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 15:46:43.917891 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.917869 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:46:43.927458 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.927438 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637c37f5-4a78-48af-bbb8-150ab9949dd9-tmp\") pod \"openshift-lws-operator-bfc7f696d-lg2zm\" (UID: \"637c37f5-4a78-48af-bbb8-150ab9949dd9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm" Jun 03 15:46:43.927544 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:43.927471 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm47k\" (UniqueName: \"kubernetes.io/projected/637c37f5-4a78-48af-bbb8-150ab9949dd9-kube-api-access-hm47k\") pod \"openshift-lws-operator-bfc7f696d-lg2zm\" (UID: \"637c37f5-4a78-48af-bbb8-150ab9949dd9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm" Jun 03 15:46:44.028879 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:44.028846 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637c37f5-4a78-48af-bbb8-150ab9949dd9-tmp\") pod \"openshift-lws-operator-bfc7f696d-lg2zm\" (UID: \"637c37f5-4a78-48af-bbb8-150ab9949dd9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm" Jun 03 15:46:44.029016 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:44.028886 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hm47k\" (UniqueName: \"kubernetes.io/projected/637c37f5-4a78-48af-bbb8-150ab9949dd9-kube-api-access-hm47k\") pod \"openshift-lws-operator-bfc7f696d-lg2zm\" (UID: \"637c37f5-4a78-48af-bbb8-150ab9949dd9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm" Jun 03 15:46:44.029171 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:44.029151 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637c37f5-4a78-48af-bbb8-150ab9949dd9-tmp\") pod \"openshift-lws-operator-bfc7f696d-lg2zm\" (UID: \"637c37f5-4a78-48af-bbb8-150ab9949dd9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm" Jun 03 15:46:44.037172 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:44.037148 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm47k\" (UniqueName: \"kubernetes.io/projected/637c37f5-4a78-48af-bbb8-150ab9949dd9-kube-api-access-hm47k\") pod \"openshift-lws-operator-bfc7f696d-lg2zm\" (UID: \"637c37f5-4a78-48af-bbb8-150ab9949dd9\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm" Jun 03 15:46:44.222993 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:44.222958 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm" Jun 03 15:46:44.371985 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:44.371962 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm"] Jun 03 15:46:44.374487 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:46:44.374453 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod637c37f5_4a78_48af_bbb8_150ab9949dd9.slice/crio-5d2a0428c8c49dfc2d2956460d36330b0a8002eb933eaaff01996b23a4bd24a1 WatchSource:0}: Error finding container 5d2a0428c8c49dfc2d2956460d36330b0a8002eb933eaaff01996b23a4bd24a1: Status 404 returned error can't find the container with id 5d2a0428c8c49dfc2d2956460d36330b0a8002eb933eaaff01996b23a4bd24a1 Jun 03 15:46:45.335119 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:45.335081 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm" event={"ID":"637c37f5-4a78-48af-bbb8-150ab9949dd9","Type":"ContainerStarted","Data":"5d2a0428c8c49dfc2d2956460d36330b0a8002eb933eaaff01996b23a4bd24a1"} Jun 03 15:46:47.343580 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:47.343534 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm" event={"ID":"637c37f5-4a78-48af-bbb8-150ab9949dd9","Type":"ContainerStarted","Data":"348bedd44ce63bbdbde3ade35df4f885d821a478da77752e721ba3b7df0de9f0"} Jun 03 15:46:47.363496 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:47.363441 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lg2zm" podStartSLOduration=2.2934313570000002 podStartE2EDuration="4.363426244s" podCreationTimestamp="2026-06-03 15:46:43 +0000 UTC" firstStartedPulling="2026-06-03 15:46:44.375953122 +0000 UTC m=+363.613700638" lastFinishedPulling="2026-06-03 15:46:46.445947998 +0000 UTC m=+365.683695525" observedRunningTime="2026-06-03 15:46:47.36200034 +0000 UTC m=+366.599747878" watchObservedRunningTime="2026-06-03 15:46:47.363426244 +0000 UTC m=+366.601173783" Jun 03 15:46:50.323632 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.323593 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c"] Jun 03 15:46:50.326127 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.326111 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:50.331541 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.331515 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:46:50.331541 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.331536 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:46:50.331846 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.331830 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw27v\"" Jun 03 15:46:50.338650 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.338628 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c"] Jun 03 15:46:50.382255 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.382222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:50.382426 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.382283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvx6l\" (UniqueName: \"kubernetes.io/projected/90f20f9d-3846-4255-bd3b-056692b486ea-kube-api-access-wvx6l\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:50.382426 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.382320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:50.483776 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.483740 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:50.483924 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.483800 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvx6l\" (UniqueName: \"kubernetes.io/projected/90f20f9d-3846-4255-bd3b-056692b486ea-kube-api-access-wvx6l\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:50.483924 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.483821 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:50.484170 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.484155 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:50.484206 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.484148 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:50.493895 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.493867 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvx6l\" (UniqueName: \"kubernetes.io/projected/90f20f9d-3846-4255-bd3b-056692b486ea-kube-api-access-wvx6l\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:50.634955 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.634890 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:50.769881 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:50.769841 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c"] Jun 03 15:46:50.774520 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:46:50.774479 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f20f9d_3846_4255_bd3b_056692b486ea.slice/crio-6fee4a8e43be4e8191d23538a445cf258fa674dd1992814855137af51cc30879 WatchSource:0}: Error finding container 6fee4a8e43be4e8191d23538a445cf258fa674dd1992814855137af51cc30879: Status 404 returned error can't find the container with id 6fee4a8e43be4e8191d23538a445cf258fa674dd1992814855137af51cc30879 Jun 03 15:46:51.359811 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:51.359775 2566 generic.go:358] "Generic (PLEG): container finished" podID="90f20f9d-3846-4255-bd3b-056692b486ea" containerID="8060033a6d0ddf9451414a4f0e4be54fcf1a3c52d35a08edbc1ecf4865eb2c5a" exitCode=0 Jun 03 15:46:51.360224 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:51.359820 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" event={"ID":"90f20f9d-3846-4255-bd3b-056692b486ea","Type":"ContainerDied","Data":"8060033a6d0ddf9451414a4f0e4be54fcf1a3c52d35a08edbc1ecf4865eb2c5a"} Jun 03 15:46:51.360224 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:51.359843 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" event={"ID":"90f20f9d-3846-4255-bd3b-056692b486ea","Type":"ContainerStarted","Data":"6fee4a8e43be4e8191d23538a445cf258fa674dd1992814855137af51cc30879"} Jun 03 15:46:52.364704 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:52.364667 2566 generic.go:358] "Generic (PLEG): container finished" podID="90f20f9d-3846-4255-bd3b-056692b486ea" containerID="104e59afdcc2162d4a0f2028921e1f4b2ec5c89d00cd03799d558859e3a3fbc2" exitCode=0 Jun 03 15:46:52.365128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:52.364765 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" event={"ID":"90f20f9d-3846-4255-bd3b-056692b486ea","Type":"ContainerDied","Data":"104e59afdcc2162d4a0f2028921e1f4b2ec5c89d00cd03799d558859e3a3fbc2"} Jun 03 15:46:53.370343 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:53.370309 2566 generic.go:358] "Generic (PLEG): container finished" podID="90f20f9d-3846-4255-bd3b-056692b486ea" containerID="fe661a288932c68056765b98c8b4b7a299b649c458c423d72598af750efb47f9" exitCode=0 Jun 03 15:46:53.370709 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:53.370384 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" event={"ID":"90f20f9d-3846-4255-bd3b-056692b486ea","Type":"ContainerDied","Data":"fe661a288932c68056765b98c8b4b7a299b649c458c423d72598af750efb47f9"} Jun 03 15:46:54.498620 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:54.498594 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:46:54.616443 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:54.616415 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-util\") pod \"90f20f9d-3846-4255-bd3b-056692b486ea\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " Jun 03 15:46:54.616597 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:54.616456 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvx6l\" (UniqueName: \"kubernetes.io/projected/90f20f9d-3846-4255-bd3b-056692b486ea-kube-api-access-wvx6l\") pod \"90f20f9d-3846-4255-bd3b-056692b486ea\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " Jun 03 15:46:54.616597 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:54.616502 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-bundle\") pod \"90f20f9d-3846-4255-bd3b-056692b486ea\" (UID: \"90f20f9d-3846-4255-bd3b-056692b486ea\") " Jun 03 15:46:54.617254 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:54.617227 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-bundle" (OuterVolumeSpecName: "bundle") pod "90f20f9d-3846-4255-bd3b-056692b486ea" (UID: "90f20f9d-3846-4255-bd3b-056692b486ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:46:54.618653 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:54.618619 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90f20f9d-3846-4255-bd3b-056692b486ea-kube-api-access-wvx6l" (OuterVolumeSpecName: "kube-api-access-wvx6l") pod "90f20f9d-3846-4255-bd3b-056692b486ea" (UID: "90f20f9d-3846-4255-bd3b-056692b486ea"). InnerVolumeSpecName "kube-api-access-wvx6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:46:54.624327 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:54.624300 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-util" (OuterVolumeSpecName: "util") pod "90f20f9d-3846-4255-bd3b-056692b486ea" (UID: "90f20f9d-3846-4255-bd3b-056692b486ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:46:54.717599 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:54.717571 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-util\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:46:54.717599 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:54.717597 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvx6l\" (UniqueName: \"kubernetes.io/projected/90f20f9d-3846-4255-bd3b-056692b486ea-kube-api-access-wvx6l\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:46:54.717803 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:54.717609 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90f20f9d-3846-4255-bd3b-056692b486ea-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:46:55.379125 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:55.379086 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" event={"ID":"90f20f9d-3846-4255-bd3b-056692b486ea","Type":"ContainerDied","Data":"6fee4a8e43be4e8191d23538a445cf258fa674dd1992814855137af51cc30879"} Jun 03 15:46:55.379125 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:55.379126 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fee4a8e43be4e8191d23538a445cf258fa674dd1992814855137af51cc30879" Jun 03 15:46:55.379327 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:46:55.379150 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfss9c" Jun 03 15:47:03.526300 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.526262 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz"] Jun 03 15:47:03.526781 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.526741 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f20f9d-3846-4255-bd3b-056692b486ea" containerName="util" Jun 03 15:47:03.526781 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.526760 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f20f9d-3846-4255-bd3b-056692b486ea" containerName="util" Jun 03 15:47:03.526912 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.526785 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f20f9d-3846-4255-bd3b-056692b486ea" containerName="pull" Jun 03 15:47:03.526912 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.526793 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f20f9d-3846-4255-bd3b-056692b486ea" containerName="pull" Jun 03 15:47:03.526912 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.526807 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f20f9d-3846-4255-bd3b-056692b486ea" containerName="extract" Jun 03 15:47:03.526912 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.526815 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f20f9d-3846-4255-bd3b-056692b486ea" containerName="extract" Jun 03 15:47:03.527100 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.526923 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="90f20f9d-3846-4255-bd3b-056692b486ea" containerName="extract" Jun 03 15:47:03.529921 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.529900 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.534948 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.534926 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 15:47:03.535062 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.535040 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 15:47:03.535155 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.535138 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 15:47:03.535293 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.535275 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fbrvd\"" Jun 03 15:47:03.535413 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.535392 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 15:47:03.550190 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.550169 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz"] Jun 03 15:47:03.589991 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.589965 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba7c3685-c450-469c-a17c-07c913c1eb01-webhook-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.590095 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.590012 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba7c3685-c450-469c-a17c-07c913c1eb01-tmp\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.590095 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.590045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba7c3685-c450-469c-a17c-07c913c1eb01-manifests\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.590095 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.590078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wr4f\" (UniqueName: \"kubernetes.io/projected/ba7c3685-c450-469c-a17c-07c913c1eb01-kube-api-access-2wr4f\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.590200 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.590131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba7c3685-c450-469c-a17c-07c913c1eb01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.690604 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.690575 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba7c3685-c450-469c-a17c-07c913c1eb01-tmp\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.690758 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.690617 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba7c3685-c450-469c-a17c-07c913c1eb01-manifests\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.690758 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.690637 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr4f\" (UniqueName: \"kubernetes.io/projected/ba7c3685-c450-469c-a17c-07c913c1eb01-kube-api-access-2wr4f\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.690758 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.690656 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba7c3685-c450-469c-a17c-07c913c1eb01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.690932 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.690778 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba7c3685-c450-469c-a17c-07c913c1eb01-webhook-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.691079 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.691048 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba7c3685-c450-469c-a17c-07c913c1eb01-manifests\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.693080 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.693053 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba7c3685-c450-469c-a17c-07c913c1eb01-tmp\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.693294 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.693277 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba7c3685-c450-469c-a17c-07c913c1eb01-webhook-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.693422 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.693400 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba7c3685-c450-469c-a17c-07c913c1eb01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.700326 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.700304 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wr4f\" (UniqueName: \"kubernetes.io/projected/ba7c3685-c450-469c-a17c-07c913c1eb01-kube-api-access-2wr4f\") pod \"opendatahub-operator-controller-manager-548f4487f9-9zbqz\" (UID: \"ba7c3685-c450-469c-a17c-07c913c1eb01\") " pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.840614 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.840533 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:03.989058 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:03.988942 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz"] Jun 03 15:47:03.991581 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:47:03.991552 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7c3685_c450_469c_a17c_07c913c1eb01.slice/crio-1ba26ebf8ab329d16f70f1c1b7c085761ad75e89dfe39c33231c542e58270189 WatchSource:0}: Error finding container 1ba26ebf8ab329d16f70f1c1b7c085761ad75e89dfe39c33231c542e58270189: Status 404 returned error can't find the container with id 1ba26ebf8ab329d16f70f1c1b7c085761ad75e89dfe39c33231c542e58270189 Jun 03 15:47:04.410287 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:04.410248 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" event={"ID":"ba7c3685-c450-469c-a17c-07c913c1eb01","Type":"ContainerStarted","Data":"1ba26ebf8ab329d16f70f1c1b7c085761ad75e89dfe39c33231c542e58270189"} Jun 03 15:47:07.423907 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:07.423868 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" event={"ID":"ba7c3685-c450-469c-a17c-07c913c1eb01","Type":"ContainerStarted","Data":"312488b5d5b52c77aa5e505865181a3bb6b76be29ceac6a02e11ea912e925ce4"} Jun 03 15:47:08.429022 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:08.428985 2566 generic.go:358] "Generic (PLEG): container finished" podID="ba7c3685-c450-469c-a17c-07c913c1eb01" containerID="312488b5d5b52c77aa5e505865181a3bb6b76be29ceac6a02e11ea912e925ce4" exitCode=0 Jun 03 15:47:08.429477 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:08.429047 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" event={"ID":"ba7c3685-c450-469c-a17c-07c913c1eb01","Type":"ContainerDied","Data":"312488b5d5b52c77aa5e505865181a3bb6b76be29ceac6a02e11ea912e925ce4"} Jun 03 15:47:09.433886 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:09.433852 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" event={"ID":"ba7c3685-c450-469c-a17c-07c913c1eb01","Type":"ContainerStarted","Data":"7761c9e508f7787f37a0d6117aba98d6447d08654a2e203d9b2608d868355e64"} Jun 03 15:47:09.434231 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:09.434012 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:09.461738 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:09.461680 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" podStartSLOduration=1.728651024 podStartE2EDuration="6.461665831s" podCreationTimestamp="2026-06-03 15:47:03 +0000 UTC" firstStartedPulling="2026-06-03 15:47:03.99349441 +0000 UTC m=+383.231241941" lastFinishedPulling="2026-06-03 15:47:08.726509228 +0000 UTC m=+387.964256748" observedRunningTime="2026-06-03 15:47:09.459140824 +0000 UTC m=+388.696888375" watchObservedRunningTime="2026-06-03 15:47:09.461665831 +0000 UTC m=+388.699413370" Jun 03 15:47:20.440135 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:20.440106 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-548f4487f9-9zbqz" Jun 03 15:47:33.580178 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.580137 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j"] Jun 03 15:47:33.583596 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.583574 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" Jun 03 15:47:33.588579 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.588556 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 15:47:33.588704 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.588675 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 15:47:33.603108 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.603085 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j"] Jun 03 15:47:33.705188 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.705154 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx"] Jun 03 15:47:33.708662 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.708639 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:33.712568 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.712533 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:47:33.712855 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.712836 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:47:33.713029 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.713008 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw27v\"" Jun 03 15:47:33.727870 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.727849 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx"] Jun 03 15:47:33.737907 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.737886 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbh2f\" (UniqueName: \"kubernetes.io/projected/027033de-70d8-4b3e-ae9a-112cac41800e-kube-api-access-rbh2f\") pod \"kube-auth-proxy-6cc4c89bc4-vq68j\" (UID: \"027033de-70d8-4b3e-ae9a-112cac41800e\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" Jun 03 15:47:33.738004 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.737919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/027033de-70d8-4b3e-ae9a-112cac41800e-tls-certs\") pod \"kube-auth-proxy-6cc4c89bc4-vq68j\" (UID: \"027033de-70d8-4b3e-ae9a-112cac41800e\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" Jun 03 15:47:33.738004 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.737958 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/027033de-70d8-4b3e-ae9a-112cac41800e-tmp\") pod \"kube-auth-proxy-6cc4c89bc4-vq68j\" (UID: \"027033de-70d8-4b3e-ae9a-112cac41800e\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" Jun 03 15:47:33.839306 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.839229 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:33.839435 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.839301 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbh2f\" (UniqueName: \"kubernetes.io/projected/027033de-70d8-4b3e-ae9a-112cac41800e-kube-api-access-rbh2f\") pod \"kube-auth-proxy-6cc4c89bc4-vq68j\" (UID: \"027033de-70d8-4b3e-ae9a-112cac41800e\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" Jun 03 15:47:33.839435 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.839338 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/027033de-70d8-4b3e-ae9a-112cac41800e-tls-certs\") pod \"kube-auth-proxy-6cc4c89bc4-vq68j\" (UID: \"027033de-70d8-4b3e-ae9a-112cac41800e\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" Jun 03 15:47:33.839435 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.839387 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/027033de-70d8-4b3e-ae9a-112cac41800e-tmp\") pod \"kube-auth-proxy-6cc4c89bc4-vq68j\" (UID: \"027033de-70d8-4b3e-ae9a-112cac41800e\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" Jun 03 15:47:33.839435 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.839418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:33.839598 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.839447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgbvd\" (UniqueName: \"kubernetes.io/projected/c8d1fb60-225e-457e-8980-e27afe1fc049-kube-api-access-hgbvd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:33.841893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.841865 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/027033de-70d8-4b3e-ae9a-112cac41800e-tmp\") pod \"kube-auth-proxy-6cc4c89bc4-vq68j\" (UID: \"027033de-70d8-4b3e-ae9a-112cac41800e\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" Jun 03 15:47:33.842003 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.841918 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/027033de-70d8-4b3e-ae9a-112cac41800e-tls-certs\") pod \"kube-auth-proxy-6cc4c89bc4-vq68j\" (UID: \"027033de-70d8-4b3e-ae9a-112cac41800e\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" Jun 03 15:47:33.849382 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.849361 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbh2f\" (UniqueName: \"kubernetes.io/projected/027033de-70d8-4b3e-ae9a-112cac41800e-kube-api-access-rbh2f\") pod \"kube-auth-proxy-6cc4c89bc4-vq68j\" (UID: \"027033de-70d8-4b3e-ae9a-112cac41800e\") " pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" Jun 03 15:47:33.895146 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.895120 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" Jun 03 15:47:33.940065 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.940032 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:33.940246 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.940119 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:33.940246 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.940138 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hgbvd\" (UniqueName: \"kubernetes.io/projected/c8d1fb60-225e-457e-8980-e27afe1fc049-kube-api-access-hgbvd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:33.940456 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.940429 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:33.940682 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.940643 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:33.955287 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:33.955184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgbvd\" (UniqueName: \"kubernetes.io/projected/c8d1fb60-225e-457e-8980-e27afe1fc049-kube-api-access-hgbvd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:34.017817 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:34.017787 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:34.030932 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:34.030906 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j"] Jun 03 15:47:34.033461 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:47:34.033435 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027033de_70d8_4b3e_ae9a_112cac41800e.slice/crio-bfbe336769f6794b073aea616f36c5c469e3bebc04f7dabfede3d307a6199292 WatchSource:0}: Error finding container bfbe336769f6794b073aea616f36c5c469e3bebc04f7dabfede3d307a6199292: Status 404 returned error can't find the container with id bfbe336769f6794b073aea616f36c5c469e3bebc04f7dabfede3d307a6199292 Jun 03 15:47:34.154908 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:34.154866 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx"] Jun 03 15:47:34.157491 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:47:34.157453 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d1fb60_225e_457e_8980_e27afe1fc049.slice/crio-a28041e46036a4f3592ea2eaecf652acf3c175610e53ce33af963327dbaaf4f4 WatchSource:0}: Error finding container a28041e46036a4f3592ea2eaecf652acf3c175610e53ce33af963327dbaaf4f4: Status 404 returned error can't find the container with id a28041e46036a4f3592ea2eaecf652acf3c175610e53ce33af963327dbaaf4f4 Jun 03 15:47:34.520502 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:34.520464 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" event={"ID":"027033de-70d8-4b3e-ae9a-112cac41800e","Type":"ContainerStarted","Data":"bfbe336769f6794b073aea616f36c5c469e3bebc04f7dabfede3d307a6199292"} Jun 03 15:47:34.521864 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:34.521834 2566 generic.go:358] "Generic (PLEG): container finished" podID="c8d1fb60-225e-457e-8980-e27afe1fc049" containerID="45d4ce904cf011aef0c1d15c714712496aa0451923b550b2e3b2bff9bc5f6434" exitCode=0 Jun 03 15:47:34.521991 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:34.521913 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" event={"ID":"c8d1fb60-225e-457e-8980-e27afe1fc049","Type":"ContainerDied","Data":"45d4ce904cf011aef0c1d15c714712496aa0451923b550b2e3b2bff9bc5f6434"} Jun 03 15:47:34.521991 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:34.521949 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" event={"ID":"c8d1fb60-225e-457e-8980-e27afe1fc049","Type":"ContainerStarted","Data":"a28041e46036a4f3592ea2eaecf652acf3c175610e53ce33af963327dbaaf4f4"} Jun 03 15:47:35.084768 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.083287 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5"] Jun 03 15:47:35.087125 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.087102 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:47:35.090861 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.090663 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kx7lx\"" Jun 03 15:47:35.092123 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.091934 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 15:47:35.093988 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.093845 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc"] Jun 03 15:47:35.097401 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.097382 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" Jun 03 15:47:35.103680 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.103660 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jn94f\"" Jun 03 15:47:35.103999 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.103978 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 15:47:35.112781 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.112758 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5"] Jun 03 15:47:35.127919 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.127891 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc"] Jun 03 15:47:35.251788 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.251749 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98f57d4f-ad70-4f36-a558-c1df7e231226-cert\") pod \"llmisvc-controller-manager-c6b9847d7-6nmkc\" (UID: \"98f57d4f-ad70-4f36-a558-c1df7e231226\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" Jun 03 15:47:35.251981 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.251827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tszc7\" (UniqueName: \"kubernetes.io/projected/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-kube-api-access-tszc7\") pod \"kserve-controller-manager-7c99ffcdcd-5lvh5\" (UID: \"f655bbcb-6f30-4d7d-94ac-3c3b3322fb73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:47:35.251981 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.251896 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-cert\") pod \"kserve-controller-manager-7c99ffcdcd-5lvh5\" (UID: \"f655bbcb-6f30-4d7d-94ac-3c3b3322fb73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:47:35.252111 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.252014 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr8gn\" (UniqueName: \"kubernetes.io/projected/98f57d4f-ad70-4f36-a558-c1df7e231226-kube-api-access-cr8gn\") pod \"llmisvc-controller-manager-c6b9847d7-6nmkc\" (UID: \"98f57d4f-ad70-4f36-a558-c1df7e231226\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" Jun 03 15:47:35.353489 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.353323 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-cert\") pod \"kserve-controller-manager-7c99ffcdcd-5lvh5\" (UID: \"f655bbcb-6f30-4d7d-94ac-3c3b3322fb73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:47:35.353489 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.353433 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cr8gn\" (UniqueName: \"kubernetes.io/projected/98f57d4f-ad70-4f36-a558-c1df7e231226-kube-api-access-cr8gn\") pod \"llmisvc-controller-manager-c6b9847d7-6nmkc\" (UID: \"98f57d4f-ad70-4f36-a558-c1df7e231226\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" Jun 03 15:47:35.353489 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.353470 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98f57d4f-ad70-4f36-a558-c1df7e231226-cert\") pod \"llmisvc-controller-manager-c6b9847d7-6nmkc\" (UID: \"98f57d4f-ad70-4f36-a558-c1df7e231226\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" Jun 03 15:47:35.353755 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.353516 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tszc7\" (UniqueName: \"kubernetes.io/projected/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-kube-api-access-tszc7\") pod \"kserve-controller-manager-7c99ffcdcd-5lvh5\" (UID: \"f655bbcb-6f30-4d7d-94ac-3c3b3322fb73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:47:35.353827 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:47:35.353468 2566 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 03 15:47:35.353881 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:47:35.353843 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-cert podName:f655bbcb-6f30-4d7d-94ac-3c3b3322fb73 nodeName:}" failed. No retries permitted until 2026-06-03 15:47:35.85381753 +0000 UTC m=+415.091565059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-cert") pod "kserve-controller-manager-7c99ffcdcd-5lvh5" (UID: "f655bbcb-6f30-4d7d-94ac-3c3b3322fb73") : secret "kserve-webhook-server-cert" not found Jun 03 15:47:35.357284 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.357237 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98f57d4f-ad70-4f36-a558-c1df7e231226-cert\") pod \"llmisvc-controller-manager-c6b9847d7-6nmkc\" (UID: \"98f57d4f-ad70-4f36-a558-c1df7e231226\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" Jun 03 15:47:35.372810 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.372752 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr8gn\" (UniqueName: \"kubernetes.io/projected/98f57d4f-ad70-4f36-a558-c1df7e231226-kube-api-access-cr8gn\") pod \"llmisvc-controller-manager-c6b9847d7-6nmkc\" (UID: \"98f57d4f-ad70-4f36-a558-c1df7e231226\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" Jun 03 15:47:35.375499 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.375473 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tszc7\" (UniqueName: \"kubernetes.io/projected/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-kube-api-access-tszc7\") pod \"kserve-controller-manager-7c99ffcdcd-5lvh5\" (UID: \"f655bbcb-6f30-4d7d-94ac-3c3b3322fb73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:47:35.413386 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.413358 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" Jun 03 15:47:35.591458 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.591352 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc"] Jun 03 15:47:35.594909 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:47:35.594866 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod98f57d4f_ad70_4f36_a558_c1df7e231226.slice/crio-df8e507a6b9e6d1719539a26e21d95e24057957525ba4111b45d2cdecfc99dbd WatchSource:0}: Error finding container df8e507a6b9e6d1719539a26e21d95e24057957525ba4111b45d2cdecfc99dbd: Status 404 returned error can't find the container with id df8e507a6b9e6d1719539a26e21d95e24057957525ba4111b45d2cdecfc99dbd Jun 03 15:47:35.860504 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:35.860462 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-cert\") pod \"kserve-controller-manager-7c99ffcdcd-5lvh5\" (UID: \"f655bbcb-6f30-4d7d-94ac-3c3b3322fb73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:47:35.860680 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:47:35.860612 2566 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 03 15:47:35.860791 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:47:35.860688 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-cert podName:f655bbcb-6f30-4d7d-94ac-3c3b3322fb73 nodeName:}" failed. No retries permitted until 2026-06-03 15:47:36.860666382 +0000 UTC m=+416.098413904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-cert") pod "kserve-controller-manager-7c99ffcdcd-5lvh5" (UID: "f655bbcb-6f30-4d7d-94ac-3c3b3322fb73") : secret "kserve-webhook-server-cert" not found Jun 03 15:47:36.533388 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:36.533349 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" event={"ID":"98f57d4f-ad70-4f36-a558-c1df7e231226","Type":"ContainerStarted","Data":"df8e507a6b9e6d1719539a26e21d95e24057957525ba4111b45d2cdecfc99dbd"} Jun 03 15:47:36.870016 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:36.869985 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-cert\") pod \"kserve-controller-manager-7c99ffcdcd-5lvh5\" (UID: \"f655bbcb-6f30-4d7d-94ac-3c3b3322fb73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:47:36.872997 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:36.872966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f655bbcb-6f30-4d7d-94ac-3c3b3322fb73-cert\") pod \"kserve-controller-manager-7c99ffcdcd-5lvh5\" (UID: \"f655bbcb-6f30-4d7d-94ac-3c3b3322fb73\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:47:36.902808 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:36.902770 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:47:37.178682 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:37.178656 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5"] Jun 03 15:47:37.181382 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:47:37.181354 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf655bbcb_6f30_4d7d_94ac_3c3b3322fb73.slice/crio-d547a36ca55d9514dfa222eec0777ed55f05346741665e739d52932f192ab561 WatchSource:0}: Error finding container d547a36ca55d9514dfa222eec0777ed55f05346741665e739d52932f192ab561: Status 404 returned error can't find the container with id d547a36ca55d9514dfa222eec0777ed55f05346741665e739d52932f192ab561 Jun 03 15:47:37.539692 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:37.539635 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" event={"ID":"027033de-70d8-4b3e-ae9a-112cac41800e","Type":"ContainerStarted","Data":"19cd4c202cc42d00e5c278151050dee5f7a2eee0944d25e5112e2dbf7a5b1ba0"} Jun 03 15:47:37.541046 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:37.540995 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" event={"ID":"f655bbcb-6f30-4d7d-94ac-3c3b3322fb73","Type":"ContainerStarted","Data":"d547a36ca55d9514dfa222eec0777ed55f05346741665e739d52932f192ab561"} Jun 03 15:47:37.546079 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:37.545982 2566 generic.go:358] "Generic (PLEG): container finished" podID="c8d1fb60-225e-457e-8980-e27afe1fc049" containerID="9426d50ec495a1bdee0558d3443b0da19adec3a15c37ab1f176ecf6db82eddca" exitCode=0 Jun 03 15:47:37.546079 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:37.546042 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" event={"ID":"c8d1fb60-225e-457e-8980-e27afe1fc049","Type":"ContainerDied","Data":"9426d50ec495a1bdee0558d3443b0da19adec3a15c37ab1f176ecf6db82eddca"} Jun 03 15:47:37.563855 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:37.563799 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6cc4c89bc4-vq68j" podStartSLOduration=1.5291388590000001 podStartE2EDuration="4.56378041s" podCreationTimestamp="2026-06-03 15:47:33 +0000 UTC" firstStartedPulling="2026-06-03 15:47:34.035255269 +0000 UTC m=+413.273002788" lastFinishedPulling="2026-06-03 15:47:37.069896807 +0000 UTC m=+416.307644339" observedRunningTime="2026-06-03 15:47:37.562264147 +0000 UTC m=+416.800011687" watchObservedRunningTime="2026-06-03 15:47:37.56378041 +0000 UTC m=+416.801527952" Jun 03 15:47:38.551511 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:38.551433 2566 generic.go:358] "Generic (PLEG): container finished" podID="c8d1fb60-225e-457e-8980-e27afe1fc049" containerID="1d5099af3c099a2d012e9f8e851e3a47b44deb350ade24586152743cfe9070d4" exitCode=0 Jun 03 15:47:38.551932 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:38.551513 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" event={"ID":"c8d1fb60-225e-457e-8980-e27afe1fc049","Type":"ContainerDied","Data":"1d5099af3c099a2d012e9f8e851e3a47b44deb350ade24586152743cfe9070d4"} Jun 03 15:47:40.103219 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.103187 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:40.198299 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.198256 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-util\") pod \"c8d1fb60-225e-457e-8980-e27afe1fc049\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " Jun 03 15:47:40.198474 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.198326 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-bundle\") pod \"c8d1fb60-225e-457e-8980-e27afe1fc049\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " Jun 03 15:47:40.198474 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.198366 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgbvd\" (UniqueName: \"kubernetes.io/projected/c8d1fb60-225e-457e-8980-e27afe1fc049-kube-api-access-hgbvd\") pod \"c8d1fb60-225e-457e-8980-e27afe1fc049\" (UID: \"c8d1fb60-225e-457e-8980-e27afe1fc049\") " Jun 03 15:47:40.199319 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.199292 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-bundle" (OuterVolumeSpecName: "bundle") pod "c8d1fb60-225e-457e-8980-e27afe1fc049" (UID: "c8d1fb60-225e-457e-8980-e27afe1fc049"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:47:40.201264 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.201231 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8d1fb60-225e-457e-8980-e27afe1fc049-kube-api-access-hgbvd" (OuterVolumeSpecName: "kube-api-access-hgbvd") pod "c8d1fb60-225e-457e-8980-e27afe1fc049" (UID: "c8d1fb60-225e-457e-8980-e27afe1fc049"). InnerVolumeSpecName "kube-api-access-hgbvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:47:40.202944 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.202899 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-util" (OuterVolumeSpecName: "util") pod "c8d1fb60-225e-457e-8980-e27afe1fc049" (UID: "c8d1fb60-225e-457e-8980-e27afe1fc049"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:47:40.299046 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.299013 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-util\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:47:40.299046 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.299042 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8d1fb60-225e-457e-8980-e27afe1fc049-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:47:40.299046 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.299055 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgbvd\" (UniqueName: \"kubernetes.io/projected/c8d1fb60-225e-457e-8980-e27afe1fc049-kube-api-access-hgbvd\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:47:40.567149 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.567109 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" event={"ID":"c8d1fb60-225e-457e-8980-e27afe1fc049","Type":"ContainerDied","Data":"a28041e46036a4f3592ea2eaecf652acf3c175610e53ce33af963327dbaaf4f4"} Jun 03 15:47:40.567149 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.567152 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a28041e46036a4f3592ea2eaecf652acf3c175610e53ce33af963327dbaaf4f4" Jun 03 15:47:40.567364 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:40.567191 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48356qqwx" Jun 03 15:47:41.571770 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:41.571713 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" event={"ID":"f655bbcb-6f30-4d7d-94ac-3c3b3322fb73","Type":"ContainerStarted","Data":"3f04159947fd86c3b3fe0904e4a43ff96f1fbf4c27b5b2d573836a9e3d6842f2"} Jun 03 15:47:41.572168 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:41.571868 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:47:41.572995 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:41.572966 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" event={"ID":"98f57d4f-ad70-4f36-a558-c1df7e231226","Type":"ContainerStarted","Data":"aada60327f77df7cf23453f93c5bcca24b3966801bd68f6e38f5dcf123966145"} Jun 03 15:47:41.573120 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:41.573105 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" Jun 03 15:47:41.593308 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:41.593264 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" podStartSLOduration=3.082924634 podStartE2EDuration="6.593252683s" podCreationTimestamp="2026-06-03 15:47:35 +0000 UTC" firstStartedPulling="2026-06-03 15:47:37.18334003 +0000 UTC m=+416.421087546" lastFinishedPulling="2026-06-03 15:47:40.693668076 +0000 UTC m=+419.931415595" observedRunningTime="2026-06-03 15:47:41.590834316 +0000 UTC m=+420.828581854" watchObservedRunningTime="2026-06-03 15:47:41.593252683 +0000 UTC m=+420.831000260" Jun 03 15:47:41.615322 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:41.615280 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" podStartSLOduration=1.5211338620000001 podStartE2EDuration="6.615266059s" podCreationTimestamp="2026-06-03 15:47:35 +0000 UTC" firstStartedPulling="2026-06-03 15:47:35.59680943 +0000 UTC m=+414.834556953" lastFinishedPulling="2026-06-03 15:47:40.690941629 +0000 UTC m=+419.928689150" observedRunningTime="2026-06-03 15:47:41.613452289 +0000 UTC m=+420.851199828" watchObservedRunningTime="2026-06-03 15:47:41.615266059 +0000 UTC m=+420.853013576" Jun 03 15:47:47.818241 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.818206 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf"] Jun 03 15:47:47.818614 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.818536 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d1fb60-225e-457e-8980-e27afe1fc049" containerName="extract" Jun 03 15:47:47.818614 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.818547 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d1fb60-225e-457e-8980-e27afe1fc049" containerName="extract" Jun 03 15:47:47.818614 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.818557 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d1fb60-225e-457e-8980-e27afe1fc049" containerName="pull" Jun 03 15:47:47.818614 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.818561 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d1fb60-225e-457e-8980-e27afe1fc049" containerName="pull" Jun 03 15:47:47.818614 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.818576 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d1fb60-225e-457e-8980-e27afe1fc049" containerName="util" Jun 03 15:47:47.818614 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.818581 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d1fb60-225e-457e-8980-e27afe1fc049" containerName="util" Jun 03 15:47:47.818813 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.818642 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="c8d1fb60-225e-457e-8980-e27afe1fc049" containerName="extract" Jun 03 15:47:47.823365 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.823344 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:47.827111 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.827080 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:47:47.827188 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.827138 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw27v\"" Jun 03 15:47:47.827977 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.827962 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:47:47.834123 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.834102 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf"] Jun 03 15:47:47.863119 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.863076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:47.863264 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.863238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:47.863352 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.863321 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpp4s\" (UniqueName: \"kubernetes.io/projected/597390a8-d453-4a5d-9504-f35c63ad6bf4-kube-api-access-hpp4s\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:47.963896 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.963860 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpp4s\" (UniqueName: \"kubernetes.io/projected/597390a8-d453-4a5d-9504-f35c63ad6bf4-kube-api-access-hpp4s\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:47.964149 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.964130 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:47.964328 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.964313 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:47.964607 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.964559 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:47.964819 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.964680 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:47.975862 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:47.975837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpp4s\" (UniqueName: \"kubernetes.io/projected/597390a8-d453-4a5d-9504-f35c63ad6bf4-kube-api-access-hpp4s\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:48.133954 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:48.133873 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:48.274385 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:48.274361 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf"] Jun 03 15:47:48.278697 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:47:48.278666 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597390a8_d453_4a5d_9504_f35c63ad6bf4.slice/crio-338c916a56e7899204098feb0a7421e2eb30b0ec6053e9b1a1cf8a55b07aaac1 WatchSource:0}: Error finding container 338c916a56e7899204098feb0a7421e2eb30b0ec6053e9b1a1cf8a55b07aaac1: Status 404 returned error can't find the container with id 338c916a56e7899204098feb0a7421e2eb30b0ec6053e9b1a1cf8a55b07aaac1 Jun 03 15:47:48.599245 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:48.599204 2566 generic.go:358] "Generic (PLEG): container finished" podID="597390a8-d453-4a5d-9504-f35c63ad6bf4" containerID="e123af53e25e9467102329f2e173cbee04c1a4c837e13d78025d5b116c4e702e" exitCode=0 Jun 03 15:47:48.599428 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:48.599302 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" event={"ID":"597390a8-d453-4a5d-9504-f35c63ad6bf4","Type":"ContainerDied","Data":"e123af53e25e9467102329f2e173cbee04c1a4c837e13d78025d5b116c4e702e"} Jun 03 15:47:48.599428 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:48.599350 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" event={"ID":"597390a8-d453-4a5d-9504-f35c63ad6bf4","Type":"ContainerStarted","Data":"338c916a56e7899204098feb0a7421e2eb30b0ec6053e9b1a1cf8a55b07aaac1"} Jun 03 15:47:49.162396 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.162360 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4"] Jun 03 15:47:49.165793 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.165775 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" Jun 03 15:47:49.168509 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.168488 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 15:47:49.168617 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.168524 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 15:47:49.168667 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.168640 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-xpwxc\"" Jun 03 15:47:49.181367 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.181345 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4"] Jun 03 15:47:49.275637 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.275563 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/afddbebe-d0f3-4a1d-9316-88aba7d33ef5-operator-config\") pod \"servicemesh-operator3-55f49c5f94-lxgn4\" (UID: \"afddbebe-d0f3-4a1d-9316-88aba7d33ef5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" Jun 03 15:47:49.275898 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.275646 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhz68\" (UniqueName: \"kubernetes.io/projected/afddbebe-d0f3-4a1d-9316-88aba7d33ef5-kube-api-access-fhz68\") pod \"servicemesh-operator3-55f49c5f94-lxgn4\" (UID: \"afddbebe-d0f3-4a1d-9316-88aba7d33ef5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" Jun 03 15:47:49.296054 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.295886 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7888f9cd56-75g2c"] Jun 03 15:47:49.307490 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.307460 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7888f9cd56-75g2c" Jun 03 15:47:49.308127 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.308101 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7888f9cd56-75g2c"] Jun 03 15:47:49.310596 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.310574 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5b4vv\"" Jun 03 15:47:49.310741 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.310573 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 15:47:49.376352 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.376323 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f97v7\" (UniqueName: \"kubernetes.io/projected/280c81e7-fc54-45fe-83fa-69a3d365342c-kube-api-access-f97v7\") pod \"dashboard-redirect-7888f9cd56-75g2c\" (UID: \"280c81e7-fc54-45fe-83fa-69a3d365342c\") " pod="opendatahub/dashboard-redirect-7888f9cd56-75g2c" Jun 03 15:47:49.376443 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.376367 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhz68\" (UniqueName: \"kubernetes.io/projected/afddbebe-d0f3-4a1d-9316-88aba7d33ef5-kube-api-access-fhz68\") pod \"servicemesh-operator3-55f49c5f94-lxgn4\" (UID: \"afddbebe-d0f3-4a1d-9316-88aba7d33ef5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" Jun 03 15:47:49.376443 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.376426 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/280c81e7-fc54-45fe-83fa-69a3d365342c-redirect-config\") pod \"dashboard-redirect-7888f9cd56-75g2c\" (UID: \"280c81e7-fc54-45fe-83fa-69a3d365342c\") " pod="opendatahub/dashboard-redirect-7888f9cd56-75g2c" Jun 03 15:47:49.376562 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.376468 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/afddbebe-d0f3-4a1d-9316-88aba7d33ef5-operator-config\") pod \"servicemesh-operator3-55f49c5f94-lxgn4\" (UID: \"afddbebe-d0f3-4a1d-9316-88aba7d33ef5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" Jun 03 15:47:49.379009 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.378989 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/afddbebe-d0f3-4a1d-9316-88aba7d33ef5-operator-config\") pod \"servicemesh-operator3-55f49c5f94-lxgn4\" (UID: \"afddbebe-d0f3-4a1d-9316-88aba7d33ef5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" Jun 03 15:47:49.385271 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.385252 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhz68\" (UniqueName: \"kubernetes.io/projected/afddbebe-d0f3-4a1d-9316-88aba7d33ef5-kube-api-access-fhz68\") pod \"servicemesh-operator3-55f49c5f94-lxgn4\" (UID: \"afddbebe-d0f3-4a1d-9316-88aba7d33ef5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" Jun 03 15:47:49.475402 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.475377 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" Jun 03 15:47:49.477221 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.477203 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f97v7\" (UniqueName: \"kubernetes.io/projected/280c81e7-fc54-45fe-83fa-69a3d365342c-kube-api-access-f97v7\") pod \"dashboard-redirect-7888f9cd56-75g2c\" (UID: \"280c81e7-fc54-45fe-83fa-69a3d365342c\") " pod="opendatahub/dashboard-redirect-7888f9cd56-75g2c" Jun 03 15:47:49.477281 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.477245 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/280c81e7-fc54-45fe-83fa-69a3d365342c-redirect-config\") pod \"dashboard-redirect-7888f9cd56-75g2c\" (UID: \"280c81e7-fc54-45fe-83fa-69a3d365342c\") " pod="opendatahub/dashboard-redirect-7888f9cd56-75g2c" Jun 03 15:47:49.477933 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.477918 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/280c81e7-fc54-45fe-83fa-69a3d365342c-redirect-config\") pod \"dashboard-redirect-7888f9cd56-75g2c\" (UID: \"280c81e7-fc54-45fe-83fa-69a3d365342c\") " pod="opendatahub/dashboard-redirect-7888f9cd56-75g2c" Jun 03 15:47:49.485649 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.485631 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f97v7\" (UniqueName: \"kubernetes.io/projected/280c81e7-fc54-45fe-83fa-69a3d365342c-kube-api-access-f97v7\") pod \"dashboard-redirect-7888f9cd56-75g2c\" (UID: \"280c81e7-fc54-45fe-83fa-69a3d365342c\") " pod="opendatahub/dashboard-redirect-7888f9cd56-75g2c" Jun 03 15:47:49.604361 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.604330 2566 generic.go:358] "Generic (PLEG): container finished" podID="597390a8-d453-4a5d-9504-f35c63ad6bf4" containerID="6fe92b2a58be122a997e892eb7c67eb060cc317f0766874a88976c1962407b93" exitCode=0 Jun 03 15:47:49.604507 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.604409 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" event={"ID":"597390a8-d453-4a5d-9504-f35c63ad6bf4","Type":"ContainerDied","Data":"6fe92b2a58be122a997e892eb7c67eb060cc317f0766874a88976c1962407b93"} Jun 03 15:47:49.614008 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.613982 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4"] Jun 03 15:47:49.617517 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:47:49.617486 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafddbebe_d0f3_4a1d_9316_88aba7d33ef5.slice/crio-14f49e42f1616c4a890226868a1d0ee79c1b828479e755d3367a6edd21a0ef05 WatchSource:0}: Error finding container 14f49e42f1616c4a890226868a1d0ee79c1b828479e755d3367a6edd21a0ef05: Status 404 returned error can't find the container with id 14f49e42f1616c4a890226868a1d0ee79c1b828479e755d3367a6edd21a0ef05 Jun 03 15:47:49.619100 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.619083 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7888f9cd56-75g2c" Jun 03 15:47:49.789094 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:49.789070 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7888f9cd56-75g2c"] Jun 03 15:47:49.791648 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:47:49.791617 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280c81e7_fc54_45fe_83fa_69a3d365342c.slice/crio-69907dc5aa26c1c8d966066a6e5c4cb0211b7cf1cc880f6722e932236775abed WatchSource:0}: Error finding container 69907dc5aa26c1c8d966066a6e5c4cb0211b7cf1cc880f6722e932236775abed: Status 404 returned error can't find the container with id 69907dc5aa26c1c8d966066a6e5c4cb0211b7cf1cc880f6722e932236775abed Jun 03 15:47:50.610376 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:50.610341 2566 generic.go:358] "Generic (PLEG): container finished" podID="597390a8-d453-4a5d-9504-f35c63ad6bf4" containerID="697affc9d744a40995bc1658eab415da2a21b7c4ea80edbf74edb72f894ee0b2" exitCode=0 Jun 03 15:47:50.610893 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:50.610415 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" event={"ID":"597390a8-d453-4a5d-9504-f35c63ad6bf4","Type":"ContainerDied","Data":"697affc9d744a40995bc1658eab415da2a21b7c4ea80edbf74edb72f894ee0b2"} Jun 03 15:47:50.611948 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:50.611914 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" event={"ID":"afddbebe-d0f3-4a1d-9316-88aba7d33ef5","Type":"ContainerStarted","Data":"14f49e42f1616c4a890226868a1d0ee79c1b828479e755d3367a6edd21a0ef05"} Jun 03 15:47:50.613052 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:50.613022 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7888f9cd56-75g2c" event={"ID":"280c81e7-fc54-45fe-83fa-69a3d365342c","Type":"ContainerStarted","Data":"69907dc5aa26c1c8d966066a6e5c4cb0211b7cf1cc880f6722e932236775abed"} Jun 03 15:47:52.469091 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.469066 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:52.517894 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.517867 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-util\") pod \"597390a8-d453-4a5d-9504-f35c63ad6bf4\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " Jun 03 15:47:52.518067 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.517923 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpp4s\" (UniqueName: \"kubernetes.io/projected/597390a8-d453-4a5d-9504-f35c63ad6bf4-kube-api-access-hpp4s\") pod \"597390a8-d453-4a5d-9504-f35c63ad6bf4\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " Jun 03 15:47:52.518067 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.517977 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-bundle\") pod \"597390a8-d453-4a5d-9504-f35c63ad6bf4\" (UID: \"597390a8-d453-4a5d-9504-f35c63ad6bf4\") " Jun 03 15:47:52.518972 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.518940 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-bundle" (OuterVolumeSpecName: "bundle") pod "597390a8-d453-4a5d-9504-f35c63ad6bf4" (UID: "597390a8-d453-4a5d-9504-f35c63ad6bf4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:47:52.520885 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.520858 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/597390a8-d453-4a5d-9504-f35c63ad6bf4-kube-api-access-hpp4s" (OuterVolumeSpecName: "kube-api-access-hpp4s") pod "597390a8-d453-4a5d-9504-f35c63ad6bf4" (UID: "597390a8-d453-4a5d-9504-f35c63ad6bf4"). InnerVolumeSpecName "kube-api-access-hpp4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:47:52.523950 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.523907 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-util" (OuterVolumeSpecName: "util") pod "597390a8-d453-4a5d-9504-f35c63ad6bf4" (UID: "597390a8-d453-4a5d-9504-f35c63ad6bf4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:47:52.619233 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.619185 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpp4s\" (UniqueName: \"kubernetes.io/projected/597390a8-d453-4a5d-9504-f35c63ad6bf4-kube-api-access-hpp4s\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:47:52.619233 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.619222 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:47:52.619233 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.619232 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/597390a8-d453-4a5d-9504-f35c63ad6bf4-util\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:47:52.630827 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.630787 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" event={"ID":"597390a8-d453-4a5d-9504-f35c63ad6bf4","Type":"ContainerDied","Data":"338c916a56e7899204098feb0a7421e2eb30b0ec6053e9b1a1cf8a55b07aaac1"} Jun 03 15:47:52.630827 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.630829 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="338c916a56e7899204098feb0a7421e2eb30b0ec6053e9b1a1cf8a55b07aaac1" Jun 03 15:47:52.631046 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:52.630865 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amqqzf" Jun 03 15:47:55.643445 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:55.643399 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" event={"ID":"afddbebe-d0f3-4a1d-9316-88aba7d33ef5","Type":"ContainerStarted","Data":"64224265640b5f9f68dc159af6f9a64fcf3d1e839387b192275bd2227067c776"} Jun 03 15:47:55.643937 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:55.643509 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" Jun 03 15:47:55.644908 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:55.644880 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7888f9cd56-75g2c" event={"ID":"280c81e7-fc54-45fe-83fa-69a3d365342c","Type":"ContainerStarted","Data":"f36036b08edcaf1b785f558bf2774548bd499ae958abf0b39b1e99584959003f"} Jun 03 15:47:55.683596 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:55.683549 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" podStartSLOduration=1.458907282 podStartE2EDuration="6.683535457s" podCreationTimestamp="2026-06-03 15:47:49 +0000 UTC" firstStartedPulling="2026-06-03 15:47:49.619995047 +0000 UTC m=+428.857742563" lastFinishedPulling="2026-06-03 15:47:54.844623212 +0000 UTC m=+434.082370738" observedRunningTime="2026-06-03 15:47:55.68020125 +0000 UTC m=+434.917948789" watchObservedRunningTime="2026-06-03 15:47:55.683535457 +0000 UTC m=+434.921282996" Jun 03 15:47:55.718871 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:47:55.718824 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7888f9cd56-75g2c" podStartSLOduration=1.59574382 podStartE2EDuration="6.718811126s" podCreationTimestamp="2026-06-03 15:47:49 +0000 UTC" firstStartedPulling="2026-06-03 15:47:49.79350478 +0000 UTC m=+429.031252301" lastFinishedPulling="2026-06-03 15:47:54.916572084 +0000 UTC m=+434.154319607" observedRunningTime="2026-06-03 15:47:55.715377556 +0000 UTC m=+434.953125094" watchObservedRunningTime="2026-06-03 15:47:55.718811126 +0000 UTC m=+434.956558664" Jun 03 15:48:01.049963 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.049880 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49"] Jun 03 15:48:01.050317 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.050229 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597390a8-d453-4a5d-9504-f35c63ad6bf4" containerName="extract" Jun 03 15:48:01.050317 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.050241 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="597390a8-d453-4a5d-9504-f35c63ad6bf4" containerName="extract" Jun 03 15:48:01.050317 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.050258 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597390a8-d453-4a5d-9504-f35c63ad6bf4" containerName="pull" Jun 03 15:48:01.050317 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.050264 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="597390a8-d453-4a5d-9504-f35c63ad6bf4" containerName="pull" Jun 03 15:48:01.050317 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.050278 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597390a8-d453-4a5d-9504-f35c63ad6bf4" containerName="util" Jun 03 15:48:01.050317 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.050283 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="597390a8-d453-4a5d-9504-f35c63ad6bf4" containerName="util" Jun 03 15:48:01.050533 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.050337 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="597390a8-d453-4a5d-9504-f35c63ad6bf4" containerName="extract" Jun 03 15:48:01.053453 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.053437 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.057280 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.057259 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 15:48:01.057642 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.057623 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-m2x5f\"" Jun 03 15:48:01.059065 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.059045 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 15:48:01.060197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.060167 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 15:48:01.060197 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.060177 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 15:48:01.074683 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.074651 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49"] Jun 03 15:48:01.195278 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.195243 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-cacerts\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.195278 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.195277 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.195469 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.195308 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.195469 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.195348 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-token\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.195469 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.195370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.195469 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.195406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-local-certs\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.195469 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.195421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzd56\" (UniqueName: \"kubernetes.io/projected/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-kube-api-access-tzd56\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.296476 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.296441 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-local-certs\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.296476 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.296474 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzd56\" (UniqueName: \"kubernetes.io/projected/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-kube-api-access-tzd56\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.296756 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.296514 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-cacerts\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.296756 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.296540 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.296756 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.296595 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.296756 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.296629 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-token\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.296756 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.296670 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.297449 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.297425 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.299518 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.299390 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-local-certs\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.300058 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.300005 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-cacerts\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.304075 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.304046 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.304184 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.304046 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.307877 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.307851 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-istio-token\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.308105 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.308085 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzd56\" (UniqueName: \"kubernetes.io/projected/ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48-kube-api-access-tzd56\") pod \"istiod-openshift-gateway-798958bb55-ndj49\" (UID: \"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.363379 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.363331 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:01.511080 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.511052 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49"] Jun 03 15:48:01.512566 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:48:01.512534 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2f2a86_1ec7_43fb_a0cd_24d72fb96f48.slice/crio-5c1e53e88732c38307601d5960922ad1cd25c88d7f29a45657af3f85a1f86d80 WatchSource:0}: Error finding container 5c1e53e88732c38307601d5960922ad1cd25c88d7f29a45657af3f85a1f86d80: Status 404 returned error can't find the container with id 5c1e53e88732c38307601d5960922ad1cd25c88d7f29a45657af3f85a1f86d80 Jun 03 15:48:01.667833 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:01.667742 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" event={"ID":"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48","Type":"ContainerStarted","Data":"5c1e53e88732c38307601d5960922ad1cd25c88d7f29a45657af3f85a1f86d80"} Jun 03 15:48:04.952845 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:04.952804 2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 03 15:48:04.953136 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:04.952872 2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 03 15:48:05.686091 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:05.686053 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" event={"ID":"ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48","Type":"ContainerStarted","Data":"ab52decdbc8a9314ddabd63055bcbfea23f6c93ba62a0b48de8807fc5fbd2620"} Jun 03 15:48:05.686276 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:05.686114 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:05.710167 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:05.710115 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" podStartSLOduration=1.272047951 podStartE2EDuration="4.710098497s" podCreationTimestamp="2026-06-03 15:48:01 +0000 UTC" firstStartedPulling="2026-06-03 15:48:01.514492247 +0000 UTC m=+440.752239766" lastFinishedPulling="2026-06-03 15:48:04.952542793 +0000 UTC m=+444.190290312" observedRunningTime="2026-06-03 15:48:05.707552341 +0000 UTC m=+444.945299881" watchObservedRunningTime="2026-06-03 15:48:05.710098497 +0000 UTC m=+444.947846038" Jun 03 15:48:06.650057 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:06.650018 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lxgn4" Jun 03 15:48:06.692358 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:06.692317 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-ndj49" Jun 03 15:48:12.578743 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:12.578686 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-6nmkc" Jun 03 15:48:12.582408 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:12.582384 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5lvh5" Jun 03 15:48:39.886511 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:39.886472 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88"] Jun 03 15:48:39.895927 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:39.895884 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:39.898916 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:39.898893 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 15:48:39.899059 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:39.898920 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 15:48:39.899926 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:39.899904 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88"] Jun 03 15:48:39.900018 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:39.899943 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mpgcn\"" Jun 03 15:48:39.930488 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:39.930458 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcsnd\" (UniqueName: \"kubernetes.io/projected/a2e697c2-6d7e-433b-9d69-935f21abf678-kube-api-access-hcsnd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:39.930612 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:39.930508 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:39.930612 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:39.930599 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:40.031883 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.031854 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcsnd\" (UniqueName: \"kubernetes.io/projected/a2e697c2-6d7e-433b-9d69-935f21abf678-kube-api-access-hcsnd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:40.032014 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.031903 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:40.032014 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.031944 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:40.032308 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.032293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:40.032351 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.032333 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:40.042061 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.042033 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcsnd\" (UniqueName: \"kubernetes.io/projected/a2e697c2-6d7e-433b-9d69-935f21abf678-kube-api-access-hcsnd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:40.206861 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.206778 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:40.350045 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.350017 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88"] Jun 03 15:48:40.351506 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:48:40.351481 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e697c2_6d7e_433b_9d69_935f21abf678.slice/crio-0388027b3b1c1bf64426161d5d0dca15ed31c7808a884249b7cd743a9bb37ec8 WatchSource:0}: Error finding container 0388027b3b1c1bf64426161d5d0dca15ed31c7808a884249b7cd743a9bb37ec8: Status 404 returned error can't find the container with id 0388027b3b1c1bf64426161d5d0dca15ed31c7808a884249b7cd743a9bb37ec8 Jun 03 15:48:40.491328 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.491300 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw"] Jun 03 15:48:40.495031 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.495016 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:40.502958 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.502930 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw"] Jun 03 15:48:40.537818 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.537788 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:40.537974 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.537861 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8rxm\" (UniqueName: \"kubernetes.io/projected/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-kube-api-access-x8rxm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:40.537974 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.537934 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:40.639277 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.639243 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:40.639413 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.639296 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8rxm\" (UniqueName: \"kubernetes.io/projected/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-kube-api-access-x8rxm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:40.639413 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.639316 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:40.639611 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.639594 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:40.639671 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.639656 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:40.648626 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.648599 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8rxm\" (UniqueName: \"kubernetes.io/projected/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-kube-api-access-x8rxm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:40.818042 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.817962 2566 generic.go:358] "Generic (PLEG): container finished" podID="a2e697c2-6d7e-433b-9d69-935f21abf678" containerID="9e5b7a18d3d30e2e5a6e6cd4f7d52bf290e70d42276e719a477b59830032c9f1" exitCode=0 Jun 03 15:48:40.818199 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.818051 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" event={"ID":"a2e697c2-6d7e-433b-9d69-935f21abf678","Type":"ContainerDied","Data":"9e5b7a18d3d30e2e5a6e6cd4f7d52bf290e70d42276e719a477b59830032c9f1"} Jun 03 15:48:40.818199 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.818094 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" event={"ID":"a2e697c2-6d7e-433b-9d69-935f21abf678","Type":"ContainerStarted","Data":"0388027b3b1c1bf64426161d5d0dca15ed31c7808a884249b7cd743a9bb37ec8"} Jun 03 15:48:40.826159 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.826141 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:40.966044 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:40.966014 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw"] Jun 03 15:48:40.967864 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:48:40.967840 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e219d7_4de4_475f_9b1f_0bc9089ba4ec.slice/crio-5df74fc1815b7d172d8e625d77344449eefd82da6a2306279aeab7ef689637a8 WatchSource:0}: Error finding container 5df74fc1815b7d172d8e625d77344449eefd82da6a2306279aeab7ef689637a8: Status 404 returned error can't find the container with id 5df74fc1815b7d172d8e625d77344449eefd82da6a2306279aeab7ef689637a8 Jun 03 15:48:41.075440 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.075413 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42"] Jun 03 15:48:41.079057 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.079040 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:41.089103 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.089080 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42"] Jun 03 15:48:41.143394 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.143369 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:41.143489 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.143436 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wtmv\" (UniqueName: \"kubernetes.io/projected/00047758-dfe8-45fb-948d-6b5856ead1ac-kube-api-access-6wtmv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:41.143489 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.143479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:41.244058 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.244019 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:41.244242 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.244082 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:41.244242 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.244216 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wtmv\" (UniqueName: \"kubernetes.io/projected/00047758-dfe8-45fb-948d-6b5856ead1ac-kube-api-access-6wtmv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:41.244462 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.244437 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:41.244563 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.244502 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:41.256212 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.256188 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wtmv\" (UniqueName: \"kubernetes.io/projected/00047758-dfe8-45fb-948d-6b5856ead1ac-kube-api-access-6wtmv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:41.422048 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.421958 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:41.483682 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.483648 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb"] Jun 03 15:48:41.487692 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.487670 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:41.495625 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.495589 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb"] Jun 03 15:48:41.546390 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.546361 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:41.546538 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.546424 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjzth\" (UniqueName: \"kubernetes.io/projected/51829f7c-59f2-444d-bd88-1605c29672ea-kube-api-access-kjzth\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:41.546538 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.546482 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:41.565932 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.565908 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42"] Jun 03 15:48:41.589836 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:48:41.589800 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00047758_dfe8_45fb_948d_6b5856ead1ac.slice/crio-c276850f2dde95731e555dd9bfe1e66a0a965cad5abc0c1d915a74bfb9d5b3cd WatchSource:0}: Error finding container c276850f2dde95731e555dd9bfe1e66a0a965cad5abc0c1d915a74bfb9d5b3cd: Status 404 returned error can't find the container with id c276850f2dde95731e555dd9bfe1e66a0a965cad5abc0c1d915a74bfb9d5b3cd Jun 03 15:48:41.647639 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.647614 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjzth\" (UniqueName: \"kubernetes.io/projected/51829f7c-59f2-444d-bd88-1605c29672ea-kube-api-access-kjzth\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:41.647812 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.647692 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:41.647812 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.647768 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:41.648100 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.648080 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:41.648167 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.648096 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:41.657429 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.657406 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjzth\" (UniqueName: \"kubernetes.io/projected/51829f7c-59f2-444d-bd88-1605c29672ea-kube-api-access-kjzth\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:41.800110 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.800081 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:41.824163 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.824133 2566 generic.go:358] "Generic (PLEG): container finished" podID="a2e697c2-6d7e-433b-9d69-935f21abf678" containerID="b250292be72bebd6898dd9b54a9fc4a3ab0561c71902d75ec435169bdab31972" exitCode=0 Jun 03 15:48:41.824303 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.824238 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" event={"ID":"a2e697c2-6d7e-433b-9d69-935f21abf678","Type":"ContainerDied","Data":"b250292be72bebd6898dd9b54a9fc4a3ab0561c71902d75ec435169bdab31972"} Jun 03 15:48:41.825764 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.825703 2566 generic.go:358] "Generic (PLEG): container finished" podID="00047758-dfe8-45fb-948d-6b5856ead1ac" containerID="88774e16ec0a810f2996f6c1f13bca79fb9d7ad9ab27f171766ecf55fa80691c" exitCode=0 Jun 03 15:48:41.825886 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.825757 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" event={"ID":"00047758-dfe8-45fb-948d-6b5856ead1ac","Type":"ContainerDied","Data":"88774e16ec0a810f2996f6c1f13bca79fb9d7ad9ab27f171766ecf55fa80691c"} Jun 03 15:48:41.825886 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.825794 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" event={"ID":"00047758-dfe8-45fb-948d-6b5856ead1ac","Type":"ContainerStarted","Data":"c276850f2dde95731e555dd9bfe1e66a0a965cad5abc0c1d915a74bfb9d5b3cd"} Jun 03 15:48:41.827210 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.827189 2566 generic.go:358] "Generic (PLEG): container finished" podID="06e219d7-4de4-475f-9b1f-0bc9089ba4ec" containerID="28e2f9c52921613115b6115663a990b6a0dee671782f47e05d45e0a0f62a4dc6" exitCode=0 Jun 03 15:48:41.827338 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.827320 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" event={"ID":"06e219d7-4de4-475f-9b1f-0bc9089ba4ec","Type":"ContainerDied","Data":"28e2f9c52921613115b6115663a990b6a0dee671782f47e05d45e0a0f62a4dc6"} Jun 03 15:48:41.827395 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.827349 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" event={"ID":"06e219d7-4de4-475f-9b1f-0bc9089ba4ec","Type":"ContainerStarted","Data":"5df74fc1815b7d172d8e625d77344449eefd82da6a2306279aeab7ef689637a8"} Jun 03 15:48:41.949073 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:41.948852 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb"] Jun 03 15:48:41.951962 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:48:41.951934 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51829f7c_59f2_444d_bd88_1605c29672ea.slice/crio-64beea5ed9fccac470f420552e5947844937cfa07834a857f449063f07c48030 WatchSource:0}: Error finding container 64beea5ed9fccac470f420552e5947844937cfa07834a857f449063f07c48030: Status 404 returned error can't find the container with id 64beea5ed9fccac470f420552e5947844937cfa07834a857f449063f07c48030 Jun 03 15:48:42.833379 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:42.833350 2566 generic.go:358] "Generic (PLEG): container finished" podID="a2e697c2-6d7e-433b-9d69-935f21abf678" containerID="07b9fa2f58fddfd1cd7cc6635ad7352ac244cd1b5eeb191d86767bb5915dc0cf" exitCode=0 Jun 03 15:48:42.833779 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:42.833438 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" event={"ID":"a2e697c2-6d7e-433b-9d69-935f21abf678","Type":"ContainerDied","Data":"07b9fa2f58fddfd1cd7cc6635ad7352ac244cd1b5eeb191d86767bb5915dc0cf"} Jun 03 15:48:42.835096 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:42.835069 2566 generic.go:358] "Generic (PLEG): container finished" podID="00047758-dfe8-45fb-948d-6b5856ead1ac" containerID="97fa29e108df0da882e337ca5ae9e74aa388eeeab607c1b05ce327236c4a31cd" exitCode=0 Jun 03 15:48:42.835203 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:42.835143 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" event={"ID":"00047758-dfe8-45fb-948d-6b5856ead1ac","Type":"ContainerDied","Data":"97fa29e108df0da882e337ca5ae9e74aa388eeeab607c1b05ce327236c4a31cd"} Jun 03 15:48:42.836813 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:42.836790 2566 generic.go:358] "Generic (PLEG): container finished" podID="06e219d7-4de4-475f-9b1f-0bc9089ba4ec" containerID="3009ffbf113da65ae904f85f0141d9438580a6d30a65357472d2312465c08152" exitCode=0 Jun 03 15:48:42.836882 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:42.836847 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" event={"ID":"06e219d7-4de4-475f-9b1f-0bc9089ba4ec","Type":"ContainerDied","Data":"3009ffbf113da65ae904f85f0141d9438580a6d30a65357472d2312465c08152"} Jun 03 15:48:42.839609 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:42.839116 2566 generic.go:358] "Generic (PLEG): container finished" podID="51829f7c-59f2-444d-bd88-1605c29672ea" containerID="37e9e768418e3ad5f8180af5b8c9e063e01c34aeca87614a38b5f589cb619dc5" exitCode=0 Jun 03 15:48:42.839609 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:42.839249 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" event={"ID":"51829f7c-59f2-444d-bd88-1605c29672ea","Type":"ContainerDied","Data":"37e9e768418e3ad5f8180af5b8c9e063e01c34aeca87614a38b5f589cb619dc5"} Jun 03 15:48:42.839609 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:42.839289 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" event={"ID":"51829f7c-59f2-444d-bd88-1605c29672ea","Type":"ContainerStarted","Data":"64beea5ed9fccac470f420552e5947844937cfa07834a857f449063f07c48030"} Jun 03 15:48:43.845284 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:43.845254 2566 generic.go:358] "Generic (PLEG): container finished" podID="00047758-dfe8-45fb-948d-6b5856ead1ac" containerID="3b0081cfd91cc5041b3b14f328960ea1aa723c9c93ddc6ef6b84751bb886d90d" exitCode=0 Jun 03 15:48:43.845670 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:43.845331 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" event={"ID":"00047758-dfe8-45fb-948d-6b5856ead1ac","Type":"ContainerDied","Data":"3b0081cfd91cc5041b3b14f328960ea1aa723c9c93ddc6ef6b84751bb886d90d"} Jun 03 15:48:43.847126 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:43.847102 2566 generic.go:358] "Generic (PLEG): container finished" podID="06e219d7-4de4-475f-9b1f-0bc9089ba4ec" containerID="47075a4d0bfa42d757c64fcd5b1677c6f2c3201502f1062ac1b76b780c46ff84" exitCode=0 Jun 03 15:48:43.847241 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:43.847195 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" event={"ID":"06e219d7-4de4-475f-9b1f-0bc9089ba4ec","Type":"ContainerDied","Data":"47075a4d0bfa42d757c64fcd5b1677c6f2c3201502f1062ac1b76b780c46ff84"} Jun 03 15:48:43.848697 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:43.848675 2566 generic.go:358] "Generic (PLEG): container finished" podID="51829f7c-59f2-444d-bd88-1605c29672ea" containerID="26ce674a43e9876ace08e11a13b31aa571a7eb42901d1846dcc2d9399109b01d" exitCode=0 Jun 03 15:48:43.848789 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:43.848754 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" event={"ID":"51829f7c-59f2-444d-bd88-1605c29672ea","Type":"ContainerDied","Data":"26ce674a43e9876ace08e11a13b31aa571a7eb42901d1846dcc2d9399109b01d"} Jun 03 15:48:43.978001 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:43.977979 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:44.068708 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.068683 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcsnd\" (UniqueName: \"kubernetes.io/projected/a2e697c2-6d7e-433b-9d69-935f21abf678-kube-api-access-hcsnd\") pod \"a2e697c2-6d7e-433b-9d69-935f21abf678\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " Jun 03 15:48:44.068851 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.068783 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-util\") pod \"a2e697c2-6d7e-433b-9d69-935f21abf678\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " Jun 03 15:48:44.068851 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.068825 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-bundle\") pod \"a2e697c2-6d7e-433b-9d69-935f21abf678\" (UID: \"a2e697c2-6d7e-433b-9d69-935f21abf678\") " Jun 03 15:48:44.069397 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.069374 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-bundle" (OuterVolumeSpecName: "bundle") pod "a2e697c2-6d7e-433b-9d69-935f21abf678" (UID: "a2e697c2-6d7e-433b-9d69-935f21abf678"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:48:44.071106 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.071075 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2e697c2-6d7e-433b-9d69-935f21abf678-kube-api-access-hcsnd" (OuterVolumeSpecName: "kube-api-access-hcsnd") pod "a2e697c2-6d7e-433b-9d69-935f21abf678" (UID: "a2e697c2-6d7e-433b-9d69-935f21abf678"). InnerVolumeSpecName "kube-api-access-hcsnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:48:44.074261 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.074240 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-util" (OuterVolumeSpecName: "util") pod "a2e697c2-6d7e-433b-9d69-935f21abf678" (UID: "a2e697c2-6d7e-433b-9d69-935f21abf678"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:48:44.170329 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.170263 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcsnd\" (UniqueName: \"kubernetes.io/projected/a2e697c2-6d7e-433b-9d69-935f21abf678-kube-api-access-hcsnd\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:44.170329 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.170290 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-util\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:44.170329 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.170300 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2e697c2-6d7e-433b-9d69-935f21abf678-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:44.854271 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.854231 2566 generic.go:358] "Generic (PLEG): container finished" podID="51829f7c-59f2-444d-bd88-1605c29672ea" containerID="373c9bbf2fbc63c2dd0caf1a961d5adfd0ff6e63e24ffa38af1b5acd6caeb4cc" exitCode=0 Jun 03 15:48:44.854700 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.854337 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" event={"ID":"51829f7c-59f2-444d-bd88-1605c29672ea","Type":"ContainerDied","Data":"373c9bbf2fbc63c2dd0caf1a961d5adfd0ff6e63e24ffa38af1b5acd6caeb4cc"} Jun 03 15:48:44.856082 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.856055 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" event={"ID":"a2e697c2-6d7e-433b-9d69-935f21abf678","Type":"ContainerDied","Data":"0388027b3b1c1bf64426161d5d0dca15ed31c7808a884249b7cd743a9bb37ec8"} Jun 03 15:48:44.856082 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.856080 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88" Jun 03 15:48:44.856214 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:44.856089 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0388027b3b1c1bf64426161d5d0dca15ed31c7808a884249b7cd743a9bb37ec8" Jun 03 15:48:45.010169 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.010145 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:45.013479 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.013461 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:45.076979 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.076949 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-util\") pod \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " Jun 03 15:48:45.077163 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.076995 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-bundle\") pod \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " Jun 03 15:48:45.077163 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.077029 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wtmv\" (UniqueName: \"kubernetes.io/projected/00047758-dfe8-45fb-948d-6b5856ead1ac-kube-api-access-6wtmv\") pod \"00047758-dfe8-45fb-948d-6b5856ead1ac\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " Jun 03 15:48:45.077163 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.077071 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-util\") pod \"00047758-dfe8-45fb-948d-6b5856ead1ac\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " Jun 03 15:48:45.077163 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.077144 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-bundle\") pod \"00047758-dfe8-45fb-948d-6b5856ead1ac\" (UID: \"00047758-dfe8-45fb-948d-6b5856ead1ac\") " Jun 03 15:48:45.077668 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.077510 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8rxm\" (UniqueName: \"kubernetes.io/projected/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-kube-api-access-x8rxm\") pod \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\" (UID: \"06e219d7-4de4-475f-9b1f-0bc9089ba4ec\") " Jun 03 15:48:45.077668 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.077572 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-bundle" (OuterVolumeSpecName: "bundle") pod "06e219d7-4de4-475f-9b1f-0bc9089ba4ec" (UID: "06e219d7-4de4-475f-9b1f-0bc9089ba4ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:48:45.077843 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.077677 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-bundle" (OuterVolumeSpecName: "bundle") pod "00047758-dfe8-45fb-948d-6b5856ead1ac" (UID: "00047758-dfe8-45fb-948d-6b5856ead1ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:48:45.077980 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.077860 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:45.077980 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.077880 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:45.079916 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.079886 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00047758-dfe8-45fb-948d-6b5856ead1ac-kube-api-access-6wtmv" (OuterVolumeSpecName: "kube-api-access-6wtmv") pod "00047758-dfe8-45fb-948d-6b5856ead1ac" (UID: "00047758-dfe8-45fb-948d-6b5856ead1ac"). InnerVolumeSpecName "kube-api-access-6wtmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:48:45.080014 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.079914 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-kube-api-access-x8rxm" (OuterVolumeSpecName: "kube-api-access-x8rxm") pod "06e219d7-4de4-475f-9b1f-0bc9089ba4ec" (UID: "06e219d7-4de4-475f-9b1f-0bc9089ba4ec"). InnerVolumeSpecName "kube-api-access-x8rxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:48:45.083735 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.083699 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-util" (OuterVolumeSpecName: "util") pod "06e219d7-4de4-475f-9b1f-0bc9089ba4ec" (UID: "06e219d7-4de4-475f-9b1f-0bc9089ba4ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:48:45.083790 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.083715 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-util" (OuterVolumeSpecName: "util") pod "00047758-dfe8-45fb-948d-6b5856ead1ac" (UID: "00047758-dfe8-45fb-948d-6b5856ead1ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:48:45.179320 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.179251 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-util\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:45.179320 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.179276 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wtmv\" (UniqueName: \"kubernetes.io/projected/00047758-dfe8-45fb-948d-6b5856ead1ac-kube-api-access-6wtmv\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:45.179320 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.179286 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00047758-dfe8-45fb-948d-6b5856ead1ac-util\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:45.179320 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.179297 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8rxm\" (UniqueName: \"kubernetes.io/projected/06e219d7-4de4-475f-9b1f-0bc9089ba4ec-kube-api-access-x8rxm\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:45.863264 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.863228 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" event={"ID":"00047758-dfe8-45fb-948d-6b5856ead1ac","Type":"ContainerDied","Data":"c276850f2dde95731e555dd9bfe1e66a0a965cad5abc0c1d915a74bfb9d5b3cd"} Jun 03 15:48:45.863264 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.863262 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c276850f2dde95731e555dd9bfe1e66a0a965cad5abc0c1d915a74bfb9d5b3cd" Jun 03 15:48:45.863820 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.863265 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42" Jun 03 15:48:45.865184 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.865163 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" Jun 03 15:48:45.865184 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.865175 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw" event={"ID":"06e219d7-4de4-475f-9b1f-0bc9089ba4ec","Type":"ContainerDied","Data":"5df74fc1815b7d172d8e625d77344449eefd82da6a2306279aeab7ef689637a8"} Jun 03 15:48:45.865405 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.865205 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5df74fc1815b7d172d8e625d77344449eefd82da6a2306279aeab7ef689637a8" Jun 03 15:48:45.994826 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:45.994803 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:48:46.086597 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.086568 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-util\") pod \"51829f7c-59f2-444d-bd88-1605c29672ea\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " Jun 03 15:48:46.086794 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.086625 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-bundle\") pod \"51829f7c-59f2-444d-bd88-1605c29672ea\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " Jun 03 15:48:46.086794 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.086653 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjzth\" (UniqueName: \"kubernetes.io/projected/51829f7c-59f2-444d-bd88-1605c29672ea-kube-api-access-kjzth\") pod \"51829f7c-59f2-444d-bd88-1605c29672ea\" (UID: \"51829f7c-59f2-444d-bd88-1605c29672ea\") " Jun 03 15:48:46.087086 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.087060 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-bundle" (OuterVolumeSpecName: "bundle") pod "51829f7c-59f2-444d-bd88-1605c29672ea" (UID: "51829f7c-59f2-444d-bd88-1605c29672ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:48:46.088998 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.088973 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51829f7c-59f2-444d-bd88-1605c29672ea-kube-api-access-kjzth" (OuterVolumeSpecName: "kube-api-access-kjzth") pod "51829f7c-59f2-444d-bd88-1605c29672ea" (UID: "51829f7c-59f2-444d-bd88-1605c29672ea"). InnerVolumeSpecName "kube-api-access-kjzth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:48:46.091782 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.091748 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-util" (OuterVolumeSpecName: "util") pod "51829f7c-59f2-444d-bd88-1605c29672ea" (UID: "51829f7c-59f2-444d-bd88-1605c29672ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:48:46.187630 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.187559 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-util\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:46.187630 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.187587 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51829f7c-59f2-444d-bd88-1605c29672ea-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:46.187630 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.187598 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjzth\" (UniqueName: \"kubernetes.io/projected/51829f7c-59f2-444d-bd88-1605c29672ea-kube-api-access-kjzth\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:48:46.871954 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.871919 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" event={"ID":"51829f7c-59f2-444d-bd88-1605c29672ea","Type":"ContainerDied","Data":"64beea5ed9fccac470f420552e5947844937cfa07834a857f449063f07c48030"} Jun 03 15:48:46.871954 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.871954 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64beea5ed9fccac470f420552e5947844937cfa07834a857f449063f07c48030" Jun 03 15:48:46.871954 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:48:46.871954 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb" Jun 03 15:49:03.161748 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.161701 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-547b8fbb79-rz6b6"] Jun 03 15:49:03.162128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162112 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e219d7-4de4-475f-9b1f-0bc9089ba4ec" containerName="pull" Jun 03 15:49:03.162128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162127 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e219d7-4de4-475f-9b1f-0bc9089ba4ec" containerName="pull" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162143 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51829f7c-59f2-444d-bd88-1605c29672ea" containerName="util" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162148 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="51829f7c-59f2-444d-bd88-1605c29672ea" containerName="util" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162154 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e219d7-4de4-475f-9b1f-0bc9089ba4ec" containerName="extract" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162159 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e219d7-4de4-475f-9b1f-0bc9089ba4ec" containerName="extract" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162166 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51829f7c-59f2-444d-bd88-1605c29672ea" containerName="pull" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162170 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="51829f7c-59f2-444d-bd88-1605c29672ea" containerName="pull" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162179 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00047758-dfe8-45fb-948d-6b5856ead1ac" containerName="extract" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162184 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="00047758-dfe8-45fb-948d-6b5856ead1ac" containerName="extract" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162193 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2e697c2-6d7e-433b-9d69-935f21abf678" containerName="extract" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162202 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2e697c2-6d7e-433b-9d69-935f21abf678" containerName="extract" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162208 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51829f7c-59f2-444d-bd88-1605c29672ea" containerName="extract" Jun 03 15:49:03.162208 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162213 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="51829f7c-59f2-444d-bd88-1605c29672ea" containerName="extract" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162221 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2e697c2-6d7e-433b-9d69-935f21abf678" containerName="util" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162226 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2e697c2-6d7e-433b-9d69-935f21abf678" containerName="util" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162232 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e219d7-4de4-475f-9b1f-0bc9089ba4ec" containerName="util" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162236 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e219d7-4de4-475f-9b1f-0bc9089ba4ec" containerName="util" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162245 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00047758-dfe8-45fb-948d-6b5856ead1ac" containerName="util" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162249 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="00047758-dfe8-45fb-948d-6b5856ead1ac" containerName="util" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162257 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00047758-dfe8-45fb-948d-6b5856ead1ac" containerName="pull" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162263 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="00047758-dfe8-45fb-948d-6b5856ead1ac" containerName="pull" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162278 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2e697c2-6d7e-433b-9d69-935f21abf678" containerName="pull" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162283 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2e697c2-6d7e-433b-9d69-935f21abf678" containerName="pull" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162339 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2e697c2-6d7e-433b-9d69-935f21abf678" containerName="extract" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162349 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="06e219d7-4de4-475f-9b1f-0bc9089ba4ec" containerName="extract" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162362 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="00047758-dfe8-45fb-948d-6b5856ead1ac" containerName="extract" Jun 03 15:49:03.162546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.162369 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="51829f7c-59f2-444d-bd88-1605c29672ea" containerName="extract" Jun 03 15:49:03.165211 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.165195 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.182685 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.182656 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-547b8fbb79-rz6b6"] Jun 03 15:49:03.229102 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.229076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-trusted-ca-bundle\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.229239 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.229120 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-console-serving-cert\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.229239 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.229135 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-console-config\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.229239 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.229151 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-service-ca\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.229239 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.229177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7zs7\" (UniqueName: \"kubernetes.io/projected/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-kube-api-access-n7zs7\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.229239 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.229209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-console-oauth-config\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.229506 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.229287 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-oauth-serving-cert\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.329910 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.329875 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-trusted-ca-bundle\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.330090 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.329919 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-console-serving-cert\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.330090 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.329935 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-console-config\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.330090 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.329953 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-service-ca\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.330090 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.329976 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7zs7\" (UniqueName: \"kubernetes.io/projected/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-kube-api-access-n7zs7\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.330090 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.330055 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-console-oauth-config\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.330342 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.330107 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-oauth-serving-cert\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.330792 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.330764 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-console-config\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.330906 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.330824 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-service-ca\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.330906 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.330845 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-oauth-serving-cert\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.331020 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.330999 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-trusted-ca-bundle\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.332550 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.332527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-console-serving-cert\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.332794 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.332776 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-console-oauth-config\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.347004 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.346974 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7zs7\" (UniqueName: \"kubernetes.io/projected/57f7fdca-bcd1-4b39-9a48-cbeac6428d01-kube-api-access-n7zs7\") pod \"console-547b8fbb79-rz6b6\" (UID: \"57f7fdca-bcd1-4b39-9a48-cbeac6428d01\") " pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.473758 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.473701 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:03.630622 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.630598 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-547b8fbb79-rz6b6"] Jun 03 15:49:03.632440 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:49:03.632414 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f7fdca_bcd1_4b39_9a48_cbeac6428d01.slice/crio-7ec3e68fb1a0fa2d5e746a82753b58138d45a63505c75216cf3f820078e4c2df WatchSource:0}: Error finding container 7ec3e68fb1a0fa2d5e746a82753b58138d45a63505c75216cf3f820078e4c2df: Status 404 returned error can't find the container with id 7ec3e68fb1a0fa2d5e746a82753b58138d45a63505c75216cf3f820078e4c2df Jun 03 15:49:03.940480 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.940391 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547b8fbb79-rz6b6" event={"ID":"57f7fdca-bcd1-4b39-9a48-cbeac6428d01","Type":"ContainerStarted","Data":"68fde2cd3163767d256e5c2b5f9f3983a84daf0b28ddbf36b7019c33446dadf8"} Jun 03 15:49:03.940480 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.940425 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547b8fbb79-rz6b6" event={"ID":"57f7fdca-bcd1-4b39-9a48-cbeac6428d01","Type":"ContainerStarted","Data":"7ec3e68fb1a0fa2d5e746a82753b58138d45a63505c75216cf3f820078e4c2df"} Jun 03 15:49:03.963636 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:03.963588 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-547b8fbb79-rz6b6" podStartSLOduration=0.96357367 podStartE2EDuration="963.57367ms" podCreationTimestamp="2026-06-03 15:49:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:49:03.961880269 +0000 UTC m=+503.199627807" watchObservedRunningTime="2026-06-03 15:49:03.96357367 +0000 UTC m=+503.201321276" Jun 03 15:49:04.811230 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:04.811180 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955"] Jun 03 15:49:04.815018 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:04.814997 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:04.817971 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:04.817950 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 15:49:04.818089 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:04.817988 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 15:49:04.818142 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:04.818103 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nl4kr\"" Jun 03 15:49:04.826528 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:04.826506 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955"] Jun 03 15:49:04.946634 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:04.946605 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9744edab-d870-472c-b568-bb4e6a1de6d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nc955\" (UID: \"9744edab-d870-472c-b568-bb4e6a1de6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:04.946814 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:04.946666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4nwd\" (UniqueName: \"kubernetes.io/projected/9744edab-d870-472c-b568-bb4e6a1de6d6-kube-api-access-r4nwd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nc955\" (UID: \"9744edab-d870-472c-b568-bb4e6a1de6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:05.047931 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:05.047890 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9744edab-d870-472c-b568-bb4e6a1de6d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nc955\" (UID: \"9744edab-d870-472c-b568-bb4e6a1de6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:05.048103 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:05.048002 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4nwd\" (UniqueName: \"kubernetes.io/projected/9744edab-d870-472c-b568-bb4e6a1de6d6-kube-api-access-r4nwd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nc955\" (UID: \"9744edab-d870-472c-b568-bb4e6a1de6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:05.048487 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:05.048466 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9744edab-d870-472c-b568-bb4e6a1de6d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nc955\" (UID: \"9744edab-d870-472c-b568-bb4e6a1de6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:05.058637 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:05.058618 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4nwd\" (UniqueName: \"kubernetes.io/projected/9744edab-d870-472c-b568-bb4e6a1de6d6-kube-api-access-r4nwd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nc955\" (UID: \"9744edab-d870-472c-b568-bb4e6a1de6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:05.126654 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:05.126584 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:05.281436 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:05.281408 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955"] Jun 03 15:49:05.282908 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:49:05.282880 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9744edab_d870_472c_b568_bb4e6a1de6d6.slice/crio-9e9870b7afb4c10ce159752a190d3f4986faf8776e2df040b8fd75fd4568257c WatchSource:0}: Error finding container 9e9870b7afb4c10ce159752a190d3f4986faf8776e2df040b8fd75fd4568257c: Status 404 returned error can't find the container with id 9e9870b7afb4c10ce159752a190d3f4986faf8776e2df040b8fd75fd4568257c Jun 03 15:49:05.950613 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:05.950582 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" event={"ID":"9744edab-d870-472c-b568-bb4e6a1de6d6","Type":"ContainerStarted","Data":"9e9870b7afb4c10ce159752a190d3f4986faf8776e2df040b8fd75fd4568257c"} Jun 03 15:49:10.979407 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:10.979371 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" event={"ID":"9744edab-d870-472c-b568-bb4e6a1de6d6","Type":"ContainerStarted","Data":"cc9694fc4978ee4ff6d0b36fc119eac344f78b0766525d14754203d2f4e049d2"} Jun 03 15:49:10.979804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:10.979491 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:11.013439 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:11.013383 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" podStartSLOduration=1.436197986 podStartE2EDuration="7.013369767s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:49:05.285834006 +0000 UTC m=+504.523581526" lastFinishedPulling="2026-06-03 15:49:10.863005786 +0000 UTC m=+510.100753307" observedRunningTime="2026-06-03 15:49:11.01219626 +0000 UTC m=+510.249943799" watchObservedRunningTime="2026-06-03 15:49:11.013369767 +0000 UTC m=+510.251117305" Jun 03 15:49:13.474825 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:13.474791 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:13.474825 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:13.474836 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:13.479838 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:13.479807 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:13.998061 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:13.998032 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-547b8fbb79-rz6b6" Jun 03 15:49:14.061184 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:14.061150 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74bc69b4d5-rwpl7"] Jun 03 15:49:21.987690 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:21.987658 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:23.810952 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.810918 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955"] Jun 03 15:49:23.811419 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.811217 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" podUID="9744edab-d870-472c-b568-bb4e6a1de6d6" containerName="manager" containerID="cri-o://cc9694fc4978ee4ff6d0b36fc119eac344f78b0766525d14754203d2f4e049d2" gracePeriod=2 Jun 03 15:49:23.824631 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.824599 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955"] Jun 03 15:49:23.841337 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.841306 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp"] Jun 03 15:49:23.841911 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.841891 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9744edab-d870-472c-b568-bb4e6a1de6d6" containerName="manager" Jun 03 15:49:23.841911 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.841913 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9744edab-d870-472c-b568-bb4e6a1de6d6" containerName="manager" Jun 03 15:49:23.842029 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.842013 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="9744edab-d870-472c-b568-bb4e6a1de6d6" containerName="manager" Jun 03 15:49:23.845523 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.845506 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:23.864400 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.864374 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp"] Jun 03 15:49:23.887005 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.886889 2566 status_manager.go:895] "Failed to get status for pod" podUID="9744edab-d870-472c-b568-bb4e6a1de6d6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-nc955\" is forbidden: User \"system:node:ip-10-0-139-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-233.ec2.internal' and this object" Jun 03 15:49:23.919340 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.919309 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85192e97-eb5d-4499-98e7-dbfb7206b8b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nkzdp\" (UID: \"85192e97-eb5d-4499-98e7-dbfb7206b8b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:23.919456 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.919431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs57q\" (UniqueName: \"kubernetes.io/projected/85192e97-eb5d-4499-98e7-dbfb7206b8b4-kube-api-access-vs57q\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nkzdp\" (UID: \"85192e97-eb5d-4499-98e7-dbfb7206b8b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:23.965756 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.965707 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl"] Jun 03 15:49:23.969110 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.969090 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" Jun 03 15:49:23.985826 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:23.985628 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl"] Jun 03 15:49:24.012164 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.012127 2566 status_manager.go:895] "Failed to get status for pod" podUID="9744edab-d870-472c-b568-bb4e6a1de6d6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-nc955\" is forbidden: User \"system:node:ip-10-0-139-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-233.ec2.internal' and this object" Jun 03 15:49:24.020622 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.020595 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04f8144a-15a6-49f9-94fa-23689080aaa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6lqnl\" (UID: \"04f8144a-15a6-49f9-94fa-23689080aaa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" Jun 03 15:49:24.020744 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.020653 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww4jq\" (UniqueName: \"kubernetes.io/projected/04f8144a-15a6-49f9-94fa-23689080aaa2-kube-api-access-ww4jq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6lqnl\" (UID: \"04f8144a-15a6-49f9-94fa-23689080aaa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" Jun 03 15:49:24.020744 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.020732 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85192e97-eb5d-4499-98e7-dbfb7206b8b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nkzdp\" (UID: \"85192e97-eb5d-4499-98e7-dbfb7206b8b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:24.020842 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.020782 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vs57q\" (UniqueName: \"kubernetes.io/projected/85192e97-eb5d-4499-98e7-dbfb7206b8b4-kube-api-access-vs57q\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nkzdp\" (UID: \"85192e97-eb5d-4499-98e7-dbfb7206b8b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:24.021080 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.021063 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85192e97-eb5d-4499-98e7-dbfb7206b8b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nkzdp\" (UID: \"85192e97-eb5d-4499-98e7-dbfb7206b8b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:24.034938 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.034909 2566 generic.go:358] "Generic (PLEG): container finished" podID="9744edab-d870-472c-b568-bb4e6a1de6d6" containerID="cc9694fc4978ee4ff6d0b36fc119eac344f78b0766525d14754203d2f4e049d2" exitCode=0 Jun 03 15:49:24.035033 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.034988 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e9870b7afb4c10ce159752a190d3f4986faf8776e2df040b8fd75fd4568257c" Jun 03 15:49:24.037058 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.037035 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs57q\" (UniqueName: \"kubernetes.io/projected/85192e97-eb5d-4499-98e7-dbfb7206b8b4-kube-api-access-vs57q\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nkzdp\" (UID: \"85192e97-eb5d-4499-98e7-dbfb7206b8b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:24.051232 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.051209 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:24.053854 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.053834 2566 status_manager.go:895] "Failed to get status for pod" podUID="9744edab-d870-472c-b568-bb4e6a1de6d6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-nc955\" is forbidden: User \"system:node:ip-10-0-139-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-233.ec2.internal' and this object" Jun 03 15:49:24.121578 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.121517 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9744edab-d870-472c-b568-bb4e6a1de6d6-extensions-socket-volume\") pod \"9744edab-d870-472c-b568-bb4e6a1de6d6\" (UID: \"9744edab-d870-472c-b568-bb4e6a1de6d6\") " Jun 03 15:49:24.121578 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.121578 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4nwd\" (UniqueName: \"kubernetes.io/projected/9744edab-d870-472c-b568-bb4e6a1de6d6-kube-api-access-r4nwd\") pod \"9744edab-d870-472c-b568-bb4e6a1de6d6\" (UID: \"9744edab-d870-472c-b568-bb4e6a1de6d6\") " Jun 03 15:49:24.121769 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.121698 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ww4jq\" (UniqueName: \"kubernetes.io/projected/04f8144a-15a6-49f9-94fa-23689080aaa2-kube-api-access-ww4jq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6lqnl\" (UID: \"04f8144a-15a6-49f9-94fa-23689080aaa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" Jun 03 15:49:24.121827 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.121813 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04f8144a-15a6-49f9-94fa-23689080aaa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6lqnl\" (UID: \"04f8144a-15a6-49f9-94fa-23689080aaa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" Jun 03 15:49:24.122079 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.122054 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9744edab-d870-472c-b568-bb4e6a1de6d6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9744edab-d870-472c-b568-bb4e6a1de6d6" (UID: "9744edab-d870-472c-b568-bb4e6a1de6d6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:49:24.122137 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.122100 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04f8144a-15a6-49f9-94fa-23689080aaa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6lqnl\" (UID: \"04f8144a-15a6-49f9-94fa-23689080aaa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" Jun 03 15:49:24.123741 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.123704 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9744edab-d870-472c-b568-bb4e6a1de6d6-kube-api-access-r4nwd" (OuterVolumeSpecName: "kube-api-access-r4nwd") pod "9744edab-d870-472c-b568-bb4e6a1de6d6" (UID: "9744edab-d870-472c-b568-bb4e6a1de6d6"). InnerVolumeSpecName "kube-api-access-r4nwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:49:24.142304 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.142282 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww4jq\" (UniqueName: \"kubernetes.io/projected/04f8144a-15a6-49f9-94fa-23689080aaa2-kube-api-access-ww4jq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6lqnl\" (UID: \"04f8144a-15a6-49f9-94fa-23689080aaa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" Jun 03 15:49:24.192209 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.192184 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:24.222422 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.222391 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9744edab-d870-472c-b568-bb4e6a1de6d6-extensions-socket-volume\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:49:24.222422 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.222422 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4nwd\" (UniqueName: \"kubernetes.io/projected/9744edab-d870-472c-b568-bb4e6a1de6d6-kube-api-access-r4nwd\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:49:24.281063 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.281031 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" Jun 03 15:49:24.334768 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.334732 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp"] Jun 03 15:49:24.338802 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:49:24.338771 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85192e97_eb5d_4499_98e7_dbfb7206b8b4.slice/crio-69d4abb85de377e4abef43d50f49a64f9e9fba90d71fccadd948e74b11288605 WatchSource:0}: Error finding container 69d4abb85de377e4abef43d50f49a64f9e9fba90d71fccadd948e74b11288605: Status 404 returned error can't find the container with id 69d4abb85de377e4abef43d50f49a64f9e9fba90d71fccadd948e74b11288605 Jun 03 15:49:24.438887 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:24.438856 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl"] Jun 03 15:49:24.441973 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:49:24.441948 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f8144a_15a6_49f9_94fa_23689080aaa2.slice/crio-2d47abd8a0a76efead5cf66d9992f1c4adaa69659b72323066a0921b5c2a25bc WatchSource:0}: Error finding container 2d47abd8a0a76efead5cf66d9992f1c4adaa69659b72323066a0921b5c2a25bc: Status 404 returned error can't find the container with id 2d47abd8a0a76efead5cf66d9992f1c4adaa69659b72323066a0921b5c2a25bc Jun 03 15:49:25.040804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.040769 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" event={"ID":"85192e97-eb5d-4499-98e7-dbfb7206b8b4","Type":"ContainerStarted","Data":"1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07"} Jun 03 15:49:25.040804 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.040808 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" event={"ID":"85192e97-eb5d-4499-98e7-dbfb7206b8b4","Type":"ContainerStarted","Data":"69d4abb85de377e4abef43d50f49a64f9e9fba90d71fccadd948e74b11288605"} Jun 03 15:49:25.041301 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.040825 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:25.042316 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.042293 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" Jun 03 15:49:25.042449 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.042294 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" event={"ID":"04f8144a-15a6-49f9-94fa-23689080aaa2","Type":"ContainerStarted","Data":"610efd4690178ec4e0b37719c7a927b6751cb13314f63beb9cbc18e168a07ff5"} Jun 03 15:49:25.042449 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.042393 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" event={"ID":"04f8144a-15a6-49f9-94fa-23689080aaa2","Type":"ContainerStarted","Data":"2d47abd8a0a76efead5cf66d9992f1c4adaa69659b72323066a0921b5c2a25bc"} Jun 03 15:49:25.042449 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.042408 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" Jun 03 15:49:25.073947 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.073876 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" podStartSLOduration=2.073858275 podStartE2EDuration="2.073858275s" podCreationTimestamp="2026-06-03 15:49:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:49:25.071529581 +0000 UTC m=+524.309277121" watchObservedRunningTime="2026-06-03 15:49:25.073858275 +0000 UTC m=+524.311605815" Jun 03 15:49:25.074075 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.073981 2566 status_manager.go:895] "Failed to get status for pod" podUID="9744edab-d870-472c-b568-bb4e6a1de6d6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-nc955\" is forbidden: User \"system:node:ip-10-0-139-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-233.ec2.internal' and this object" Jun 03 15:49:25.078451 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.078428 2566 status_manager.go:895] "Failed to get status for pod" podUID="9744edab-d870-472c-b568-bb4e6a1de6d6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nc955" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-nc955\" is forbidden: User \"system:node:ip-10-0-139-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-233.ec2.internal' and this object" Jun 03 15:49:25.127307 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.127253 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" podStartSLOduration=2.12724027 podStartE2EDuration="2.12724027s" podCreationTimestamp="2026-06-03 15:49:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:49:25.126375332 +0000 UTC m=+524.364122884" watchObservedRunningTime="2026-06-03 15:49:25.12724027 +0000 UTC m=+524.364987806" Jun 03 15:49:25.246770 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:25.246736 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9744edab-d870-472c-b568-bb4e6a1de6d6" path="/var/lib/kubelet/pods/9744edab-d870-472c-b568-bb4e6a1de6d6/volumes" Jun 03 15:49:36.048557 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:36.048477 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6lqnl" Jun 03 15:49:36.048557 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:36.048537 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:36.142272 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:36.142242 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp"] Jun 03 15:49:36.142465 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:36.142446 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" podUID="85192e97-eb5d-4499-98e7-dbfb7206b8b4" containerName="manager" containerID="cri-o://1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07" gracePeriod=10 Jun 03 15:49:36.391465 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:36.391441 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:36.422643 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:36.422617 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85192e97-eb5d-4499-98e7-dbfb7206b8b4-extensions-socket-volume\") pod \"85192e97-eb5d-4499-98e7-dbfb7206b8b4\" (UID: \"85192e97-eb5d-4499-98e7-dbfb7206b8b4\") " Jun 03 15:49:36.422815 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:36.422670 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs57q\" (UniqueName: \"kubernetes.io/projected/85192e97-eb5d-4499-98e7-dbfb7206b8b4-kube-api-access-vs57q\") pod \"85192e97-eb5d-4499-98e7-dbfb7206b8b4\" (UID: \"85192e97-eb5d-4499-98e7-dbfb7206b8b4\") " Jun 03 15:49:36.423060 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:36.423026 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85192e97-eb5d-4499-98e7-dbfb7206b8b4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "85192e97-eb5d-4499-98e7-dbfb7206b8b4" (UID: "85192e97-eb5d-4499-98e7-dbfb7206b8b4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:49:36.425318 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:36.425290 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85192e97-eb5d-4499-98e7-dbfb7206b8b4-kube-api-access-vs57q" (OuterVolumeSpecName: "kube-api-access-vs57q") pod "85192e97-eb5d-4499-98e7-dbfb7206b8b4" (UID: "85192e97-eb5d-4499-98e7-dbfb7206b8b4"). InnerVolumeSpecName "kube-api-access-vs57q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:49:36.523783 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:36.523755 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/85192e97-eb5d-4499-98e7-dbfb7206b8b4-extensions-socket-volume\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:49:36.523783 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:36.523780 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs57q\" (UniqueName: \"kubernetes.io/projected/85192e97-eb5d-4499-98e7-dbfb7206b8b4-kube-api-access-vs57q\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:49:37.095984 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:37.095946 2566 generic.go:358] "Generic (PLEG): container finished" podID="85192e97-eb5d-4499-98e7-dbfb7206b8b4" containerID="1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07" exitCode=0 Jun 03 15:49:37.096446 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:37.095991 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" event={"ID":"85192e97-eb5d-4499-98e7-dbfb7206b8b4","Type":"ContainerDied","Data":"1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07"} Jun 03 15:49:37.096446 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:37.096007 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" Jun 03 15:49:37.096446 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:37.096032 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp" event={"ID":"85192e97-eb5d-4499-98e7-dbfb7206b8b4","Type":"ContainerDied","Data":"69d4abb85de377e4abef43d50f49a64f9e9fba90d71fccadd948e74b11288605"} Jun 03 15:49:37.096446 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:37.096046 2566 scope.go:117] "RemoveContainer" containerID="1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07" Jun 03 15:49:37.105017 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:37.105001 2566 scope.go:117] "RemoveContainer" containerID="1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07" Jun 03 15:49:37.105254 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:49:37.105236 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07\": container with ID starting with 1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07 not found: ID does not exist" containerID="1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07" Jun 03 15:49:37.105300 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:37.105264 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07"} err="failed to get container status \"1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07\": rpc error: code = NotFound desc = could not find container \"1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07\": container with ID starting with 1d68ff6b863537155c08910bf22b4f61bf14fed81cafc7bf863b886eac99bf07 not found: ID does not exist" Jun 03 15:49:37.124042 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:37.124017 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp"] Jun 03 15:49:37.133235 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:37.133213 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nkzdp"] Jun 03 15:49:37.246656 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:37.246626 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85192e97-eb5d-4499-98e7-dbfb7206b8b4" path="/var/lib/kubelet/pods/85192e97-eb5d-4499-98e7-dbfb7206b8b4/volumes" Jun 03 15:49:39.084369 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.084322 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-74bc69b4d5-rwpl7" podUID="e329c490-8d9d-410a-b31b-e8d4ea5328ba" containerName="console" containerID="cri-o://fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c" gracePeriod=15 Jun 03 15:49:39.339933 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.339882 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74bc69b4d5-rwpl7_e329c490-8d9d-410a-b31b-e8d4ea5328ba/console/0.log" Jun 03 15:49:39.340021 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.339942 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:49:39.450366 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.450336 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-config\") pod \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " Jun 03 15:49:39.450519 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.450378 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-trusted-ca-bundle\") pod \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " Jun 03 15:49:39.450519 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.450409 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-service-ca\") pod \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " Jun 03 15:49:39.450519 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.450498 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-serving-cert\") pod \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " Jun 03 15:49:39.450670 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.450533 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-oauth-serving-cert\") pod \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " Jun 03 15:49:39.450670 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.450558 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlqcx\" (UniqueName: \"kubernetes.io/projected/e329c490-8d9d-410a-b31b-e8d4ea5328ba-kube-api-access-wlqcx\") pod \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " Jun 03 15:49:39.450670 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.450614 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-oauth-config\") pod \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\" (UID: \"e329c490-8d9d-410a-b31b-e8d4ea5328ba\") " Jun 03 15:49:39.450894 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.450872 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-config" (OuterVolumeSpecName: "console-config") pod "e329c490-8d9d-410a-b31b-e8d4ea5328ba" (UID: "e329c490-8d9d-410a-b31b-e8d4ea5328ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:49:39.450955 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.450835 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e329c490-8d9d-410a-b31b-e8d4ea5328ba" (UID: "e329c490-8d9d-410a-b31b-e8d4ea5328ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:49:39.451000 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.450947 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "e329c490-8d9d-410a-b31b-e8d4ea5328ba" (UID: "e329c490-8d9d-410a-b31b-e8d4ea5328ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:49:39.451102 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.451080 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e329c490-8d9d-410a-b31b-e8d4ea5328ba" (UID: "e329c490-8d9d-410a-b31b-e8d4ea5328ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:49:39.452948 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.452926 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e329c490-8d9d-410a-b31b-e8d4ea5328ba" (UID: "e329c490-8d9d-410a-b31b-e8d4ea5328ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:49:39.452948 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.452942 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e329c490-8d9d-410a-b31b-e8d4ea5328ba" (UID: "e329c490-8d9d-410a-b31b-e8d4ea5328ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:49:39.453073 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.452993 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e329c490-8d9d-410a-b31b-e8d4ea5328ba-kube-api-access-wlqcx" (OuterVolumeSpecName: "kube-api-access-wlqcx") pod "e329c490-8d9d-410a-b31b-e8d4ea5328ba" (UID: "e329c490-8d9d-410a-b31b-e8d4ea5328ba"). InnerVolumeSpecName "kube-api-access-wlqcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:49:39.551826 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.551794 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-oauth-config\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:49:39.551826 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.551823 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-config\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:49:39.551995 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.551834 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-trusted-ca-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:49:39.551995 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.551843 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-service-ca\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:49:39.551995 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.551852 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e329c490-8d9d-410a-b31b-e8d4ea5328ba-console-serving-cert\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:49:39.551995 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.551860 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e329c490-8d9d-410a-b31b-e8d4ea5328ba-oauth-serving-cert\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:49:39.551995 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:39.551869 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlqcx\" (UniqueName: \"kubernetes.io/projected/e329c490-8d9d-410a-b31b-e8d4ea5328ba-kube-api-access-wlqcx\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:49:40.111363 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:40.111335 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74bc69b4d5-rwpl7_e329c490-8d9d-410a-b31b-e8d4ea5328ba/console/0.log" Jun 03 15:49:40.111821 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:40.111376 2566 generic.go:358] "Generic (PLEG): container finished" podID="e329c490-8d9d-410a-b31b-e8d4ea5328ba" containerID="fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c" exitCode=2 Jun 03 15:49:40.111821 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:40.111406 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bc69b4d5-rwpl7" event={"ID":"e329c490-8d9d-410a-b31b-e8d4ea5328ba","Type":"ContainerDied","Data":"fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c"} Jun 03 15:49:40.111821 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:40.111441 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bc69b4d5-rwpl7" event={"ID":"e329c490-8d9d-410a-b31b-e8d4ea5328ba","Type":"ContainerDied","Data":"ab9c792517c153165ccf852aecec76c8c5c129dbbb06f0a590bf02b0911294b5"} Jun 03 15:49:40.111821 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:40.111448 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bc69b4d5-rwpl7" Jun 03 15:49:40.111821 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:40.111456 2566 scope.go:117] "RemoveContainer" containerID="fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c" Jun 03 15:49:40.121423 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:40.121402 2566 scope.go:117] "RemoveContainer" containerID="fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c" Jun 03 15:49:40.121684 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:49:40.121667 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c\": container with ID starting with fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c not found: ID does not exist" containerID="fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c" Jun 03 15:49:40.121738 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:40.121694 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c"} err="failed to get container status \"fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c\": rpc error: code = NotFound desc = could not find container \"fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c\": container with ID starting with fee5ada4c126affd278decb0d8b1a73d59e34883dcfe083f2cd891ec2326738c not found: ID does not exist" Jun 03 15:49:40.147647 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:40.147622 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74bc69b4d5-rwpl7"] Jun 03 15:49:40.153351 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:40.153329 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74bc69b4d5-rwpl7"] Jun 03 15:49:41.247101 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:41.247065 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e329c490-8d9d-410a-b31b-e8d4ea5328ba" path="/var/lib/kubelet/pods/e329c490-8d9d-410a-b31b-e8d4ea5328ba/volumes" Jun 03 15:49:56.813680 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.813643 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7pwtn"] Jun 03 15:49:56.814196 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.814063 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85192e97-eb5d-4499-98e7-dbfb7206b8b4" containerName="manager" Jun 03 15:49:56.814196 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.814076 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="85192e97-eb5d-4499-98e7-dbfb7206b8b4" containerName="manager" Jun 03 15:49:56.814196 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.814093 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e329c490-8d9d-410a-b31b-e8d4ea5328ba" containerName="console" Jun 03 15:49:56.814196 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.814098 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e329c490-8d9d-410a-b31b-e8d4ea5328ba" containerName="console" Jun 03 15:49:56.814196 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.814163 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e329c490-8d9d-410a-b31b-e8d4ea5328ba" containerName="console" Jun 03 15:49:56.814196 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.814174 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="85192e97-eb5d-4499-98e7-dbfb7206b8b4" containerName="manager" Jun 03 15:49:56.817691 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.817673 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:49:56.820546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.820527 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 15:49:56.820673 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.820625 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mpgcn\"" Jun 03 15:49:56.826956 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.826934 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7pwtn"] Jun 03 15:49:56.895828 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.895788 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb675b36-3e9a-41fc-b323-8a4af2337d92-config-file\") pod \"limitador-limitador-7d549b5b-7pwtn\" (UID: \"eb675b36-3e9a-41fc-b323-8a4af2337d92\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:49:56.895988 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.895851 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfrbk\" (UniqueName: \"kubernetes.io/projected/eb675b36-3e9a-41fc-b323-8a4af2337d92-kube-api-access-qfrbk\") pod \"limitador-limitador-7d549b5b-7pwtn\" (UID: \"eb675b36-3e9a-41fc-b323-8a4af2337d92\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:49:56.926486 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.926455 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7pwtn"] Jun 03 15:49:56.996421 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.996382 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb675b36-3e9a-41fc-b323-8a4af2337d92-config-file\") pod \"limitador-limitador-7d549b5b-7pwtn\" (UID: \"eb675b36-3e9a-41fc-b323-8a4af2337d92\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:49:56.996583 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.996437 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfrbk\" (UniqueName: \"kubernetes.io/projected/eb675b36-3e9a-41fc-b323-8a4af2337d92-kube-api-access-qfrbk\") pod \"limitador-limitador-7d549b5b-7pwtn\" (UID: \"eb675b36-3e9a-41fc-b323-8a4af2337d92\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:49:56.997029 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:56.997011 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb675b36-3e9a-41fc-b323-8a4af2337d92-config-file\") pod \"limitador-limitador-7d549b5b-7pwtn\" (UID: \"eb675b36-3e9a-41fc-b323-8a4af2337d92\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:49:57.005143 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:57.005123 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfrbk\" (UniqueName: \"kubernetes.io/projected/eb675b36-3e9a-41fc-b323-8a4af2337d92-kube-api-access-qfrbk\") pod \"limitador-limitador-7d549b5b-7pwtn\" (UID: \"eb675b36-3e9a-41fc-b323-8a4af2337d92\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:49:57.129341 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:57.129265 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:49:57.269566 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:57.269543 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7pwtn"] Jun 03 15:49:57.271338 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:49:57.271313 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb675b36_3e9a_41fc_b323_8a4af2337d92.slice/crio-53f662285c68372638656689e8f74accef5681ad68cc76296c4486cfc39a2f33 WatchSource:0}: Error finding container 53f662285c68372638656689e8f74accef5681ad68cc76296c4486cfc39a2f33: Status 404 returned error can't find the container with id 53f662285c68372638656689e8f74accef5681ad68cc76296c4486cfc39a2f33 Jun 03 15:49:58.188640 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:49:58.188601 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" event={"ID":"eb675b36-3e9a-41fc-b323-8a4af2337d92","Type":"ContainerStarted","Data":"53f662285c68372638656689e8f74accef5681ad68cc76296c4486cfc39a2f33"} Jun 03 15:50:00.197845 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:00.197805 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" event={"ID":"eb675b36-3e9a-41fc-b323-8a4af2337d92","Type":"ContainerStarted","Data":"9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c"} Jun 03 15:50:00.198296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:00.197938 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:50:00.223762 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:00.222814 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" podStartSLOduration=1.503390778 podStartE2EDuration="4.222789107s" podCreationTimestamp="2026-06-03 15:49:56 +0000 UTC" firstStartedPulling="2026-06-03 15:49:57.273033562 +0000 UTC m=+556.510781078" lastFinishedPulling="2026-06-03 15:49:59.99243189 +0000 UTC m=+559.230179407" observedRunningTime="2026-06-03 15:50:00.220186316 +0000 UTC m=+559.457933858" watchObservedRunningTime="2026-06-03 15:50:00.222789107 +0000 UTC m=+559.460536650" Jun 03 15:50:11.202916 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:11.202878 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:50:14.889296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:14.889259 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7pwtn"] Jun 03 15:50:14.889683 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:14.889479 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" podUID="eb675b36-3e9a-41fc-b323-8a4af2337d92" containerName="limitador" containerID="cri-o://9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c" gracePeriod=30 Jun 03 15:50:15.442989 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:15.442966 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:50:15.555229 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:15.555197 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfrbk\" (UniqueName: \"kubernetes.io/projected/eb675b36-3e9a-41fc-b323-8a4af2337d92-kube-api-access-qfrbk\") pod \"eb675b36-3e9a-41fc-b323-8a4af2337d92\" (UID: \"eb675b36-3e9a-41fc-b323-8a4af2337d92\") " Jun 03 15:50:15.555381 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:15.555268 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb675b36-3e9a-41fc-b323-8a4af2337d92-config-file\") pod \"eb675b36-3e9a-41fc-b323-8a4af2337d92\" (UID: \"eb675b36-3e9a-41fc-b323-8a4af2337d92\") " Jun 03 15:50:15.555659 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:15.555623 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb675b36-3e9a-41fc-b323-8a4af2337d92-config-file" (OuterVolumeSpecName: "config-file") pod "eb675b36-3e9a-41fc-b323-8a4af2337d92" (UID: "eb675b36-3e9a-41fc-b323-8a4af2337d92"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:50:15.557497 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:15.557475 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb675b36-3e9a-41fc-b323-8a4af2337d92-kube-api-access-qfrbk" (OuterVolumeSpecName: "kube-api-access-qfrbk") pod "eb675b36-3e9a-41fc-b323-8a4af2337d92" (UID: "eb675b36-3e9a-41fc-b323-8a4af2337d92"). InnerVolumeSpecName "kube-api-access-qfrbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:50:15.656693 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:15.656665 2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb675b36-3e9a-41fc-b323-8a4af2337d92-config-file\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:50:15.656693 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:15.656690 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfrbk\" (UniqueName: \"kubernetes.io/projected/eb675b36-3e9a-41fc-b323-8a4af2337d92-kube-api-access-qfrbk\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:50:16.260429 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:16.260389 2566 generic.go:358] "Generic (PLEG): container finished" podID="eb675b36-3e9a-41fc-b323-8a4af2337d92" containerID="9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c" exitCode=0 Jun 03 15:50:16.260889 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:16.260474 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" Jun 03 15:50:16.260889 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:16.260478 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" event={"ID":"eb675b36-3e9a-41fc-b323-8a4af2337d92","Type":"ContainerDied","Data":"9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c"} Jun 03 15:50:16.260889 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:16.260578 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7pwtn" event={"ID":"eb675b36-3e9a-41fc-b323-8a4af2337d92","Type":"ContainerDied","Data":"53f662285c68372638656689e8f74accef5681ad68cc76296c4486cfc39a2f33"} Jun 03 15:50:16.260889 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:16.260597 2566 scope.go:117] "RemoveContainer" containerID="9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c" Jun 03 15:50:16.270032 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:16.270012 2566 scope.go:117] "RemoveContainer" containerID="9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c" Jun 03 15:50:16.270284 ip-10-0-139-233 kubenswrapper[2566]: E0603 15:50:16.270266 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c\": container with ID starting with 9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c not found: ID does not exist" containerID="9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c" Jun 03 15:50:16.270320 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:16.270293 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c"} err="failed to get container status \"9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c\": rpc error: code = NotFound desc = could not find container \"9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c\": container with ID starting with 9e3e70e43398e9336ab1683d111ab7a513b716bc99ca8509d865f4bb243d174c not found: ID does not exist" Jun 03 15:50:16.292816 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:16.292785 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7pwtn"] Jun 03 15:50:16.295063 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:16.295043 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7pwtn"] Jun 03 15:50:17.246770 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:17.246714 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb675b36-3e9a-41fc-b323-8a4af2337d92" path="/var/lib/kubelet/pods/eb675b36-3e9a-41fc-b323-8a4af2337d92/volumes" Jun 03 15:50:18.172835 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.172800 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-8nc8m"] Jun 03 15:50:18.173400 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.173379 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb675b36-3e9a-41fc-b323-8a4af2337d92" containerName="limitador" Jun 03 15:50:18.173442 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.173404 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb675b36-3e9a-41fc-b323-8a4af2337d92" containerName="limitador" Jun 03 15:50:18.173540 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.173528 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb675b36-3e9a-41fc-b323-8a4af2337d92" containerName="limitador" Jun 03 15:50:18.186464 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.186440 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-8nc8m" Jun 03 15:50:18.190340 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.190315 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 15:50:18.193877 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.193855 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-8nc8m"] Jun 03 15:50:18.385293 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.385260 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26gn9\" (UniqueName: \"kubernetes.io/projected/d3c168f5-04b0-44bb-b2a0-a914d65b61ea-kube-api-access-26gn9\") pod \"postgres-68c4fbbd6f-8nc8m\" (UID: \"d3c168f5-04b0-44bb-b2a0-a914d65b61ea\") " pod="opendatahub/postgres-68c4fbbd6f-8nc8m" Jun 03 15:50:18.385469 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.385298 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d3c168f5-04b0-44bb-b2a0-a914d65b61ea-data\") pod \"postgres-68c4fbbd6f-8nc8m\" (UID: \"d3c168f5-04b0-44bb-b2a0-a914d65b61ea\") " pod="opendatahub/postgres-68c4fbbd6f-8nc8m" Jun 03 15:50:18.485702 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.485678 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26gn9\" (UniqueName: \"kubernetes.io/projected/d3c168f5-04b0-44bb-b2a0-a914d65b61ea-kube-api-access-26gn9\") pod \"postgres-68c4fbbd6f-8nc8m\" (UID: \"d3c168f5-04b0-44bb-b2a0-a914d65b61ea\") " pod="opendatahub/postgres-68c4fbbd6f-8nc8m" Jun 03 15:50:18.485850 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.485712 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d3c168f5-04b0-44bb-b2a0-a914d65b61ea-data\") pod \"postgres-68c4fbbd6f-8nc8m\" (UID: \"d3c168f5-04b0-44bb-b2a0-a914d65b61ea\") " pod="opendatahub/postgres-68c4fbbd6f-8nc8m" Jun 03 15:50:18.486111 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.486093 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d3c168f5-04b0-44bb-b2a0-a914d65b61ea-data\") pod \"postgres-68c4fbbd6f-8nc8m\" (UID: \"d3c168f5-04b0-44bb-b2a0-a914d65b61ea\") " pod="opendatahub/postgres-68c4fbbd6f-8nc8m" Jun 03 15:50:18.495316 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.495296 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26gn9\" (UniqueName: \"kubernetes.io/projected/d3c168f5-04b0-44bb-b2a0-a914d65b61ea-kube-api-access-26gn9\") pod \"postgres-68c4fbbd6f-8nc8m\" (UID: \"d3c168f5-04b0-44bb-b2a0-a914d65b61ea\") " pod="opendatahub/postgres-68c4fbbd6f-8nc8m" Jun 03 15:50:18.498128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.498111 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-8nc8m" Jun 03 15:50:18.633046 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:18.633014 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-8nc8m"] Jun 03 15:50:18.634710 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:50:18.634685 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c168f5_04b0_44bb_b2a0_a914d65b61ea.slice/crio-1b3d68eaade0512d936c71749bad1df91e48c411bb93ab6bb4e71fd35b1272a7 WatchSource:0}: Error finding container 1b3d68eaade0512d936c71749bad1df91e48c411bb93ab6bb4e71fd35b1272a7: Status 404 returned error can't find the container with id 1b3d68eaade0512d936c71749bad1df91e48c411bb93ab6bb4e71fd35b1272a7 Jun 03 15:50:19.272855 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:19.272814 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-8nc8m" event={"ID":"d3c168f5-04b0-44bb-b2a0-a914d65b61ea","Type":"ContainerStarted","Data":"1b3d68eaade0512d936c71749bad1df91e48c411bb93ab6bb4e71fd35b1272a7"} Jun 03 15:50:21.282279 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:21.282239 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-8nc8m" event={"ID":"d3c168f5-04b0-44bb-b2a0-a914d65b61ea","Type":"ContainerStarted","Data":"b74a133230fc78ad7ab49b6aa04967a5fcd89d6a29a96981211e766191955922"} Jun 03 15:50:21.282645 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:21.282357 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-8nc8m" Jun 03 15:50:21.302711 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:21.302660 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-8nc8m" podStartSLOduration=1.145888351 podStartE2EDuration="3.302646414s" podCreationTimestamp="2026-06-03 15:50:18 +0000 UTC" firstStartedPulling="2026-06-03 15:50:18.636435885 +0000 UTC m=+577.874183402" lastFinishedPulling="2026-06-03 15:50:20.793193948 +0000 UTC m=+580.030941465" observedRunningTime="2026-06-03 15:50:21.300930486 +0000 UTC m=+580.538678026" watchObservedRunningTime="2026-06-03 15:50:21.302646414 +0000 UTC m=+580.540393994" Jun 03 15:50:27.317241 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:27.317212 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-8nc8m" Jun 03 15:50:28.952864 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:28.952825 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74"] Jun 03 15:50:28.959283 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:28.959263 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:28.962485 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:28.962459 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fw27v\"" Jun 03 15:50:28.962646 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:28.962501 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:50:28.962792 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:28.962773 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:50:28.965400 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:28.965371 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74"] Jun 03 15:50:29.074135 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:29.074098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:29.074304 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:29.074227 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:29.074304 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:29.074271 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqk6h\" (UniqueName: \"kubernetes.io/projected/a7300e4e-41e8-402d-950f-59fec527bc09-kube-api-access-cqk6h\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:29.176071 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:29.176029 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:29.176226 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:29.176102 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqk6h\" (UniqueName: \"kubernetes.io/projected/a7300e4e-41e8-402d-950f-59fec527bc09-kube-api-access-cqk6h\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:29.176226 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:29.176157 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:29.176711 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:29.176687 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:29.176987 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:29.176965 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:29.187008 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:29.186985 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqk6h\" (UniqueName: \"kubernetes.io/projected/a7300e4e-41e8-402d-950f-59fec527bc09-kube-api-access-cqk6h\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:29.270256 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:29.270235 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:29.414617 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:29.414592 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74"] Jun 03 15:50:29.417139 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:50:29.417109 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7300e4e_41e8_402d_950f_59fec527bc09.slice/crio-6571b836016a7a214513f27f6dc726449e06526f2375f6ae3b2daa42ddcb6a36 WatchSource:0}: Error finding container 6571b836016a7a214513f27f6dc726449e06526f2375f6ae3b2daa42ddcb6a36: Status 404 returned error can't find the container with id 6571b836016a7a214513f27f6dc726449e06526f2375f6ae3b2daa42ddcb6a36 Jun 03 15:50:30.318961 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:30.318930 2566 generic.go:358] "Generic (PLEG): container finished" podID="a7300e4e-41e8-402d-950f-59fec527bc09" containerID="09116220ab596a92c891654ebdaf799f055d4871eec7dfdbc2dfc2fbdd570341" exitCode=0 Jun 03 15:50:30.319360 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:30.319020 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" event={"ID":"a7300e4e-41e8-402d-950f-59fec527bc09","Type":"ContainerDied","Data":"09116220ab596a92c891654ebdaf799f055d4871eec7dfdbc2dfc2fbdd570341"} Jun 03 15:50:30.319360 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:30.319053 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" event={"ID":"a7300e4e-41e8-402d-950f-59fec527bc09","Type":"ContainerStarted","Data":"6571b836016a7a214513f27f6dc726449e06526f2375f6ae3b2daa42ddcb6a36"} Jun 03 15:50:31.324210 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:31.324129 2566 generic.go:358] "Generic (PLEG): container finished" podID="a7300e4e-41e8-402d-950f-59fec527bc09" containerID="923c3add7186cb734420f5bc8501164d95e9a168a727ef93449978cb88fd2632" exitCode=0 Jun 03 15:50:31.324538 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:31.324217 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" event={"ID":"a7300e4e-41e8-402d-950f-59fec527bc09","Type":"ContainerDied","Data":"923c3add7186cb734420f5bc8501164d95e9a168a727ef93449978cb88fd2632"} Jun 03 15:50:32.329914 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:32.329884 2566 generic.go:358] "Generic (PLEG): container finished" podID="a7300e4e-41e8-402d-950f-59fec527bc09" containerID="22ef7ebd51f39108154f45a75ee701e66f88b2e4eb3c7ba046a25bb283396869" exitCode=0 Jun 03 15:50:32.330275 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:32.329962 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" event={"ID":"a7300e4e-41e8-402d-950f-59fec527bc09","Type":"ContainerDied","Data":"22ef7ebd51f39108154f45a75ee701e66f88b2e4eb3c7ba046a25bb283396869"} Jun 03 15:50:33.481565 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:33.481540 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:33.518652 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:33.518616 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-util\") pod \"a7300e4e-41e8-402d-950f-59fec527bc09\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " Jun 03 15:50:33.518809 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:33.518693 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqk6h\" (UniqueName: \"kubernetes.io/projected/a7300e4e-41e8-402d-950f-59fec527bc09-kube-api-access-cqk6h\") pod \"a7300e4e-41e8-402d-950f-59fec527bc09\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " Jun 03 15:50:33.518879 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:33.518815 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-bundle\") pod \"a7300e4e-41e8-402d-950f-59fec527bc09\" (UID: \"a7300e4e-41e8-402d-950f-59fec527bc09\") " Jun 03 15:50:33.519272 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:33.519245 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-bundle" (OuterVolumeSpecName: "bundle") pod "a7300e4e-41e8-402d-950f-59fec527bc09" (UID: "a7300e4e-41e8-402d-950f-59fec527bc09"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:50:33.520882 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:33.520857 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7300e4e-41e8-402d-950f-59fec527bc09-kube-api-access-cqk6h" (OuterVolumeSpecName: "kube-api-access-cqk6h") pod "a7300e4e-41e8-402d-950f-59fec527bc09" (UID: "a7300e4e-41e8-402d-950f-59fec527bc09"). InnerVolumeSpecName "kube-api-access-cqk6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:50:33.524768 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:33.524732 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-util" (OuterVolumeSpecName: "util") pod "a7300e4e-41e8-402d-950f-59fec527bc09" (UID: "a7300e4e-41e8-402d-950f-59fec527bc09"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:50:33.620016 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:33.619956 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqk6h\" (UniqueName: \"kubernetes.io/projected/a7300e4e-41e8-402d-950f-59fec527bc09-kube-api-access-cqk6h\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:50:33.620016 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:33.619980 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-bundle\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:50:33.620016 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:33.619990 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7300e4e-41e8-402d-950f-59fec527bc09-util\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:50:34.340418 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:34.340391 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" Jun 03 15:50:34.340588 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:34.340419 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70ppt74" event={"ID":"a7300e4e-41e8-402d-950f-59fec527bc09","Type":"ContainerDied","Data":"6571b836016a7a214513f27f6dc726449e06526f2375f6ae3b2daa42ddcb6a36"} Jun 03 15:50:34.340588 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:34.340452 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6571b836016a7a214513f27f6dc726449e06526f2375f6ae3b2daa42ddcb6a36" Jun 03 15:50:53.311815 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.311778 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:50:53.312205 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.312144 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7300e4e-41e8-402d-950f-59fec527bc09" containerName="pull" Jun 03 15:50:53.312205 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.312155 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7300e4e-41e8-402d-950f-59fec527bc09" containerName="pull" Jun 03 15:50:53.312205 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.312167 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7300e4e-41e8-402d-950f-59fec527bc09" containerName="util" Jun 03 15:50:53.312205 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.312173 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7300e4e-41e8-402d-950f-59fec527bc09" containerName="util" Jun 03 15:50:53.312205 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.312183 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7300e4e-41e8-402d-950f-59fec527bc09" containerName="extract" Jun 03 15:50:53.312205 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.312188 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7300e4e-41e8-402d-950f-59fec527bc09" containerName="extract" Jun 03 15:50:53.312389 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.312237 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7300e4e-41e8-402d-950f-59fec527bc09" containerName="extract" Jun 03 15:50:53.316665 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.316648 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:50:53.321448 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.321425 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 15:50:53.321448 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.321442 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 15:50:53.322529 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.322507 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 15:50:53.322651 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.322560 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-j8zw8\"" Jun 03 15:50:53.337797 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.337774 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:50:53.479413 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.479388 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62ptv\" (UniqueName: \"kubernetes.io/projected/3ae361bc-661a-4991-879a-efbb0033a70d-kube-api-access-62ptv\") pod \"maas-keycloak-0\" (UID: \"3ae361bc-661a-4991-879a-efbb0033a70d\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:50:53.580117 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.580048 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62ptv\" (UniqueName: \"kubernetes.io/projected/3ae361bc-661a-4991-879a-efbb0033a70d-kube-api-access-62ptv\") pod \"maas-keycloak-0\" (UID: \"3ae361bc-661a-4991-879a-efbb0033a70d\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:50:53.603917 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.603891 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62ptv\" (UniqueName: \"kubernetes.io/projected/3ae361bc-661a-4991-879a-efbb0033a70d-kube-api-access-62ptv\") pod \"maas-keycloak-0\" (UID: \"3ae361bc-661a-4991-879a-efbb0033a70d\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:50:53.625889 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.625863 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:50:53.774925 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:53.774894 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:50:53.776493 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:50:53.776464 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae361bc_661a_4991_879a_efbb0033a70d.slice/crio-dfd16430686935f4475ac3803b5139386ced75f4ad14e3b7096292fdbdc08885 WatchSource:0}: Error finding container dfd16430686935f4475ac3803b5139386ced75f4ad14e3b7096292fdbdc08885: Status 404 returned error can't find the container with id dfd16430686935f4475ac3803b5139386ced75f4ad14e3b7096292fdbdc08885 Jun 03 15:50:54.424946 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:54.424904 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3ae361bc-661a-4991-879a-efbb0033a70d","Type":"ContainerStarted","Data":"dfd16430686935f4475ac3803b5139386ced75f4ad14e3b7096292fdbdc08885"} Jun 03 15:50:59.456414 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:59.456319 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3ae361bc-661a-4991-879a-efbb0033a70d","Type":"ContainerStarted","Data":"7796314bbbedfe1b2bc3c6ac872484264af560aa62a8359a1550f59b51c5a5bf"} Jun 03 15:50:59.492475 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:59.492411 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.296235263 podStartE2EDuration="6.492392541s" podCreationTimestamp="2026-06-03 15:50:53 +0000 UTC" firstStartedPulling="2026-06-03 15:50:53.777813274 +0000 UTC m=+613.015560790" lastFinishedPulling="2026-06-03 15:50:58.973970547 +0000 UTC m=+618.211718068" observedRunningTime="2026-06-03 15:50:59.490473318 +0000 UTC m=+618.728220858" watchObservedRunningTime="2026-06-03 15:50:59.492392541 +0000 UTC m=+618.730140084" Jun 03 15:50:59.626178 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:59.626144 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 15:50:59.627600 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:50:59.627548 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:00.626670 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:00.626610 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:01.627241 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:01.627180 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:02.626628 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:02.626583 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:03.626597 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:03.626537 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 15:51:03.627421 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:03.627391 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:04.627348 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:04.627295 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:05.626490 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:05.626440 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:06.626213 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:06.626170 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:07.626488 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:07.626441 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:08.626912 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:08.626861 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:09.626590 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:09.626538 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:10.626769 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:10.626695 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:11.626775 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:11.626697 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 03 15:51:12.760988 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:12.760932 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 15:51:12.779260 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:12.779192 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 15:51:22.767451 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:22.767419 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 15:51:29.225740 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:29.225682 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d6db7cf6f-8whqc"] Jun 03 15:51:29.232823 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:29.232801 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d6db7cf6f-8whqc" Jun 03 15:51:29.235751 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:29.235708 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 15:51:29.236385 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:29.236368 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zv95v\"" Jun 03 15:51:29.246963 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:29.246939 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d6db7cf6f-8whqc"] Jun 03 15:51:29.323574 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:29.323543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7lrt\" (UniqueName: \"kubernetes.io/projected/e3def8f3-b323-409d-a0bc-87a32b0911ab-kube-api-access-l7lrt\") pod \"maas-controller-6d6db7cf6f-8whqc\" (UID: \"e3def8f3-b323-409d-a0bc-87a32b0911ab\") " pod="opendatahub/maas-controller-6d6db7cf6f-8whqc" Jun 03 15:51:29.424615 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:29.424590 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7lrt\" (UniqueName: \"kubernetes.io/projected/e3def8f3-b323-409d-a0bc-87a32b0911ab-kube-api-access-l7lrt\") pod \"maas-controller-6d6db7cf6f-8whqc\" (UID: \"e3def8f3-b323-409d-a0bc-87a32b0911ab\") " pod="opendatahub/maas-controller-6d6db7cf6f-8whqc" Jun 03 15:51:29.435310 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:29.435279 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7lrt\" (UniqueName: \"kubernetes.io/projected/e3def8f3-b323-409d-a0bc-87a32b0911ab-kube-api-access-l7lrt\") pod \"maas-controller-6d6db7cf6f-8whqc\" (UID: \"e3def8f3-b323-409d-a0bc-87a32b0911ab\") " pod="opendatahub/maas-controller-6d6db7cf6f-8whqc" Jun 03 15:51:29.545005 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:29.544940 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d6db7cf6f-8whqc" Jun 03 15:51:29.681104 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:29.681081 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d6db7cf6f-8whqc"] Jun 03 15:51:29.683164 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:51:29.683134 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3def8f3_b323_409d_a0bc_87a32b0911ab.slice/crio-21f5fccb83e9b12ec3cdea4c3c513ddde27de1304053b8eace50702a124637da WatchSource:0}: Error finding container 21f5fccb83e9b12ec3cdea4c3c513ddde27de1304053b8eace50702a124637da: Status 404 returned error can't find the container with id 21f5fccb83e9b12ec3cdea4c3c513ddde27de1304053b8eace50702a124637da Jun 03 15:51:29.684591 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:29.684570 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:51:30.610181 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:30.610126 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d6db7cf6f-8whqc" event={"ID":"e3def8f3-b323-409d-a0bc-87a32b0911ab","Type":"ContainerStarted","Data":"21f5fccb83e9b12ec3cdea4c3c513ddde27de1304053b8eace50702a124637da"} Jun 03 15:51:32.622633 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:32.622596 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d6db7cf6f-8whqc" event={"ID":"e3def8f3-b323-409d-a0bc-87a32b0911ab","Type":"ContainerStarted","Data":"20a552b9211ebf60303576ccc14e7360c66ecfaf93843e8034513da63787b24e"} Jun 03 15:51:32.623072 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:32.622690 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d6db7cf6f-8whqc" Jun 03 15:51:32.707989 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:32.707940 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6d6db7cf6f-8whqc" podStartSLOduration=1.394832079 podStartE2EDuration="3.707927981s" podCreationTimestamp="2026-06-03 15:51:29 +0000 UTC" firstStartedPulling="2026-06-03 15:51:29.684768359 +0000 UTC m=+648.922515880" lastFinishedPulling="2026-06-03 15:51:31.997864263 +0000 UTC m=+651.235611782" observedRunningTime="2026-06-03 15:51:32.703442438 +0000 UTC m=+651.941189988" watchObservedRunningTime="2026-06-03 15:51:32.707927981 +0000 UTC m=+651.945675520" Jun 03 15:51:43.632612 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:51:43.632583 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d6db7cf6f-8whqc" Jun 03 15:52:16.183546 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:16.183509 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:52:16.184130 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:16.183751 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" containerID="cri-o://7796314bbbedfe1b2bc3c6ac872484264af560aa62a8359a1550f59b51c5a5bf" gracePeriod=30 Jun 03 15:52:17.813774 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:17.813740 2566 generic.go:358] "Generic (PLEG): container finished" podID="3ae361bc-661a-4991-879a-efbb0033a70d" containerID="7796314bbbedfe1b2bc3c6ac872484264af560aa62a8359a1550f59b51c5a5bf" exitCode=143 Jun 03 15:52:17.814103 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:17.813769 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3ae361bc-661a-4991-879a-efbb0033a70d","Type":"ContainerDied","Data":"7796314bbbedfe1b2bc3c6ac872484264af560aa62a8359a1550f59b51c5a5bf"} Jun 03 15:52:17.829501 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:17.829471 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:17.949296 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:17.949206 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62ptv\" (UniqueName: \"kubernetes.io/projected/3ae361bc-661a-4991-879a-efbb0033a70d-kube-api-access-62ptv\") pod \"3ae361bc-661a-4991-879a-efbb0033a70d\" (UID: \"3ae361bc-661a-4991-879a-efbb0033a70d\") " Jun 03 15:52:17.951525 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:17.951502 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ae361bc-661a-4991-879a-efbb0033a70d-kube-api-access-62ptv" (OuterVolumeSpecName: "kube-api-access-62ptv") pod "3ae361bc-661a-4991-879a-efbb0033a70d" (UID: "3ae361bc-661a-4991-879a-efbb0033a70d"). InnerVolumeSpecName "kube-api-access-62ptv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:52:18.050065 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.050037 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62ptv\" (UniqueName: \"kubernetes.io/projected/3ae361bc-661a-4991-879a-efbb0033a70d-kube-api-access-62ptv\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 15:52:18.819512 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.819478 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3ae361bc-661a-4991-879a-efbb0033a70d","Type":"ContainerDied","Data":"dfd16430686935f4475ac3803b5139386ced75f4ad14e3b7096292fdbdc08885"} Jun 03 15:52:18.819947 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.819522 2566 scope.go:117] "RemoveContainer" containerID="7796314bbbedfe1b2bc3c6ac872484264af560aa62a8359a1550f59b51c5a5bf" Jun 03 15:52:18.819947 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.819527 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:18.842809 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.842785 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:52:18.849961 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.849941 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:52:18.873964 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.873939 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:52:18.874359 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.874346 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" Jun 03 15:52:18.874403 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.874361 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" Jun 03 15:52:18.874450 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.874440 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" containerName="keycloak" Jun 03 15:52:18.877443 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.877426 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:18.880016 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.879998 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 15:52:18.880115 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.880039 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 15:52:18.880115 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.880053 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-j8zw8\"" Jun 03 15:52:18.880115 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.880053 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 15:52:18.880308 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.880291 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 15:52:18.889680 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.889661 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:52:18.956633 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.956607 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1b1557c1-9e46-46a8-934a-0f3e17f68115-test-realms\") pod \"maas-keycloak-0\" (UID: \"1b1557c1-9e46-46a8-934a-0f3e17f68115\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:18.956779 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:18.956640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqzzn\" (UniqueName: \"kubernetes.io/projected/1b1557c1-9e46-46a8-934a-0f3e17f68115-kube-api-access-hqzzn\") pod \"maas-keycloak-0\" (UID: \"1b1557c1-9e46-46a8-934a-0f3e17f68115\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:19.058089 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:19.058059 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1b1557c1-9e46-46a8-934a-0f3e17f68115-test-realms\") pod \"maas-keycloak-0\" (UID: \"1b1557c1-9e46-46a8-934a-0f3e17f68115\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:19.058233 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:19.058098 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqzzn\" (UniqueName: \"kubernetes.io/projected/1b1557c1-9e46-46a8-934a-0f3e17f68115-kube-api-access-hqzzn\") pod \"maas-keycloak-0\" (UID: \"1b1557c1-9e46-46a8-934a-0f3e17f68115\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:19.058751 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:19.058705 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1b1557c1-9e46-46a8-934a-0f3e17f68115-test-realms\") pod \"maas-keycloak-0\" (UID: \"1b1557c1-9e46-46a8-934a-0f3e17f68115\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:19.067669 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:19.067647 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqzzn\" (UniqueName: \"kubernetes.io/projected/1b1557c1-9e46-46a8-934a-0f3e17f68115-kube-api-access-hqzzn\") pod \"maas-keycloak-0\" (UID: \"1b1557c1-9e46-46a8-934a-0f3e17f68115\") " pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:19.187600 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:19.187528 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:19.249949 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:19.249919 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ae361bc-661a-4991-879a-efbb0033a70d" path="/var/lib/kubelet/pods/3ae361bc-661a-4991-879a-efbb0033a70d/volumes" Jun 03 15:52:19.324669 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:19.324640 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 15:52:19.325561 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:52:19.325534 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1557c1_9e46_46a8_934a_0f3e17f68115.slice/crio-7fe571893e5f7bd63045b8347a5908492c2af3f28bcdd8eafa81863d13fa8358 WatchSource:0}: Error finding container 7fe571893e5f7bd63045b8347a5908492c2af3f28bcdd8eafa81863d13fa8358: Status 404 returned error can't find the container with id 7fe571893e5f7bd63045b8347a5908492c2af3f28bcdd8eafa81863d13fa8358 Jun 03 15:52:19.826382 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:19.826350 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1b1557c1-9e46-46a8-934a-0f3e17f68115","Type":"ContainerStarted","Data":"7fe571893e5f7bd63045b8347a5908492c2af3f28bcdd8eafa81863d13fa8358"} Jun 03 15:52:20.833233 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:20.833188 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1b1557c1-9e46-46a8-934a-0f3e17f68115","Type":"ContainerStarted","Data":"b529774f6be4ae26cccae6b5ff79fb6b96d8be9486ea3f8893bdfc0f07505963"} Jun 03 15:52:20.857487 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:20.857411 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.406866174 podStartE2EDuration="2.857392312s" podCreationTimestamp="2026-06-03 15:52:18 +0000 UTC" firstStartedPulling="2026-06-03 15:52:19.326899516 +0000 UTC m=+698.564647033" lastFinishedPulling="2026-06-03 15:52:19.777425651 +0000 UTC m=+699.015173171" observedRunningTime="2026-06-03 15:52:20.854344914 +0000 UTC m=+700.092092459" watchObservedRunningTime="2026-06-03 15:52:20.857392312 +0000 UTC m=+700.095139852" Jun 03 15:52:21.188104 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:21.187981 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:21.190215 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:21.190167 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:22.188281 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:22.188236 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:23.188990 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:23.188939 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:24.188118 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:24.188073 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:25.188138 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:25.188079 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:26.188828 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:26.188783 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:27.188746 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:27.188655 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:28.188190 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:28.188094 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:29.188043 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:29.187995 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:29.188390 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:29.188351 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:30.188701 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:30.188652 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:31.189046 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:31.188993 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:32.188425 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:32.188366 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 03 15:52:33.301378 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:33.301317 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 15:52:33.319160 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:33.318769 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="1b1557c1-9e46-46a8-934a-0f3e17f68115" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 15:52:43.307252 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:52:43.307214 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 15:53:13.747647 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.747615 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n"] Jun 03 15:53:13.751564 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.751549 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.754352 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.754328 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 15:53:13.755336 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.755313 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b7blc\"" Jun 03 15:53:13.755440 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.755362 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 15:53:13.755440 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.755391 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 15:53:13.764110 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.764082 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n"] Jun 03 15:53:13.848764 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.848703 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92gkf\" (UniqueName: \"kubernetes.io/projected/f9d43cb1-bad3-4061-a05c-d19e3f20b399-kube-api-access-92gkf\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.848916 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.848819 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.848916 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.848874 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.848916 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.848903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.849037 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.848929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.849037 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.848966 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9d43cb1-bad3-4061-a05c-d19e3f20b399-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.949595 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.949565 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.949764 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.949618 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.949764 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.949661 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.949764 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.949686 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.949764 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.949704 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9d43cb1-bad3-4061-a05c-d19e3f20b399-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.949764 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.949757 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92gkf\" (UniqueName: \"kubernetes.io/projected/f9d43cb1-bad3-4061-a05c-d19e3f20b399-kube-api-access-92gkf\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.950093 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.950065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.950159 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.950096 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.950220 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.950163 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.952153 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.952119 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9d43cb1-bad3-4061-a05c-d19e3f20b399-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.952474 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.952455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9d43cb1-bad3-4061-a05c-d19e3f20b399-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:13.958019 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:13.957997 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92gkf\" (UniqueName: \"kubernetes.io/projected/f9d43cb1-bad3-4061-a05c-d19e3f20b399-kube-api-access-92gkf\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n\" (UID: \"f9d43cb1-bad3-4061-a05c-d19e3f20b399\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:14.065443 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:14.065380 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:53:14.203672 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:14.203646 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n"] Jun 03 15:53:14.205884 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:53:14.205857 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d43cb1_bad3_4061_a05c_d19e3f20b399.slice/crio-e111075243f4985c24f4abe934aafc6f12fc231770f9d956b612e1345cb8f5d3 WatchSource:0}: Error finding container e111075243f4985c24f4abe934aafc6f12fc231770f9d956b612e1345cb8f5d3: Status 404 returned error can't find the container with id e111075243f4985c24f4abe934aafc6f12fc231770f9d956b612e1345cb8f5d3 Jun 03 15:53:15.085518 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:15.085475 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" event={"ID":"f9d43cb1-bad3-4061-a05c-d19e3f20b399","Type":"ContainerStarted","Data":"e111075243f4985c24f4abe934aafc6f12fc231770f9d956b612e1345cb8f5d3"} Jun 03 15:53:18.103682 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:18.103646 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" event={"ID":"f9d43cb1-bad3-4061-a05c-d19e3f20b399","Type":"ContainerStarted","Data":"ae578a0c8879ee7578cc0e25b56e13aeb1ed1460b352755be1e1d3188b644d22"} Jun 03 15:53:51.909311 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:51.909280 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4"] Jun 03 15:53:51.913260 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:51.913239 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:51.917456 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:51.917433 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 15:53:51.955790 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:51.955761 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4"] Jun 03 15:53:51.977933 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:51.977911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:51.978033 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:51.977942 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqgpn\" (UniqueName: \"kubernetes.io/projected/ce6836d3-9714-481b-8a48-6dd90928987e-kube-api-access-qqgpn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:51.978033 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:51.977962 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:51.978033 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:51.977982 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:51.978137 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:51.978052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6836d3-9714-481b-8a48-6dd90928987e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:51.978137 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:51.978085 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.079331 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.079297 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6836d3-9714-481b-8a48-6dd90928987e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.079500 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.079352 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.079500 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.079408 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.079500 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.079426 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqgpn\" (UniqueName: \"kubernetes.io/projected/ce6836d3-9714-481b-8a48-6dd90928987e-kube-api-access-qqgpn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.079500 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.079448 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.079500 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.079474 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.079975 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.079947 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.080075 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.079985 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.080075 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.079955 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.081685 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.081663 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6836d3-9714-481b-8a48-6dd90928987e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.081911 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.081888 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6836d3-9714-481b-8a48-6dd90928987e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.091077 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.091031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqgpn\" (UniqueName: \"kubernetes.io/projected/ce6836d3-9714-481b-8a48-6dd90928987e-kube-api-access-qqgpn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4\" (UID: \"ce6836d3-9714-481b-8a48-6dd90928987e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.223980 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.223951 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:53:52.365508 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:52.365484 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4"] Jun 03 15:53:52.367172 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:53:52.367145 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6836d3_9714_481b_8a48_6dd90928987e.slice/crio-1bd04ad71bb06759b5afd98906a7d9cb597e1a8d415d1b667de372b3294a1742 WatchSource:0}: Error finding container 1bd04ad71bb06759b5afd98906a7d9cb597e1a8d415d1b667de372b3294a1742: Status 404 returned error can't find the container with id 1bd04ad71bb06759b5afd98906a7d9cb597e1a8d415d1b667de372b3294a1742 Jun 03 15:53:53.247527 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:53.247492 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" event={"ID":"ce6836d3-9714-481b-8a48-6dd90928987e","Type":"ContainerStarted","Data":"a6ffebecd9cbfde8596388709513d87247f2423a110d347d39bc8d76a34460db"} Jun 03 15:53:53.247527 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:53.247527 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" event={"ID":"ce6836d3-9714-481b-8a48-6dd90928987e","Type":"ContainerStarted","Data":"1bd04ad71bb06759b5afd98906a7d9cb597e1a8d415d1b667de372b3294a1742"} Jun 03 15:53:59.272763 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:59.272706 2566 generic.go:358] "Generic (PLEG): container finished" podID="ce6836d3-9714-481b-8a48-6dd90928987e" containerID="a6ffebecd9cbfde8596388709513d87247f2423a110d347d39bc8d76a34460db" exitCode=0 Jun 03 15:53:59.273141 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:53:59.272780 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" event={"ID":"ce6836d3-9714-481b-8a48-6dd90928987e","Type":"ContainerDied","Data":"a6ffebecd9cbfde8596388709513d87247f2423a110d347d39bc8d76a34460db"} Jun 03 15:54:01.283826 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:01.283713 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" event={"ID":"ce6836d3-9714-481b-8a48-6dd90928987e","Type":"ContainerStarted","Data":"5f651209e69dd42ae75541f9010ddc4c937d7066d4a5945750bfecbcd4371993"} Jun 03 15:54:01.312039 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:01.311989 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" podStartSLOduration=8.589309258 podStartE2EDuration="10.3119753s" podCreationTimestamp="2026-06-03 15:53:51 +0000 UTC" firstStartedPulling="2026-06-03 15:53:59.273418705 +0000 UTC m=+798.511166222" lastFinishedPulling="2026-06-03 15:54:00.996084747 +0000 UTC m=+800.233832264" observedRunningTime="2026-06-03 15:54:01.308434986 +0000 UTC m=+800.546182526" watchObservedRunningTime="2026-06-03 15:54:01.3119753 +0000 UTC m=+800.549722840" Jun 03 15:54:02.224658 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:02.224615 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:54:02.224863 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:02.224670 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:54:02.239381 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:02.239354 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:54:02.301738 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:02.301634 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4" Jun 03 15:54:14.346244 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:14.346162 2566 generic.go:358] "Generic (PLEG): container finished" podID="f9d43cb1-bad3-4061-a05c-d19e3f20b399" containerID="ae578a0c8879ee7578cc0e25b56e13aeb1ed1460b352755be1e1d3188b644d22" exitCode=0 Jun 03 15:54:14.346244 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:14.346234 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" event={"ID":"f9d43cb1-bad3-4061-a05c-d19e3f20b399","Type":"ContainerDied","Data":"ae578a0c8879ee7578cc0e25b56e13aeb1ed1460b352755be1e1d3188b644d22"} Jun 03 15:54:15.351384 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.351352 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" event={"ID":"f9d43cb1-bad3-4061-a05c-d19e3f20b399","Type":"ContainerStarted","Data":"4dde063906a01122ce3e39771198cefa571850ace424bbdd321fcf891ca3479c"} Jun 03 15:54:15.374749 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.374684 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" podStartSLOduration=1.931059517 podStartE2EDuration="1m2.374671073s" podCreationTimestamp="2026-06-03 15:53:13 +0000 UTC" firstStartedPulling="2026-06-03 15:53:14.2078456 +0000 UTC m=+753.445593133" lastFinishedPulling="2026-06-03 15:54:14.651457171 +0000 UTC m=+813.889204689" observedRunningTime="2026-06-03 15:54:15.371571829 +0000 UTC m=+814.609319370" watchObservedRunningTime="2026-06-03 15:54:15.374671073 +0000 UTC m=+814.612418612" Jun 03 15:54:15.457270 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.457240 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4"] Jun 03 15:54:15.461128 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.461112 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.463617 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.463595 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 15:54:15.469709 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.469683 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4"] Jun 03 15:54:15.586425 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.586390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.586604 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.586435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.586604 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.586461 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.586604 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.586484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cf9303b-a3f1-462a-a0e7-01b7140442b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.586604 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.586545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfxh\" (UniqueName: \"kubernetes.io/projected/6cf9303b-a3f1-462a-a0e7-01b7140442b4-kube-api-access-2pfxh\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.586824 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.586638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.687434 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.687341 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.687434 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.687389 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.687434 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.687409 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.687710 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.687541 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cf9303b-a3f1-462a-a0e7-01b7140442b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.687710 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.687582 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfxh\" (UniqueName: \"kubernetes.io/projected/6cf9303b-a3f1-462a-a0e7-01b7140442b4-kube-api-access-2pfxh\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.687710 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.687652 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.687889 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.687861 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.687943 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.687883 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.688094 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.688070 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.690006 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.689977 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cf9303b-a3f1-462a-a0e7-01b7140442b4-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.690522 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.690500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cf9303b-a3f1-462a-a0e7-01b7140442b4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.697219 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.697194 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfxh\" (UniqueName: \"kubernetes.io/projected/6cf9303b-a3f1-462a-a0e7-01b7140442b4-kube-api-access-2pfxh\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4\" (UID: \"6cf9303b-a3f1-462a-a0e7-01b7140442b4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.771898 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.771870 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" Jun 03 15:54:15.911036 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:15.911009 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4"] Jun 03 15:54:15.912677 ip-10-0-139-233 kubenswrapper[2566]: W0603 15:54:15.912652 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf9303b_a3f1_462a_a0e7_01b7140442b4.slice/crio-2765a67d83589909a250cb79b5d8dd0ff16968f17f959ebb24bcfc81788d848b WatchSource:0}: Error finding container 2765a67d83589909a250cb79b5d8dd0ff16968f17f959ebb24bcfc81788d848b: Status 404 returned error can't find the container with id 2765a67d83589909a250cb79b5d8dd0ff16968f17f959ebb24bcfc81788d848b Jun 03 15:54:16.357417 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:16.357375 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" event={"ID":"6cf9303b-a3f1-462a-a0e7-01b7140442b4","Type":"ContainerStarted","Data":"b3e058f496f18fa5d9fccda8539277b67a159740617818547dd926248a9ff8e9"} Jun 03 15:54:16.357417 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:16.357418 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4" event={"ID":"6cf9303b-a3f1-462a-a0e7-01b7140442b4","Type":"ContainerStarted","Data":"2765a67d83589909a250cb79b5d8dd0ff16968f17f959ebb24bcfc81788d848b"} Jun 03 15:54:24.066236 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:24.066202 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:54:24.066236 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:24.066243 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:54:24.078504 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:24.078481 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:54:24.406741 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:54:24.406641 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n" Jun 03 15:55:41.239468 ip-10-0-139-233 kubenswrapper[2566]: I0603 15:55:41.239382 2566 scope.go:117] "RemoveContainer" containerID="cc9694fc4978ee4ff6d0b36fc119eac344f78b0766525d14754203d2f4e049d2" Jun 03 16:00:00.165111 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:00.165027 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675040-pfhmr"] Jun 03 16:00:00.170032 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:00.170015 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" Jun 03 16:00:00.172780 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:00.172759 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6fsqp\"" Jun 03 16:00:00.189070 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:00.189044 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675040-pfhmr"] Jun 03 16:00:00.273955 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:00.273916 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgxrc\" (UniqueName: \"kubernetes.io/projected/a9ef4479-7c67-4933-9fe7-4b0f8d630c72-kube-api-access-wgxrc\") pod \"maas-api-key-cleanup-29675040-pfhmr\" (UID: \"a9ef4479-7c67-4933-9fe7-4b0f8d630c72\") " pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" Jun 03 16:00:00.374609 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:00.374578 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgxrc\" (UniqueName: \"kubernetes.io/projected/a9ef4479-7c67-4933-9fe7-4b0f8d630c72-kube-api-access-wgxrc\") pod \"maas-api-key-cleanup-29675040-pfhmr\" (UID: \"a9ef4479-7c67-4933-9fe7-4b0f8d630c72\") " pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" Jun 03 16:00:00.386384 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:00.386348 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgxrc\" (UniqueName: \"kubernetes.io/projected/a9ef4479-7c67-4933-9fe7-4b0f8d630c72-kube-api-access-wgxrc\") pod \"maas-api-key-cleanup-29675040-pfhmr\" (UID: \"a9ef4479-7c67-4933-9fe7-4b0f8d630c72\") " pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" Jun 03 16:00:00.481175 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:00.481148 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" Jun 03 16:00:00.621856 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:00.621828 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675040-pfhmr"] Jun 03 16:00:00.622863 ip-10-0-139-233 kubenswrapper[2566]: W0603 16:00:00.622837 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ef4479_7c67_4933_9fe7_4b0f8d630c72.slice/crio-a388c7b1f1fa473c107fe10970b1f6aacc80dff97b80208b6cb4a509381fa58a WatchSource:0}: Error finding container a388c7b1f1fa473c107fe10970b1f6aacc80dff97b80208b6cb4a509381fa58a: Status 404 returned error can't find the container with id a388c7b1f1fa473c107fe10970b1f6aacc80dff97b80208b6cb4a509381fa58a Jun 03 16:00:00.624689 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:00.624673 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:00:00.839614 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:00.839528 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" event={"ID":"a9ef4479-7c67-4933-9fe7-4b0f8d630c72","Type":"ContainerStarted","Data":"a388c7b1f1fa473c107fe10970b1f6aacc80dff97b80208b6cb4a509381fa58a"} Jun 03 16:00:15.013240 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:15.013207 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4_6cf9303b-a3f1-462a-a0e7-01b7140442b4/storage-initializer/0.log" Jun 03 16:00:19.927057 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:19.927017 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" event={"ID":"a9ef4479-7c67-4933-9fe7-4b0f8d630c72","Type":"ContainerStarted","Data":"9baf707e245bc1d4903d434c567ee4dc6db9e01868d5199c29a9b84d802c1a49"} Jun 03 16:00:19.946173 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:19.946127 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" podStartSLOduration=1.521251407 podStartE2EDuration="19.946114161s" podCreationTimestamp="2026-06-03 16:00:00 +0000 UTC" firstStartedPulling="2026-06-03 16:00:00.62482142 +0000 UTC m=+1159.862568937" lastFinishedPulling="2026-06-03 16:00:19.049684163 +0000 UTC m=+1178.287431691" observedRunningTime="2026-06-03 16:00:19.944506298 +0000 UTC m=+1179.182253837" watchObservedRunningTime="2026-06-03 16:00:19.946114161 +0000 UTC m=+1179.183861700" Jun 03 16:00:20.657923 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:20.657878 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7888f9cd56-75g2c_280c81e7-fc54-45fe-83fa-69a3d365342c/nginx/0.log" Jun 03 16:00:20.886226 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:20.886190 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-5lvh5_f655bbcb-6f30-4d7d-94ac-3c3b3322fb73/manager/0.log" Jun 03 16:00:20.933367 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:20.933280 2566 generic.go:358] "Generic (PLEG): container finished" podID="a9ef4479-7c67-4933-9fe7-4b0f8d630c72" containerID="9baf707e245bc1d4903d434c567ee4dc6db9e01868d5199c29a9b84d802c1a49" exitCode=0 Jun 03 16:00:20.933367 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:20.933339 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" event={"ID":"a9ef4479-7c67-4933-9fe7-4b0f8d630c72","Type":"ContainerDied","Data":"9baf707e245bc1d4903d434c567ee4dc6db9e01868d5199c29a9b84d802c1a49"} Jun 03 16:00:21.012775 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:21.012748 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-6nmkc_98f57d4f-ad70-4f36-a558-c1df7e231226/manager/0.log" Jun 03 16:00:21.246415 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:21.246386 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675040-pfhmr_a9ef4479-7c67-4933-9fe7-4b0f8d630c72/cleanup/0.log" Jun 03 16:00:21.386812 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:21.386787 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d6db7cf6f-8whqc_e3def8f3-b323-409d-a0bc-87a32b0911ab/manager/0.log" Jun 03 16:00:21.733696 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:21.733662 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548f4487f9-9zbqz_ba7c3685-c450-469c-a17c-07c913c1eb01/copy-manifests/0.log" Jun 03 16:00:21.741487 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:21.741455 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548f4487f9-9zbqz_ba7c3685-c450-469c-a17c-07c913c1eb01/manager/0.log" Jun 03 16:00:22.081957 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:22.081932 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" Jun 03 16:00:22.173937 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:22.173906 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-8nc8m_d3c168f5-04b0-44bb-b2a0-a914d65b61ea/postgres/0.log" Jun 03 16:00:22.178464 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:22.178439 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgxrc\" (UniqueName: \"kubernetes.io/projected/a9ef4479-7c67-4933-9fe7-4b0f8d630c72-kube-api-access-wgxrc\") pod \"a9ef4479-7c67-4933-9fe7-4b0f8d630c72\" (UID: \"a9ef4479-7c67-4933-9fe7-4b0f8d630c72\") " Jun 03 16:00:22.180745 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:22.180705 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9ef4479-7c67-4933-9fe7-4b0f8d630c72-kube-api-access-wgxrc" (OuterVolumeSpecName: "kube-api-access-wgxrc") pod "a9ef4479-7c67-4933-9fe7-4b0f8d630c72" (UID: "a9ef4479-7c67-4933-9fe7-4b0f8d630c72"). InnerVolumeSpecName "kube-api-access-wgxrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:00:22.279410 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:22.279324 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgxrc\" (UniqueName: \"kubernetes.io/projected/a9ef4479-7c67-4933-9fe7-4b0f8d630c72-kube-api-access-wgxrc\") on node \"ip-10-0-139-233.ec2.internal\" DevicePath \"\"" Jun 03 16:00:22.943936 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:22.943909 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" Jun 03 16:00:22.944080 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:22.943908 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675040-pfhmr" event={"ID":"a9ef4479-7c67-4933-9fe7-4b0f8d630c72","Type":"ContainerDied","Data":"a388c7b1f1fa473c107fe10970b1f6aacc80dff97b80208b6cb4a509381fa58a"} Jun 03 16:00:22.944080 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:22.944017 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a388c7b1f1fa473c107fe10970b1f6aacc80dff97b80208b6cb4a509381fa58a" Jun 03 16:00:23.010921 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.010893 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb_51829f7c-59f2-444d-bd88-1605c29672ea/util/0.log" Jun 03 16:00:23.018063 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.018027 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb_51829f7c-59f2-444d-bd88-1605c29672ea/pull/0.log" Jun 03 16:00:23.024120 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.024104 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb_51829f7c-59f2-444d-bd88-1605c29672ea/extract/0.log" Jun 03 16:00:23.135457 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.135432 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw_06e219d7-4de4-475f-9b1f-0bc9089ba4ec/util/0.log" Jun 03 16:00:23.142836 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.142814 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw_06e219d7-4de4-475f-9b1f-0bc9089ba4ec/pull/0.log" Jun 03 16:00:23.149668 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.149646 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw_06e219d7-4de4-475f-9b1f-0bc9089ba4ec/extract/0.log" Jun 03 16:00:23.259454 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.259430 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88_a2e697c2-6d7e-433b-9d69-935f21abf678/util/0.log" Jun 03 16:00:23.266865 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.266837 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88_a2e697c2-6d7e-433b-9d69-935f21abf678/pull/0.log" Jun 03 16:00:23.273887 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.273867 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88_a2e697c2-6d7e-433b-9d69-935f21abf678/extract/0.log" Jun 03 16:00:23.383094 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.383066 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42_00047758-dfe8-45fb-948d-6b5856ead1ac/extract/0.log" Jun 03 16:00:23.390214 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.390189 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42_00047758-dfe8-45fb-948d-6b5856ead1ac/util/0.log" Jun 03 16:00:23.396734 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:23.396697 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42_00047758-dfe8-45fb-948d-6b5856ead1ac/pull/0.log" Jun 03 16:00:24.104255 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:24.104225 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-6lqnl_04f8144a-15a6-49f9-94fa-23689080aaa2/manager/0.log" Jun 03 16:00:24.813867 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:24.813826 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-ndj49_ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48/discovery/0.log" Jun 03 16:00:25.054115 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:25.054080 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cc4c89bc4-vq68j_027033de-70d8-4b3e-ae9a-112cac41800e/kube-auth-proxy/0.log" Jun 03 16:00:25.435224 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:25.435196 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64c87cbd65-8xckp_d10fe152-c199-408e-9552-04e3be42bb28/router/0.log" Jun 03 16:00:25.912854 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:25.912822 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n_f9d43cb1-bad3-4061-a05c-d19e3f20b399/storage-initializer/0.log" Jun 03 16:00:25.921575 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:25.921555 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-ncw5n_f9d43cb1-bad3-4061-a05c-d19e3f20b399/main/0.log" Jun 03 16:00:26.152764 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:26.152737 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4_ce6836d3-9714-481b-8a48-6dd90928987e/main/0.log" Jun 03 16:00:26.161585 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:26.161562 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9lcpr4_ce6836d3-9714-481b-8a48-6dd90928987e/storage-initializer/0.log" Jun 03 16:00:26.393793 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:26.393761 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-9hlf4_6cf9303b-a3f1-462a-a0e7-01b7140442b4/storage-initializer/0.log" Jun 03 16:00:35.686099 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:35.686067 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lrjqd_60e89a0d-ca13-4ed3-834f-440d973a813f/global-pull-secret-syncer/0.log" Jun 03 16:00:35.777739 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:35.777689 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qxccn_24e0b295-848d-456f-8447-6cb5878a49fb/konnectivity-agent/0.log" Jun 03 16:00:35.888478 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:35.888452 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-233.ec2.internal_c8fd5fecc6875c8582ac03c1e0e534ca/haproxy/0.log" Jun 03 16:00:39.832207 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:39.832118 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb_51829f7c-59f2-444d-bd88-1605c29672ea/extract/0.log" Jun 03 16:00:39.856531 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:39.856503 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb_51829f7c-59f2-444d-bd88-1605c29672ea/util/0.log" Jun 03 16:00:39.887627 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:39.887600 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hqmcb_51829f7c-59f2-444d-bd88-1605c29672ea/pull/0.log" Jun 03 16:00:39.926991 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:39.926970 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw_06e219d7-4de4-475f-9b1f-0bc9089ba4ec/extract/0.log" Jun 03 16:00:39.957448 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:39.957421 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw_06e219d7-4de4-475f-9b1f-0bc9089ba4ec/util/0.log" Jun 03 16:00:39.985712 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:39.985691 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09dhnw_06e219d7-4de4-475f-9b1f-0bc9089ba4ec/pull/0.log" Jun 03 16:00:40.016031 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:40.016009 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88_a2e697c2-6d7e-433b-9d69-935f21abf678/extract/0.log" Jun 03 16:00:40.039555 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:40.039536 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88_a2e697c2-6d7e-433b-9d69-935f21abf678/util/0.log" Jun 03 16:00:40.067261 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:40.067241 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jdm88_a2e697c2-6d7e-433b-9d69-935f21abf678/pull/0.log" Jun 03 16:00:40.098380 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:40.098313 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42_00047758-dfe8-45fb-948d-6b5856ead1ac/extract/0.log" Jun 03 16:00:40.121777 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:40.121755 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42_00047758-dfe8-45fb-948d-6b5856ead1ac/util/0.log" Jun 03 16:00:40.146038 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:40.146021 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1m2d42_00047758-dfe8-45fb-948d-6b5856ead1ac/pull/0.log" Jun 03 16:00:40.466845 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:40.466815 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-6lqnl_04f8144a-15a6-49f9-94fa-23689080aaa2/manager/0.log" Jun 03 16:00:41.955670 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:41.955639 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_184539f1-23b7-40ef-9889-58ec8fbfce20/alertmanager/0.log" Jun 03 16:00:41.982793 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:41.982751 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_184539f1-23b7-40ef-9889-58ec8fbfce20/config-reloader/0.log" Jun 03 16:00:42.003835 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:42.003810 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_184539f1-23b7-40ef-9889-58ec8fbfce20/kube-rbac-proxy-web/0.log" Jun 03 16:00:42.025474 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:42.025452 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_184539f1-23b7-40ef-9889-58ec8fbfce20/kube-rbac-proxy/0.log" Jun 03 16:00:42.050262 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:42.050238 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_184539f1-23b7-40ef-9889-58ec8fbfce20/kube-rbac-proxy-metric/0.log" Jun 03 16:00:42.073244 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:42.073220 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_184539f1-23b7-40ef-9889-58ec8fbfce20/prom-label-proxy/0.log" Jun 03 16:00:42.106929 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:42.106899 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_184539f1-23b7-40ef-9889-58ec8fbfce20/init-config-reloader/0.log" Jun 03 16:00:42.303572 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:42.303550 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-ls2bw_c6c4c34d-bb35-4c0d-83f1-947b19d10f55/monitoring-plugin/0.log" Jun 03 16:00:42.336128 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:42.336088 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-25sd5_c48277cf-010d-4225-a9b7-409a4e3cf8d7/node-exporter/0.log" Jun 03 16:00:42.359205 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:42.359183 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-25sd5_c48277cf-010d-4225-a9b7-409a4e3cf8d7/kube-rbac-proxy/0.log" Jun 03 16:00:42.394051 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:42.394031 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-25sd5_c48277cf-010d-4225-a9b7-409a4e3cf8d7/init-textfile/0.log" Jun 03 16:00:43.066219 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:43.066192 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb7fc764d-rsg94_65029175-2136-4df0-af63-d33288f33245/thanos-query/0.log" Jun 03 16:00:43.090373 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:43.090346 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb7fc764d-rsg94_65029175-2136-4df0-af63-d33288f33245/kube-rbac-proxy-web/0.log" Jun 03 16:00:43.131239 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:43.131213 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb7fc764d-rsg94_65029175-2136-4df0-af63-d33288f33245/kube-rbac-proxy/0.log" Jun 03 16:00:43.156295 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:43.156276 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb7fc764d-rsg94_65029175-2136-4df0-af63-d33288f33245/prom-label-proxy/0.log" Jun 03 16:00:43.181155 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:43.181133 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb7fc764d-rsg94_65029175-2136-4df0-af63-d33288f33245/kube-rbac-proxy-rules/0.log" Jun 03 16:00:43.202936 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:43.202912 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb7fc764d-rsg94_65029175-2136-4df0-af63-d33288f33245/kube-rbac-proxy-metrics/0.log" Jun 03 16:00:44.326695 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.326656 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-nwqfc_ae750873-93db-4ebd-8d5d-990e0c4b62c3/networking-console-plugin/0.log" Jun 03 16:00:44.733099 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.733072 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc"] Jun 03 16:00:44.733488 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.733476 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9ef4479-7c67-4933-9fe7-4b0f8d630c72" containerName="cleanup" Jun 03 16:00:44.733573 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.733491 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9ef4479-7c67-4933-9fe7-4b0f8d630c72" containerName="cleanup" Jun 03 16:00:44.733573 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.733566 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9ef4479-7c67-4933-9fe7-4b0f8d630c72" containerName="cleanup" Jun 03 16:00:44.737052 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.737037 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.739870 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.739847 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjb2f\"/\"openshift-service-ca.crt\"" Jun 03 16:00:44.740011 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.739847 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gjb2f\"/\"default-dockercfg-9mlg5\"" Jun 03 16:00:44.740750 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.740712 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjb2f\"/\"kube-root-ca.crt\"" Jun 03 16:00:44.747871 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.747847 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc"] Jun 03 16:00:44.871873 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.871830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-lib-modules\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.871873 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.871875 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-sys\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.872061 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.871897 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpmqr\" (UniqueName: \"kubernetes.io/projected/4dec6673-f563-4a55-b064-c9d3bbc75ee8-kube-api-access-cpmqr\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.872061 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.872022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-podres\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.872135 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.872072 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-proc\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.973137 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.973097 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-podres\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.973137 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.973156 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-proc\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.973372 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.973192 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-lib-modules\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.973372 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.973210 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-sys\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.973372 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.973231 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpmqr\" (UniqueName: \"kubernetes.io/projected/4dec6673-f563-4a55-b064-c9d3bbc75ee8-kube-api-access-cpmqr\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.973372 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.973266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-podres\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.973372 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.973317 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-proc\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.973372 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.973326 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-sys\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.973372 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.973345 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4dec6673-f563-4a55-b064-c9d3bbc75ee8-lib-modules\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:44.982083 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:44.982056 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpmqr\" (UniqueName: \"kubernetes.io/projected/4dec6673-f563-4a55-b064-c9d3bbc75ee8-kube-api-access-cpmqr\") pod \"perf-node-gather-daemonset-2j7wc\" (UID: \"4dec6673-f563-4a55-b064-c9d3bbc75ee8\") " pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:45.049932 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:45.049873 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:45.395025 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:45.394996 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc"] Jun 03 16:00:45.396533 ip-10-0-139-233 kubenswrapper[2566]: W0603 16:00:45.396506 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4dec6673_f563_4a55_b064_c9d3bbc75ee8.slice/crio-930049880d5129dd3d613730366aae90d7a949268bbd6cb09309f0005a8867a6 WatchSource:0}: Error finding container 930049880d5129dd3d613730366aae90d7a949268bbd6cb09309f0005a8867a6: Status 404 returned error can't find the container with id 930049880d5129dd3d613730366aae90d7a949268bbd6cb09309f0005a8867a6 Jun 03 16:00:45.421141 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:45.421119 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-547b8fbb79-rz6b6_57f7fdca-bcd1-4b39-9a48-cbeac6428d01/console/0.log" Jun 03 16:00:46.027301 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:46.027274 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-w55p5_55ee0b74-0b48-4807-b2fa-bc262b5684be/volume-data-source-validator/0.log" Jun 03 16:00:46.051611 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:46.051582 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" event={"ID":"4dec6673-f563-4a55-b064-c9d3bbc75ee8","Type":"ContainerStarted","Data":"a4887ee44ce8aa52eb1e4de7f3ac2d0770dee589d598ca5d657e93626add2160"} Jun 03 16:00:46.051611 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:46.051612 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" event={"ID":"4dec6673-f563-4a55-b064-c9d3bbc75ee8","Type":"ContainerStarted","Data":"930049880d5129dd3d613730366aae90d7a949268bbd6cb09309f0005a8867a6"} Jun 03 16:00:46.051876 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:46.051697 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:46.071859 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:46.071815 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" podStartSLOduration=2.071804829 podStartE2EDuration="2.071804829s" podCreationTimestamp="2026-06-03 16:00:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:00:46.069396253 +0000 UTC m=+1205.307143820" watchObservedRunningTime="2026-06-03 16:00:46.071804829 +0000 UTC m=+1205.309552368" Jun 03 16:00:46.851599 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:46.851569 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6jw7w_d80b1c9c-ed86-407b-a9c8-aa8ce7277222/dns/0.log" Jun 03 16:00:46.871446 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:46.871422 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6jw7w_d80b1c9c-ed86-407b-a9c8-aa8ce7277222/kube-rbac-proxy/0.log" Jun 03 16:00:47.030103 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:47.030071 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4b5p_04f1a986-af91-4f11-8331-24d0a44eed34/dns-node-resolver/0.log" Jun 03 16:00:47.709711 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:47.709678 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qr4lb_b6888c28-3ce4-430b-95d7-928a55f82992/node-ca/0.log" Jun 03 16:00:48.732684 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:48.732655 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-ndj49_ec2f2a86-1ec7-43fb-a0cd-24d72fb96f48/discovery/0.log" Jun 03 16:00:48.789432 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:48.789406 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cc4c89bc4-vq68j_027033de-70d8-4b3e-ae9a-112cac41800e/kube-auth-proxy/0.log" Jun 03 16:00:48.887923 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:48.887890 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64c87cbd65-8xckp_d10fe152-c199-408e-9552-04e3be42bb28/router/0.log" Jun 03 16:00:49.482869 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:49.482840 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hgfm9_cf2341d0-e5ac-46b5-af12-20dadc47c445/serve-healthcheck-canary/0.log" Jun 03 16:00:50.070873 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:50.070831 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l22gp_6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7/kube-rbac-proxy/0.log" Jun 03 16:00:50.102440 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:50.102412 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l22gp_6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7/exporter/0.log" Jun 03 16:00:50.126508 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:50.126461 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l22gp_6c1b4341-2c9a-474d-a1ed-bd8e533ff7b7/extractor/0.log" Jun 03 16:00:52.067214 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:52.067184 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gjb2f/perf-node-gather-daemonset-2j7wc" Jun 03 16:00:52.332306 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:52.332223 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7888f9cd56-75g2c_280c81e7-fc54-45fe-83fa-69a3d365342c/nginx/0.log" Jun 03 16:00:52.386379 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:52.386345 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-5lvh5_f655bbcb-6f30-4d7d-94ac-3c3b3322fb73/manager/0.log" Jun 03 16:00:52.429162 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:52.429134 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-6nmkc_98f57d4f-ad70-4f36-a558-c1df7e231226/manager/0.log" Jun 03 16:00:52.477620 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:52.477571 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675040-pfhmr_a9ef4479-7c67-4933-9fe7-4b0f8d630c72/cleanup/0.log" Jun 03 16:00:52.514948 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:52.514920 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d6db7cf6f-8whqc_e3def8f3-b323-409d-a0bc-87a32b0911ab/manager/0.log" Jun 03 16:00:52.638329 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:52.638263 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548f4487f9-9zbqz_ba7c3685-c450-469c-a17c-07c913c1eb01/manager/0.log" Jun 03 16:00:52.658115 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:52.658093 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-548f4487f9-9zbqz_ba7c3685-c450-469c-a17c-07c913c1eb01/copy-manifests/0.log" Jun 03 16:00:52.942619 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:52.942539 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-8nc8m_d3c168f5-04b0-44bb-b2a0-a914d65b61ea/postgres/0.log" Jun 03 16:00:54.385561 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:54.385528 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-lg2zm_637c37f5-4a78-48af-bbb8-150ab9949dd9/openshift-lws-operator/0.log" Jun 03 16:00:59.530246 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:59.530203 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-hqsgd_6589971e-9447-4d10-8242-99e9eed6d2ad/migrator/0.log" Jun 03 16:00:59.554075 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:00:59.554051 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-hqsgd_6589971e-9447-4d10-8242-99e9eed6d2ad/graceful-termination/0.log" Jun 03 16:01:01.205922 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:01:01.205886 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5qq54_65aae031-fa35-47fd-bdb3-ede2d2255c04/kube-multus/0.log" Jun 03 16:01:01.574466 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:01:01.574437 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s72xm_f83cc80e-2a78-4924-89f0-73513fdeebe7/kube-multus-additional-cni-plugins/0.log" Jun 03 16:01:01.598846 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:01:01.598818 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s72xm_f83cc80e-2a78-4924-89f0-73513fdeebe7/egress-router-binary-copy/0.log" Jun 03 16:01:01.621373 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:01:01.621347 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s72xm_f83cc80e-2a78-4924-89f0-73513fdeebe7/cni-plugins/0.log" Jun 03 16:01:01.642908 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:01:01.642864 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s72xm_f83cc80e-2a78-4924-89f0-73513fdeebe7/bond-cni-plugin/0.log" Jun 03 16:01:01.667940 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:01:01.667914 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s72xm_f83cc80e-2a78-4924-89f0-73513fdeebe7/routeoverride-cni/0.log" Jun 03 16:01:01.692652 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:01:01.692617 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s72xm_f83cc80e-2a78-4924-89f0-73513fdeebe7/whereabouts-cni-bincopy/0.log" Jun 03 16:01:01.716041 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:01:01.715990 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s72xm_f83cc80e-2a78-4924-89f0-73513fdeebe7/whereabouts-cni/0.log" Jun 03 16:01:01.810734 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:01:01.810696 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-llzgd_1c22f0a9-6788-4c37-89a6-5ab6de86ef60/network-metrics-daemon/0.log" Jun 03 16:01:01.832884 ip-10-0-139-233 kubenswrapper[2566]: I0603 16:01:01.832787 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-llzgd_1c22f0a9-6788-4c37-89a6-5ab6de86ef60/kube-rbac-proxy/0.log"