Jun 03 20:40:55.610273 ip-10-0-134-233 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 20:40:55.610287 ip-10-0-134-233 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 20:40:55.610297 ip-10-0-134-233 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 20:40:55.610508 ip-10-0-134-233 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 20:41:05.764409 ip-10-0-134-233 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 20:41:05.764430 ip-10-0-134-233 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4ecd35d00a6648ccba9bf44085e236ba -- Jun 03 20:43:35.264240 ip-10-0-134-233 systemd[1]: Starting Kubernetes Kubelet... Jun 03 20:43:35.726332 ip-10-0-134-233 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:43:35.726332 ip-10-0-134-233 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 20:43:35.726332 ip-10-0-134-233 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:43:35.726332 ip-10-0-134-233 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 20:43:35.726332 ip-10-0-134-233 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:43:35.727880 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.727787 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 20:43:35.732145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732129 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:35.732145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732144 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732148 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732151 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732154 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732159 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732164 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732167 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732170 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732173 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732175 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732178 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732181 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732184 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732186 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732189 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732191 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732194 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732197 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732199 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:35.732211 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732202 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732205 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732207 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732210 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732213 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732219 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732222 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732225 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732227 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732230 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732232 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732235 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732238 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732240 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732243 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732246 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732248 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732251 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732254 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732256 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:35.732664 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732259 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732261 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732264 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732268 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732271 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732274 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732277 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732280 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732283 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732286 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732288 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732291 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732293 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732296 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732299 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732302 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732305 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732307 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732310 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732313 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:35.733163 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732316 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732318 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732321 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732323 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732326 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732329 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732331 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732334 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732336 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732338 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732346 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732349 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732352 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732355 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732358 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732361 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732363 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732372 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732376 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:35.733643 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732378 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732381 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732384 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732387 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732389 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732392 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732394 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732398 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732401 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732404 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732407 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732410 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732412 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732415 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732417 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732420 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732422 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732425 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:35.734130 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.732427 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:35.734980 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.734967 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:35.734980 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.734979 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.734982 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.734985 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.734988 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.734990 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.734993 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.734996 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.734998 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735001 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735003 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735007 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735011 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735013 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735016 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735019 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735022 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735026 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735030 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735033 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735035 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:35.735040 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735038 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735041 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735044 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735046 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735049 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735052 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735055 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735057 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735060 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735062 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735065 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735068 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735070 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735073 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735075 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735078 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735080 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735083 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735086 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735088 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:35.735545 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735090 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735093 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735095 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735098 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735101 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735104 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735108 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735111 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735113 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735116 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735118 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735121 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735124 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735126 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735130 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735134 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735138 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735141 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735144 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:35.736065 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735147 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735150 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735153 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735156 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735158 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735161 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735164 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735166 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735169 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735171 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735174 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735176 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735179 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735181 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735184 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735187 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735189 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735192 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735195 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735198 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:35.736539 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735201 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735204 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735206 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735210 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735213 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735217 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735220 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735223 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735226 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735229 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735232 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735234 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735237 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735240 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735243 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735246 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735249 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735252 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735635 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735643 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:35.737128 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735646 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735649 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735652 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735655 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735657 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735660 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735663 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735666 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735668 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735671 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735674 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735678 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735682 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735686 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735689 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735692 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735695 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735698 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735700 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:35.737617 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735703 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735705 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735708 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735711 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735713 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735716 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735718 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735721 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735724 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735727 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735729 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735732 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735734 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735737 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735740 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735742 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735745 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735747 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735749 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735752 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:35.738145 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735755 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735757 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735760 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735762 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735766 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735769 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735772 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735775 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735777 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735792 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735796 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735799 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735802 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735804 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735807 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735810 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735813 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735815 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735818 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735820 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:35.738630 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735823 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735827 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735830 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735834 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735836 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735839 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735843 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735845 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735848 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735850 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735853 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735855 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735858 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735860 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735864 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735867 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735871 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735877 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735880 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:35.739125 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735883 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735886 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735888 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735891 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735893 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735896 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735898 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735901 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735903 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735906 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735909 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735911 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735914 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735916 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735918 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735921 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735924 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.735926 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736010 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736020 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736034 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 20:43:35.739622 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736040 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736049 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736055 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736061 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736072 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736079 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736088 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736096 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736101 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736106 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736116 2563 flags.go:64] FLAG: --cgroup-root="" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736120 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736123 2563 flags.go:64] FLAG: --client-ca-file="" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736127 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736130 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736134 2563 flags.go:64] FLAG: --cluster-domain="" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736137 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736140 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736144 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736147 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736151 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736154 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736158 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 20:43:35.740151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736161 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736164 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736167 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736170 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736173 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736176 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736180 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736183 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736187 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736189 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736192 2563 flags.go:64] FLAG: --enable-server="true" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736195 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736200 2563 flags.go:64] FLAG: --event-burst="100" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736203 2563 flags.go:64] FLAG: --event-qps="50" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736206 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736210 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736213 2563 flags.go:64] FLAG: --eviction-hard="" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736217 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736220 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736223 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736227 2563 flags.go:64] FLAG: --eviction-soft="" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736230 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736232 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736235 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736238 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 20:43:35.740697 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736241 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736244 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736247 2563 flags.go:64] FLAG: --feature-gates="" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736251 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736254 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736257 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736260 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736263 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736267 2563 flags.go:64] FLAG: --help="false" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736269 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-134-233.ec2.internal" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736273 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736276 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736279 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736282 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736285 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736288 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736291 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736294 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736297 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736299 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736302 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736305 2563 flags.go:64] FLAG: --kube-reserved="" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736308 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736311 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 20:43:35.741328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736316 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736319 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736322 2563 flags.go:64] FLAG: --lock-file="" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736325 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736328 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736331 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736336 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736339 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736342 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736345 2563 flags.go:64] FLAG: --logging-format="text" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736348 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736351 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736354 2563 flags.go:64] FLAG: --manifest-url="" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736357 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736361 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736365 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736369 2563 flags.go:64] FLAG: --max-pods="110" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736372 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736375 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736378 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736380 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736383 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736386 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736389 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736396 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 20:43:35.741925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736399 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736402 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736405 2563 flags.go:64] FLAG: --pod-cidr="" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736408 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736413 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736416 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736419 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736422 2563 flags.go:64] FLAG: --port="10250" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736428 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736431 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0de81fb03d2ca0b03" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736434 2563 flags.go:64] FLAG: --qos-reserved="" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736437 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736441 2563 flags.go:64] FLAG: --register-node="true" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736444 2563 flags.go:64] FLAG: --register-with-taints="" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736447 2563 flags.go:64] FLAG: --registry-burst="10" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736450 2563 flags.go:64] FLAG: --registry-qps="5" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736453 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736456 2563 flags.go:64] FLAG: --reserved-memory="" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736460 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736463 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736466 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736468 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736471 2563 flags.go:64] FLAG: --runonce="false" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736474 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736477 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 20:43:35.742611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736480 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736483 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736486 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736489 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736492 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736495 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736498 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736501 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736503 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736506 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736509 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736512 2563 flags.go:64] FLAG: --system-cgroups="" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736515 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736520 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736523 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736528 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736532 2563 flags.go:64] FLAG: --tls-min-version="" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736535 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736538 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736541 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736545 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736548 2563 flags.go:64] FLAG: --v="2" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736552 2563 flags.go:64] FLAG: --version="false" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736556 2563 flags.go:64] FLAG: --vmodule="" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736560 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 20:43:35.743250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.736563 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736681 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736685 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736688 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736693 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736696 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736700 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736702 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736705 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736708 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736711 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736713 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736716 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736719 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736721 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736724 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736727 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736729 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736732 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736735 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:35.743897 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736737 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736740 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736745 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736748 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736750 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736753 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736756 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736758 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736767 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736769 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736772 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736774 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736777 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736780 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736782 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736785 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736787 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736790 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736793 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736796 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:35.744417 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736799 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736801 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736804 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736807 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736809 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736812 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736815 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736817 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736820 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736823 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736826 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736828 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736832 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736836 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736842 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736845 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736847 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736851 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736853 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736856 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:35.744936 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736858 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736862 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736864 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736867 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736870 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736873 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736875 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736878 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736880 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736883 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736886 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736888 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736891 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736893 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736896 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736898 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736901 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736904 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736906 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736909 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:35.745447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736911 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736914 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736917 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736920 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736922 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736925 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736930 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736933 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736937 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736956 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736959 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736962 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736965 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736967 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736971 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736973 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736976 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736979 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:35.745952 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.736981 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.737695 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.744868 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.744883 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.744900 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.744905 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.744975 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.744981 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.744985 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.744988 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.744992 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.744994 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.744997 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745000 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745003 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:35.746391 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745006 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745008 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745011 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745014 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745017 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745020 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745022 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745025 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745027 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745030 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745033 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745036 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745038 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745045 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745049 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745051 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745054 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745057 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745059 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:35.746756 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745062 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745065 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745068 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745071 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745074 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745076 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745079 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745082 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745084 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745087 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745090 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745093 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745095 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745098 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745101 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745103 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745107 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745110 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745113 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745116 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:35.747235 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745118 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745121 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745123 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745126 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745128 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745131 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745133 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745136 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745139 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745142 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745145 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745148 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745151 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745156 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745160 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745163 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745166 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745169 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745172 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:35.747734 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745174 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745177 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745180 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745183 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745186 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745188 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745192 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745195 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745197 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745200 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745203 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745206 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745208 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745211 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745214 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745217 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745220 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745222 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745225 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745227 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:35.748213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745230 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745233 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745235 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745238 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745240 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745243 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745248 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745251 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745254 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745257 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745260 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.745265 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745378 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745382 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:35.748690 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745385 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745389 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745393 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745396 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745399 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745402 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745405 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745408 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745411 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745414 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745417 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745420 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745422 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745425 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745428 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745431 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745434 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745436 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745438 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745441 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:35.749042 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745444 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745447 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745450 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745452 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745455 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745458 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745461 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745464 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745467 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745469 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745472 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745475 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745477 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745480 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745500 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745503 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745506 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745509 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745512 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745515 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:35.749520 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745517 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745520 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745523 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745527 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745530 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745533 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745536 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745538 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745541 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745543 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745546 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745549 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745551 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745555 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745557 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745560 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745563 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745566 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745569 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745571 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:35.750074 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745574 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745577 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745580 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745582 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745584 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745587 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745590 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745592 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745595 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745597 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745600 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745603 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745605 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745608 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745610 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745613 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745615 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745618 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745620 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:35.750586 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745623 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745626 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745628 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745631 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745634 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745636 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745639 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745642 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745644 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745648 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745652 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745656 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745659 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745662 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745664 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745667 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:35.751063 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:35.745669 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:35.751442 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.745674 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:43:35.751442 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.745775 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 20:43:35.751442 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.748730 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 20:43:35.751442 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.750599 2563 server.go:1019] "Starting client certificate rotation" Jun 03 20:43:35.751442 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.750697 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 20:43:35.751442 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.750733 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 20:43:35.753856 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.753840 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 20:43:35.755328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.755309 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 20:43:35.779123 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.779099 2563 log.go:25] "Validated CRI v1 runtime API" Jun 03 20:43:35.782482 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.782460 2563 log.go:25] "Validated CRI v1 image API" Jun 03 20:43:35.783387 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.783369 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 20:43:35.788423 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.788398 2563 fs.go:135] Filesystem UUIDs: map[44641453-8e10-4cc1-aae4-25c3180cbca3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8455d422-0172-4e5f-b996-47f015facadc:/dev/nvme0n1p4] Jun 03 20:43:35.788519 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.788420 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 20:43:35.792865 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.792737 2563 manager.go:216] Machine: {Timestamp:2026-06-03 20:43:35.792245357 +0000 UTC m=+0.391124310 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3039161 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec280741cc50cb49c6267aeaaaa51847 SystemUUID:ec280741-cc50-cb49-c626-7aeaaaa51847 BootID:4ecd35d0-0a66-48cc-ba9b-f44085e236ba Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:6d:18:80:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:6d:18:80:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:47:e4:27:4a:19 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 20:43:35.792865 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.792853 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 20:43:35.793048 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.793034 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 20:43:35.796668 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.796642 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 20:43:35.796819 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.796673 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 20:43:35.797369 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.797358 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 20:43:35.797403 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.797370 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 20:43:35.797403 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.797384 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 20:43:35.797403 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.797398 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 20:43:35.798064 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.798046 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 20:43:35.798331 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.798319 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 20:43:35.801200 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.801177 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 03 20:43:35.801325 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.801315 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 20:43:35.801360 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.801346 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 03 20:43:35.801387 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.801359 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 20:43:35.801387 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.801374 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 20:43:35.801387 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.801384 2563 kubelet.go:398] "Adding apiserver pod source" Jun 03 20:43:35.801494 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.801393 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 20:43:35.801961 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.801808 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 20:43:35.802042 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.801983 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 20:43:35.805240 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.805223 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 20:43:35.807378 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.807363 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 20:43:35.807441 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.807394 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 20:43:35.809503 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809489 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 20:43:35.809575 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809509 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 20:43:35.809575 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809515 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 20:43:35.809575 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809521 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 20:43:35.809575 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809530 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 20:43:35.809575 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809537 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 20:43:35.809575 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809545 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 20:43:35.809575 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809557 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 20:43:35.809575 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809564 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 20:43:35.809575 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809570 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 20:43:35.809855 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809581 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 20:43:35.809855 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.809587 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 20:43:35.810348 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.810334 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 20:43:35.810348 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.810344 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 20:43:35.811919 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.811900 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 20:43:35.811919 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.811897 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 20:43:35.812053 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.812031 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 20:43:35.813665 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.813651 2563 server.go:1268] "Started kubelet" Jun 03 20:43:35.813750 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.813714 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 20:43:35.813812 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.813738 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 20:43:35.813935 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.813920 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 20:43:35.814574 ip-10-0-134-233 systemd[1]: Started Kubernetes Kubelet. Jun 03 20:43:35.818492 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.818462 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 20:43:35.819494 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.819471 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 03 20:43:35.821358 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.821334 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 20:43:35.824573 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.824554 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 20:43:35.824573 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.824559 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 20:43:35.824715 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.824701 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:35.825403 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825292 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 20:43:35.825403 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825307 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 20:43:35.825511 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825442 2563 factory.go:55] Registering systemd factory Jun 03 20:43:35.825511 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825455 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 03 20:43:35.825511 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825466 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 03 20:43:35.825511 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825474 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 20:43:35.825511 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825459 2563 factory.go:223] Registration of the systemd container factory successfully Jun 03 20:43:35.825860 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825807 2563 factory.go:153] Registering CRI-O factory Jun 03 20:43:35.825860 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825822 2563 factory.go:223] Registration of the crio container factory successfully Jun 03 20:43:35.825860 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825846 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7fmdx" Jun 03 20:43:35.826027 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825866 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 20:43:35.826027 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825893 2563 factory.go:103] Registering Raw factory Jun 03 20:43:35.826027 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.825909 2563 manager.go:1196] Started watching for new ooms in manager Jun 03 20:43:35.826356 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.826339 2563 manager.go:349] Starting recovery of all containers Jun 03 20:43:35.833515 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.833481 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7fmdx" Jun 03 20:43:35.833795 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.833758 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 20:43:35.833954 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.833921 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 20:43:35.834861 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.833760 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-233.ec2.internal.18b5acf99f41ba2c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-233.ec2.internal,UID:ip-10-0-134-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-233.ec2.internal,},FirstTimestamp:2026-06-03 20:43:35.81361822 +0000 UTC m=+0.412497175,LastTimestamp:2026-06-03 20:43:35.81361822 +0000 UTC m=+0.412497175,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-233.ec2.internal,}" Jun 03 20:43:35.835237 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.835214 2563 manager.go:354] Recovery completed Jun 03 20:43:35.836791 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.836768 2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 03 20:43:35.839529 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.839517 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:35.841472 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.841458 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:35.841529 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.841484 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:35.841529 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.841494 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:35.842036 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.842019 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 20:43:35.842036 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.842034 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 20:43:35.842163 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.842052 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 03 20:43:35.842163 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.842060 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:35.843136 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.843117 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:35.843208 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.843140 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:35.843208 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.843150 2563 policy_none.go:49] "None policy: Start" Jun 03 20:43:35.843208 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.843165 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 20:43:35.843208 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.843181 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 20:43:35.843208 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.843152 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-233.ec2.internal.18b5acf9a0eabb02 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-233.ec2.internal,UID:ip-10-0-134-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-233.ec2.internal,},FirstTimestamp:2026-06-03 20:43:35.841471234 +0000 UTC m=+0.440350188,LastTimestamp:2026-06-03 20:43:35.841471234 +0000 UTC m=+0.440350188,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-233.ec2.internal,}" Jun 03 20:43:35.843430 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.843154 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:35.844195 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.844183 2563 policy_none.go:47] "Start" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.884998 2563 manager.go:337] "Starting Device Plugin manager" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.885029 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.885039 2563 server.go:87] "Starting device plugin registration server" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.885282 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.885295 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.885426 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.885504 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.885513 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.886515 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.886564 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.897924 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.899158 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.899193 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.899214 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.899246 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 20:43:35.902210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.901664 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:35.985876 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.985796 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:35.987024 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.987006 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:35.987125 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.987037 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:35.987125 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.987047 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:35.987125 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.987076 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-233.ec2.internal" Jun 03 20:43:35.995692 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.995668 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-233.ec2.internal" Jun 03 20:43:35.995692 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:35.995695 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-233.ec2.internal\": node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:35.999880 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.999861 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal"] Jun 03 20:43:35.999995 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:35.999915 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:36.000726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.000712 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:36.000785 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.000740 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:36.000785 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.000756 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:36.002045 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.002032 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:36.002158 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.002142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.002209 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.002188 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:36.002879 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.002866 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:36.002957 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.002886 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:36.002957 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.002895 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:36.002957 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.002907 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:36.002957 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.002926 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:36.002957 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.002937 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:36.004115 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.004101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.004165 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.004126 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:36.004816 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.004795 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:36.004882 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.004832 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:36.004882 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.004846 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:36.008806 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.008789 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:36.036694 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.036670 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-233.ec2.internal\" not found" node="ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.041022 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.041008 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-233.ec2.internal\" not found" node="ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.109782 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.109755 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:36.126853 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.126832 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d82e29907a2bf8a0d636ac0d1fc5392d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"d82e29907a2bf8a0d636ac0d1fc5392d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.126918 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.126861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d82e29907a2bf8a0d636ac0d1fc5392d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"d82e29907a2bf8a0d636ac0d1fc5392d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.126918 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.126879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63aad158be7a52985bc7aa2bdf4ecbef-config\") pod \"kube-apiserver-proxy-ip-10-0-134-233.ec2.internal\" (UID: \"63aad158be7a52985bc7aa2bdf4ecbef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.210678 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.210649 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:36.228023 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.227988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d82e29907a2bf8a0d636ac0d1fc5392d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"d82e29907a2bf8a0d636ac0d1fc5392d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.228086 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.228031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d82e29907a2bf8a0d636ac0d1fc5392d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"d82e29907a2bf8a0d636ac0d1fc5392d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.228086 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.228055 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63aad158be7a52985bc7aa2bdf4ecbef-config\") pod \"kube-apiserver-proxy-ip-10-0-134-233.ec2.internal\" (UID: \"63aad158be7a52985bc7aa2bdf4ecbef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.228147 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.228094 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63aad158be7a52985bc7aa2bdf4ecbef-config\") pod \"kube-apiserver-proxy-ip-10-0-134-233.ec2.internal\" (UID: \"63aad158be7a52985bc7aa2bdf4ecbef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.228147 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.228098 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d82e29907a2bf8a0d636ac0d1fc5392d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"d82e29907a2bf8a0d636ac0d1fc5392d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.228147 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.228111 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d82e29907a2bf8a0d636ac0d1fc5392d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"d82e29907a2bf8a0d636ac0d1fc5392d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.311443 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.311412 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:36.339872 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.339836 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.345488 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.345462 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" Jun 03 20:43:36.411894 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.411856 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:36.512462 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.512422 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:36.613003 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.612908 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:36.667117 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.667091 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:36.713504 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.713469 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:36.749971 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.749929 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 20:43:36.750508 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.750083 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 20:43:36.750508 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.750143 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 20:43:36.814056 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.814027 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:36.837398 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.837354 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 20:38:35 +0000 UTC" deadline="2028-01-17 13:58:21.982893493 +0000 UTC" Jun 03 20:43:36.837398 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.837391 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14225h14m45.145505709s" Jun 03 20:43:36.863350 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:36.863287 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82e29907a2bf8a0d636ac0d1fc5392d.slice/crio-d885427327ea91648919019928decce017d289ce91ee2201a6ba602f9e24f41b WatchSource:0}: Error finding container d885427327ea91648919019928decce017d289ce91ee2201a6ba602f9e24f41b: Status 404 returned error can't find the container with id d885427327ea91648919019928decce017d289ce91ee2201a6ba602f9e24f41b Jun 03 20:43:36.863720 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:36.863693 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63aad158be7a52985bc7aa2bdf4ecbef.slice/crio-a0c49517e87d011648c745ed738a62665542eac8ba83dcc1c9379c852b0d4527 WatchSource:0}: Error finding container a0c49517e87d011648c745ed738a62665542eac8ba83dcc1c9379c852b0d4527: Status 404 returned error can't find the container with id a0c49517e87d011648c745ed738a62665542eac8ba83dcc1c9379c852b0d4527 Jun 03 20:43:36.864958 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.864929 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:36.869053 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.869037 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:43:36.902560 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.902508 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" event={"ID":"d82e29907a2bf8a0d636ac0d1fc5392d","Type":"ContainerStarted","Data":"d885427327ea91648919019928decce017d289ce91ee2201a6ba602f9e24f41b"} Jun 03 20:43:36.903523 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:36.903500 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" event={"ID":"63aad158be7a52985bc7aa2bdf4ecbef","Type":"ContainerStarted","Data":"a0c49517e87d011648c745ed738a62665542eac8ba83dcc1c9379c852b0d4527"} Jun 03 20:43:36.914664 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:36.914640 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found" Jun 03 20:43:37.005762 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.005731 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:37.025770 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.025748 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" Jun 03 20:43:37.039458 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.039438 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 20:43:37.040357 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.040345 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" Jun 03 20:43:37.049487 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.049472 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 20:43:37.802657 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.802625 2563 apiserver.go:52] "Watching apiserver" Jun 03 20:43:37.811498 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.811477 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 20:43:37.812762 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.812737 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-c4cnh","kube-system/konnectivity-agent-lf7rr","kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hzvvz","openshift-dns/node-resolver-hvb8z","openshift-image-registry/node-ca-g7wxk","openshift-network-operator/iptables-alerter-qrwxg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal","openshift-multus/multus-additional-cni-plugins-vh628","openshift-multus/multus-j9vx5","openshift-multus/network-metrics-daemon-cjp9g","openshift-network-diagnostics/network-check-target-brbhj","openshift-ovn-kubernetes/ovnkube-node-2q5hl"] Jun 03 20:43:37.814455 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.814428 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.815495 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.815472 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrwxg" Jun 03 20:43:37.817370 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.817348 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:43:37.817539 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.817523 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 20:43:37.818072 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.818029 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:43:37.818072 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.818053 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hgmjt\"" Jun 03 20:43:37.818273 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.818110 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 20:43:37.818273 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.818172 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2k7cc\"" Jun 03 20:43:37.818382 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.818321 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 20:43:37.818527 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.818512 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:43:37.818727 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.818696 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hvb8z" Jun 03 20:43:37.819934 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.819446 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 20:43:37.819934 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.819792 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ggq4d\"" Jun 03 20:43:37.820451 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.820174 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g7wxk" Jun 03 20:43:37.820724 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.820705 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 20:43:37.820990 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.820971 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 20:43:37.820990 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.820986 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 20:43:37.821341 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.821324 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wwzjz\"" Jun 03 20:43:37.821923 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.821907 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:37.822025 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:37.821988 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:37.822495 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.822475 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 20:43:37.822594 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.822568 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 20:43:37.822968 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.822760 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 20:43:37.822968 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.822849 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nnm7m\"" Jun 03 20:43:37.823234 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.823219 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.824641 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.824622 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.825352 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.825334 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 20:43:37.826156 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.826026 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.826964 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.826914 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2jgl4\"" Jun 03 20:43:37.826964 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.826955 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 20:43:37.827269 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.827251 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 20:43:37.827269 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.827268 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 20:43:37.827401 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.827300 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 20:43:37.827663 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.827624 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:37.827763 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:37.827694 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:37.827763 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.827627 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 20:43:37.827763 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.827750 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 20:43:37.828339 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.828011 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 20:43:37.828339 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.828044 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-crk9d\"" Jun 03 20:43:37.828339 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.828100 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 20:43:37.828339 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.828271 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 20:43:37.829754 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.828972 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qckfb\"" Jun 03 20:43:37.831965 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.831276 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:37.831965 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:37.831388 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:37.834598 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.834530 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.837050 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837029 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 20:43:37.837141 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837103 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837308 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75da9761-a791-43a6-9b2a-5c4541f0b947-konnectivity-ca\") pod \"konnectivity-agent-lf7rr\" (UID: \"75da9761-a791-43a6-9b2a-5c4541f0b947\") " pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b3c760f9-ef51-42cc-b57a-a945396666df-kubelet-config\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-system-cni-dir\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/986fede1-39d0-4a43-8526-bcb2bd8f28e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837428 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837430 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-device-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-sys-fs\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-cni-dir\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837507 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9j6ks\"" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-var-lib-cni-multus\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-sys\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837577 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/986fede1-39d0-4a43-8526-bcb2bd8f28e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-modprobe-d\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-host\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837605 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 20:43:37.837769 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf7h7\" (UniqueName: \"kubernetes.io/projected/4381bffc-e0ab-444d-a052-3972c1a0dbbd-kube-api-access-vf7h7\") pod \"node-resolver-hvb8z\" (UID: \"4381bffc-e0ab-444d-a052-3972c1a0dbbd\") " pod="openshift-dns/node-resolver-hvb8z" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837662 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f52cd91a-765c-4427-81c7-caa38584c1b6-serviceca\") pod \"node-ca-g7wxk\" (UID: \"f52cd91a-765c-4427-81c7-caa38584c1b6\") " pod="openshift-image-registry/node-ca-g7wxk" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837686 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-sysctl-d\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-system-cni-dir\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-etc-kubernetes\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837794 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-socket-dir-parent\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837818 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-var-lib-kubelet\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-conf-dir\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837892 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-registration-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-lib-modules\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75da9761-a791-43a6-9b2a-5c4541f0b947-agent-certs\") pod \"konnectivity-agent-lf7rr\" (UID: \"75da9761-a791-43a6-9b2a-5c4541f0b947\") " pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7663897a-c35c-4e7e-bbb7-1b7956d2ddb0-host-slash\") pod \"iptables-alerter-qrwxg\" (UID: \"7663897a-c35c-4e7e-bbb7-1b7956d2ddb0\") " pod="openshift-network-operator/iptables-alerter-qrwxg" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4779\" (UniqueName: \"kubernetes.io/projected/7663897a-c35c-4e7e-bbb7-1b7956d2ddb0-kube-api-access-z4779\") pod \"iptables-alerter-qrwxg\" (UID: \"7663897a-c35c-4e7e-bbb7-1b7956d2ddb0\") " pod="openshift-network-operator/iptables-alerter-qrwxg" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.837997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-os-release\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a33e93-f74e-4aa7-85e6-301bc4355b16-cni-binary-copy\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.838670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4381bffc-e0ab-444d-a052-3972c1a0dbbd-hosts-file\") pod \"node-resolver-hvb8z\" (UID: \"4381bffc-e0ab-444d-a052-3972c1a0dbbd\") " pod="openshift-dns/node-resolver-hvb8z" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-socket-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-kubernetes\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f5b8399-e2c0-4c85-97d2-540925882e3d-tmp\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838135 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4381bffc-e0ab-444d-a052-3972c1a0dbbd-tmp-dir\") pod \"node-resolver-hvb8z\" (UID: \"4381bffc-e0ab-444d-a052-3972c1a0dbbd\") " pod="openshift-dns/node-resolver-hvb8z" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvvjh\" (UniqueName: \"kubernetes.io/projected/5f96139a-8f36-4f22-a932-dc461fa90edc-kube-api-access-zvvjh\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7663897a-c35c-4e7e-bbb7-1b7956d2ddb0-iptables-alerter-script\") pod \"iptables-alerter-qrwxg\" (UID: \"7663897a-c35c-4e7e-bbb7-1b7956d2ddb0\") " pod="openshift-network-operator/iptables-alerter-qrwxg" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khrmc\" (UniqueName: \"kubernetes.io/projected/48a33e93-f74e-4aa7-85e6-301bc4355b16-kube-api-access-khrmc\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-cnibin\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838338 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838384 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/986fede1-39d0-4a43-8526-bcb2bd8f28e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-run-k8s-cni-cncf-io\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838452 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-systemd\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838484 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-tuned\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838498 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b3c760f9-ef51-42cc-b57a-a945396666df-dbus\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838576 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 20:43:37.839288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-daemon-config\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838678 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxrdl\" (UniqueName: \"kubernetes.io/projected/986fede1-39d0-4a43-8526-bcb2bd8f28e9-kube-api-access-zxrdl\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-sysconfig\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-sysctl-conf\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-cnibin\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-var-lib-cni-bin\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f52cd91a-765c-4427-81c7-caa38584c1b6-host\") pod \"node-ca-g7wxk\" (UID: \"f52cd91a-765c-4427-81c7-caa38584c1b6\") " pod="openshift-image-registry/node-ca-g7wxk" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffgwr\" (UniqueName: \"kubernetes.io/projected/f52cd91a-765c-4427-81c7-caa38584c1b6-kube-api-access-ffgwr\") pod \"node-ca-g7wxk\" (UID: \"f52cd91a-765c-4427-81c7-caa38584c1b6\") " pod="openshift-image-registry/node-ca-g7wxk" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-var-lib-kubelet\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-os-release\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.838965 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-run-netns\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.839002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-run-multus-certs\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.839028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-run\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.839050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb8fb\" (UniqueName: \"kubernetes.io/projected/0f5b8399-e2c0-4c85-97d2-540925882e3d-kube-api-access-gb8fb\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.839960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.839073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-hostroot\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.860062 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.860042 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z2776" Jun 03 20:43:37.871067 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.871017 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z2776" Jun 03 20:43:37.926773 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.926582 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 20:43:37.939686 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb8fb\" (UniqueName: \"kubernetes.io/projected/0f5b8399-e2c0-4c85-97d2-540925882e3d-kube-api-access-gb8fb\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.939686 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-hostroot\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.939893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgfkv\" (UniqueName: \"kubernetes.io/projected/a4d60725-a1d1-401e-a46c-d2d874ec1693-kube-api-access-fgfkv\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:37.939893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939770 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-var-lib-openvswitch\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.939893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939792 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-ovn-node-metrics-cert\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.939893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6w8s\" (UniqueName: \"kubernetes.io/projected/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-kube-api-access-l6w8s\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.939893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939833 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75da9761-a791-43a6-9b2a-5c4541f0b947-konnectivity-ca\") pod \"konnectivity-agent-lf7rr\" (UID: \"75da9761-a791-43a6-9b2a-5c4541f0b947\") " pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:43:37.939893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b3c760f9-ef51-42cc-b57a-a945396666df-kubelet-config\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:37.939893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939813 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-hostroot\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939989 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b3c760f9-ef51-42cc-b57a-a945396666df-kubelet-config\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.939917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-system-cni-dir\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:37.940025 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/986fede1-39d0-4a43-8526-bcb2bd8f28e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940119 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-system-cni-dir\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:37.940133 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret podName:b3c760f9-ef51-42cc-b57a-a945396666df nodeName:}" failed. No retries permitted until 2026-06-03 20:43:38.440095319 +0000 UTC m=+3.038974265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret") pod "global-pull-secret-syncer-c4cnh" (UID: "b3c760f9-ef51-42cc-b57a-a945396666df") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng9fz\" (UniqueName: \"kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz\") pod \"network-check-target-brbhj\" (UID: \"4f123adb-d60e-449f-b868-db33d2c1ae6a\") " pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940215 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-device-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-sys-fs\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940302 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-cni-dir\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-var-lib-cni-multus\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940344 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-device-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.940368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940374 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-sys-fs\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940376 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-run-ovn-kubernetes\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-sys\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940422 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-var-lib-cni-multus\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940411 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75da9761-a791-43a6-9b2a-5c4541f0b947-konnectivity-ca\") pod \"konnectivity-agent-lf7rr\" (UID: \"75da9761-a791-43a6-9b2a-5c4541f0b947\") " pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940436 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-cni-dir\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/986fede1-39d0-4a43-8526-bcb2bd8f28e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-ovnkube-config\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-sys\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-modprobe-d\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-host\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-host\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-slash\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-run-systemd\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940762 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-modprobe-d\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-log-socket\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/986fede1-39d0-4a43-8526-bcb2bd8f28e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.941137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940808 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf7h7\" (UniqueName: \"kubernetes.io/projected/4381bffc-e0ab-444d-a052-3972c1a0dbbd-kube-api-access-vf7h7\") pod \"node-resolver-hvb8z\" (UID: \"4381bffc-e0ab-444d-a052-3972c1a0dbbd\") " pod="openshift-dns/node-resolver-hvb8z" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f52cd91a-765c-4427-81c7-caa38584c1b6-serviceca\") pod \"node-ca-g7wxk\" (UID: \"f52cd91a-765c-4427-81c7-caa38584c1b6\") " pod="openshift-image-registry/node-ca-g7wxk" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.940957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-sysctl-d\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941059 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/986fede1-39d0-4a43-8526-bcb2bd8f28e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-system-cni-dir\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-etc-kubernetes\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-run-netns\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941167 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-system-cni-dir\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-ovnkube-script-lib\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941191 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-etc-kubernetes\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941154 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-sysctl-d\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-socket-dir-parent\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-var-lib-kubelet\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-conf-dir\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941355 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-var-lib-kubelet\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941384 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f52cd91a-765c-4427-81c7-caa38584c1b6-serviceca\") pod \"node-ca-g7wxk\" (UID: \"f52cd91a-765c-4427-81c7-caa38584c1b6\") " pod="openshift-image-registry/node-ca-g7wxk" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-socket-dir-parent\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.941822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941404 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-conf-dir\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-run-openvswitch\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941424 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-registration-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-lib-modules\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941490 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-registration-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-env-overrides\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75da9761-a791-43a6-9b2a-5c4541f0b947-agent-certs\") pod \"konnectivity-agent-lf7rr\" (UID: \"75da9761-a791-43a6-9b2a-5c4541f0b947\") " pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941561 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7663897a-c35c-4e7e-bbb7-1b7956d2ddb0-host-slash\") pod \"iptables-alerter-qrwxg\" (UID: \"7663897a-c35c-4e7e-bbb7-1b7956d2ddb0\") " pod="openshift-network-operator/iptables-alerter-qrwxg" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4779\" (UniqueName: \"kubernetes.io/projected/7663897a-c35c-4e7e-bbb7-1b7956d2ddb0-kube-api-access-z4779\") pod \"iptables-alerter-qrwxg\" (UID: \"7663897a-c35c-4e7e-bbb7-1b7956d2ddb0\") " pod="openshift-network-operator/iptables-alerter-qrwxg" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941593 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-lib-modules\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941629 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7663897a-c35c-4e7e-bbb7-1b7956d2ddb0-host-slash\") pod \"iptables-alerter-qrwxg\" (UID: \"7663897a-c35c-4e7e-bbb7-1b7956d2ddb0\") " pod="openshift-network-operator/iptables-alerter-qrwxg" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941896 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941960 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-os-release\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.941603 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-os-release\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a33e93-f74e-4aa7-85e6-301bc4355b16-cni-binary-copy\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942086 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4381bffc-e0ab-444d-a052-3972c1a0dbbd-hosts-file\") pod \"node-resolver-hvb8z\" (UID: \"4381bffc-e0ab-444d-a052-3972c1a0dbbd\") " pod="openshift-dns/node-resolver-hvb8z" Jun 03 20:43:37.942630 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942109 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-socket-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942184 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4381bffc-e0ab-444d-a052-3972c1a0dbbd-hosts-file\") pod \"node-resolver-hvb8z\" (UID: \"4381bffc-e0ab-444d-a052-3972c1a0dbbd\") " pod="openshift-dns/node-resolver-hvb8z" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942230 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-socket-dir\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942339 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f96139a-8f36-4f22-a932-dc461fa90edc-etc-selinux\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942347 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-kubernetes\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942386 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-kubernetes\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f5b8399-e2c0-4c85-97d2-540925882e3d-tmp\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-kubelet\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-systemd-units\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4381bffc-e0ab-444d-a052-3972c1a0dbbd-tmp-dir\") pod \"node-resolver-hvb8z\" (UID: \"4381bffc-e0ab-444d-a052-3972c1a0dbbd\") " pod="openshift-dns/node-resolver-hvb8z" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvjh\" (UniqueName: \"kubernetes.io/projected/5f96139a-8f36-4f22-a932-dc461fa90edc-kube-api-access-zvvjh\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942525 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7663897a-c35c-4e7e-bbb7-1b7956d2ddb0-iptables-alerter-script\") pod \"iptables-alerter-qrwxg\" (UID: \"7663897a-c35c-4e7e-bbb7-1b7956d2ddb0\") " pod="openshift-network-operator/iptables-alerter-qrwxg" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942552 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khrmc\" (UniqueName: \"kubernetes.io/projected/48a33e93-f74e-4aa7-85e6-301bc4355b16-kube-api-access-khrmc\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-run-ovn\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-cni-bin\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.943461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a33e93-f74e-4aa7-85e6-301bc4355b16-cni-binary-copy\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942663 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-cnibin\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/986fede1-39d0-4a43-8526-bcb2bd8f28e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-run-k8s-cni-cncf-io\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-systemd\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-tuned\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b3c760f9-ef51-42cc-b57a-a945396666df-dbus\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942802 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/986fede1-39d0-4a43-8526-bcb2bd8f28e9-cnibin\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942816 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-daemon-config\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-cni-netd\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxrdl\" (UniqueName: \"kubernetes.io/projected/986fede1-39d0-4a43-8526-bcb2bd8f28e9-kube-api-access-zxrdl\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942914 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-sysconfig\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.942988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-sysctl-conf\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943012 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-cnibin\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-var-lib-cni-bin\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f52cd91a-765c-4427-81c7-caa38584c1b6-host\") pod \"node-ca-g7wxk\" (UID: \"f52cd91a-765c-4427-81c7-caa38584c1b6\") " pod="openshift-image-registry/node-ca-g7wxk" Jun 03 20:43:37.944274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943086 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffgwr\" (UniqueName: \"kubernetes.io/projected/f52cd91a-765c-4427-81c7-caa38584c1b6-kube-api-access-ffgwr\") pod \"node-ca-g7wxk\" (UID: \"f52cd91a-765c-4427-81c7-caa38584c1b6\") " pod="openshift-image-registry/node-ca-g7wxk" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943109 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-var-lib-kubelet\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-os-release\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943153 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-run-netns\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-run-multus-certs\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-etc-openvswitch\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943212 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7663897a-c35c-4e7e-bbb7-1b7956d2ddb0-iptables-alerter-script\") pod \"iptables-alerter-qrwxg\" (UID: \"7663897a-c35c-4e7e-bbb7-1b7956d2ddb0\") " pod="openshift-network-operator/iptables-alerter-qrwxg" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-node-log\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-run\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943288 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/986fede1-39d0-4a43-8526-bcb2bd8f28e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943305 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-var-lib-cni-bin\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943337 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-run-k8s-cni-cncf-io\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943362 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48a33e93-f74e-4aa7-85e6-301bc4355b16-multus-daemon-config\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943360 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-systemd\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-run\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943403 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f52cd91a-765c-4427-81c7-caa38584c1b6-host\") pod \"node-ca-g7wxk\" (UID: \"f52cd91a-765c-4427-81c7-caa38584c1b6\") " pod="openshift-image-registry/node-ca-g7wxk" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-run-netns\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943460 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b3c760f9-ef51-42cc-b57a-a945396666df-dbus\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:37.945091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943510 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-var-lib-kubelet\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.945887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-sysconfig\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.945887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943568 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-cnibin\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.945887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-os-release\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.945887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943606 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48a33e93-f74e-4aa7-85e6-301bc4355b16-host-run-multus-certs\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.945887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943624 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-sysctl-conf\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.945887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.943938 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4381bffc-e0ab-444d-a052-3972c1a0dbbd-tmp-dir\") pod \"node-resolver-hvb8z\" (UID: \"4381bffc-e0ab-444d-a052-3972c1a0dbbd\") " pod="openshift-dns/node-resolver-hvb8z" Jun 03 20:43:37.945887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.945397 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f5b8399-e2c0-4c85-97d2-540925882e3d-etc-tuned\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.945887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.945585 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75da9761-a791-43a6-9b2a-5c4541f0b947-agent-certs\") pod \"konnectivity-agent-lf7rr\" (UID: \"75da9761-a791-43a6-9b2a-5c4541f0b947\") " pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:43:37.945887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.945647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f5b8399-e2c0-4c85-97d2-540925882e3d-tmp\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.953964 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.953837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf7h7\" (UniqueName: \"kubernetes.io/projected/4381bffc-e0ab-444d-a052-3972c1a0dbbd-kube-api-access-vf7h7\") pod \"node-resolver-hvb8z\" (UID: \"4381bffc-e0ab-444d-a052-3972c1a0dbbd\") " pod="openshift-dns/node-resolver-hvb8z" Jun 03 20:43:37.955225 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.955176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb8fb\" (UniqueName: \"kubernetes.io/projected/0f5b8399-e2c0-4c85-97d2-540925882e3d-kube-api-access-gb8fb\") pod \"tuned-hzvvz\" (UID: \"0f5b8399-e2c0-4c85-97d2-540925882e3d\") " pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:37.956565 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.956387 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khrmc\" (UniqueName: \"kubernetes.io/projected/48a33e93-f74e-4aa7-85e6-301bc4355b16-kube-api-access-khrmc\") pod \"multus-j9vx5\" (UID: \"48a33e93-f74e-4aa7-85e6-301bc4355b16\") " pod="openshift-multus/multus-j9vx5" Jun 03 20:43:37.956565 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.956403 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvvjh\" (UniqueName: \"kubernetes.io/projected/5f96139a-8f36-4f22-a932-dc461fa90edc-kube-api-access-zvvjh\") pod \"aws-ebs-csi-driver-node-rcphb\" (UID: \"5f96139a-8f36-4f22-a932-dc461fa90edc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:37.956736 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.956708 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffgwr\" (UniqueName: \"kubernetes.io/projected/f52cd91a-765c-4427-81c7-caa38584c1b6-kube-api-access-ffgwr\") pod \"node-ca-g7wxk\" (UID: \"f52cd91a-765c-4427-81c7-caa38584c1b6\") " pod="openshift-image-registry/node-ca-g7wxk" Jun 03 20:43:37.957349 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.957328 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4779\" (UniqueName: \"kubernetes.io/projected/7663897a-c35c-4e7e-bbb7-1b7956d2ddb0-kube-api-access-z4779\") pod \"iptables-alerter-qrwxg\" (UID: \"7663897a-c35c-4e7e-bbb7-1b7956d2ddb0\") " pod="openshift-network-operator/iptables-alerter-qrwxg" Jun 03 20:43:37.957448 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:37.957353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxrdl\" (UniqueName: \"kubernetes.io/projected/986fede1-39d0-4a43-8526-bcb2bd8f28e9-kube-api-access-zxrdl\") pod \"multus-additional-cni-plugins-vh628\" (UID: \"986fede1-39d0-4a43-8526-bcb2bd8f28e9\") " pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:38.043915 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.043879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-etc-openvswitch\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.043915 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.043918 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-node-log\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044148 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.043959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgfkv\" (UniqueName: \"kubernetes.io/projected/a4d60725-a1d1-401e-a46c-d2d874ec1693-kube-api-access-fgfkv\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:38.044148 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.043980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-var-lib-openvswitch\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044148 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-ovn-node-metrics-cert\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044148 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-etc-openvswitch\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044148 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6w8s\" (UniqueName: \"kubernetes.io/projected/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-kube-api-access-l6w8s\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044148 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044005 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-node-log\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044148 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044040 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-var-lib-openvswitch\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044148 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9fz\" (UniqueName: \"kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz\") pod \"network-check-target-brbhj\" (UID: \"4f123adb-d60e-449f-b868-db33d2c1ae6a\") " pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:38.044148 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-run-ovn-kubernetes\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-ovnkube-config\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-slash\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044186 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-run-ovn-kubernetes\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-run-systemd\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-log-socket\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044260 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-slash\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044265 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-run-systemd\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-run-netns\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044305 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-log-socket\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-ovnkube-script-lib\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044342 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-run-netns\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-run-openvswitch\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044377 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-run-openvswitch\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-env-overrides\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-kubelet\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-systemd-units\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-run-ovn\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.044617 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044493 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-cni-bin\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-run-ovn\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-cni-netd\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044563 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-systemd-units\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044494 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-kubelet\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044604 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-cni-bin\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044670 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-host-cni-netd\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.044692 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044724 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-ovnkube-config\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.044755 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs podName:a4d60725-a1d1-401e-a46c-d2d874ec1693 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:38.544737379 +0000 UTC m=+3.143616324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs") pod "network-metrics-daemon-cjp9g" (UID: "a4d60725-a1d1-401e-a46c-d2d874ec1693") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044780 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-env-overrides\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.045364 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.044876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-ovnkube-script-lib\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.046703 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.046682 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-ovn-node-metrics-cert\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.056982 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.056886 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:38.056982 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.056913 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:38.056982 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.056927 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ng9fz for pod openshift-network-diagnostics/network-check-target-brbhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:38.057157 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.057013 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz podName:4f123adb-d60e-449f-b868-db33d2c1ae6a nodeName:}" failed. No retries permitted until 2026-06-03 20:43:38.556996453 +0000 UTC m=+3.155875408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ng9fz" (UniqueName: "kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz") pod "network-check-target-brbhj" (UID: "4f123adb-d60e-449f-b868-db33d2c1ae6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:38.058045 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.058022 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6w8s\" (UniqueName: \"kubernetes.io/projected/59bc0c3d-d465-4c83-b500-d3c76c6aaeea-kube-api-access-l6w8s\") pod \"ovnkube-node-2q5hl\" (UID: \"59bc0c3d-d465-4c83-b500-d3c76c6aaeea\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.059347 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.059326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgfkv\" (UniqueName: \"kubernetes.io/projected/a4d60725-a1d1-401e-a46c-d2d874ec1693-kube-api-access-fgfkv\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:38.127835 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.127794 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" Jun 03 20:43:38.138652 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.138626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrwxg" Jun 03 20:43:38.147545 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.147523 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:43:38.151842 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.151823 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hvb8z" Jun 03 20:43:38.158655 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.158636 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g7wxk" Jun 03 20:43:38.165661 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.165638 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" Jun 03 20:43:38.170801 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.170781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vh628" Jun 03 20:43:38.179129 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.179104 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9vx5" Jun 03 20:43:38.184328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.184306 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:43:38.219474 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.219441 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:38.447164 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.447077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:38.447322 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.447253 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:38.447382 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.447332 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret podName:b3c760f9-ef51-42cc-b57a-a945396666df nodeName:}" failed. No retries permitted until 2026-06-03 20:43:39.447311011 +0000 UTC m=+4.046189970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret") pod "global-pull-secret-syncer-c4cnh" (UID: "b3c760f9-ef51-42cc-b57a-a945396666df") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:38.547891 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.547861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:38.548047 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.548017 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:38.548112 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.548084 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs podName:a4d60725-a1d1-401e-a46c-d2d874ec1693 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:39.548064428 +0000 UTC m=+4.146943389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs") pod "network-metrics-daemon-cjp9g" (UID: "a4d60725-a1d1-401e-a46c-d2d874ec1693") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:38.648552 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.648522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9fz\" (UniqueName: \"kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz\") pod \"network-check-target-brbhj\" (UID: \"4f123adb-d60e-449f-b868-db33d2c1ae6a\") " pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:38.648738 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.648668 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:38.648738 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.648689 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:38.648738 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.648699 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ng9fz for pod openshift-network-diagnostics/network-check-target-brbhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:38.648894 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.648764 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz podName:4f123adb-d60e-449f-b868-db33d2c1ae6a nodeName:}" failed. No retries permitted until 2026-06-03 20:43:39.648747236 +0000 UTC m=+4.247626176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng9fz" (UniqueName: "kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz") pod "network-check-target-brbhj" (UID: "4f123adb-d60e-449f-b868-db33d2c1ae6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:38.768510 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:38.768476 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4381bffc_e0ab_444d_a052_3972c1a0dbbd.slice/crio-f6ce043882ca08cbc7dc8ff03877a86173730cd451ef28d3490e34312fa1dcda WatchSource:0}: Error finding container f6ce043882ca08cbc7dc8ff03877a86173730cd451ef28d3490e34312fa1dcda: Status 404 returned error can't find the container with id f6ce043882ca08cbc7dc8ff03877a86173730cd451ef28d3490e34312fa1dcda Jun 03 20:43:38.769802 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:38.769777 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a33e93_f74e_4aa7_85e6_301bc4355b16.slice/crio-9fc718a8bec4b9ab57357ed320f00a76c1f190160fc4b56fd82d45ad39b716ea WatchSource:0}: Error finding container 9fc718a8bec4b9ab57357ed320f00a76c1f190160fc4b56fd82d45ad39b716ea: Status 404 returned error can't find the container with id 9fc718a8bec4b9ab57357ed320f00a76c1f190160fc4b56fd82d45ad39b716ea Jun 03 20:43:38.770447 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:38.770426 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5b8399_e2c0_4c85_97d2_540925882e3d.slice/crio-a53cd74da2e7d7aaa23c53bd073d09fca63c98b3b96300c41ef7f2ca28ef667a WatchSource:0}: Error finding container a53cd74da2e7d7aaa23c53bd073d09fca63c98b3b96300c41ef7f2ca28ef667a: Status 404 returned error can't find the container with id a53cd74da2e7d7aaa23c53bd073d09fca63c98b3b96300c41ef7f2ca28ef667a Jun 03 20:43:38.771684 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:38.771651 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7663897a_c35c_4e7e_bbb7_1b7956d2ddb0.slice/crio-3837e6e201463a1e753b010816a300d5fae4e666c6478ad0ed60cd43c638bad6 WatchSource:0}: Error finding container 3837e6e201463a1e753b010816a300d5fae4e666c6478ad0ed60cd43c638bad6: Status 404 returned error can't find the container with id 3837e6e201463a1e753b010816a300d5fae4e666c6478ad0ed60cd43c638bad6 Jun 03 20:43:38.773894 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:38.773836 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59bc0c3d_d465_4c83_b500_d3c76c6aaeea.slice/crio-1da38ce3cc358ee6439de1cab019239a6c3d1c6e750313164b8304c62ed4731f WatchSource:0}: Error finding container 1da38ce3cc358ee6439de1cab019239a6c3d1c6e750313164b8304c62ed4731f: Status 404 returned error can't find the container with id 1da38ce3cc358ee6439de1cab019239a6c3d1c6e750313164b8304c62ed4731f Jun 03 20:43:38.775266 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:38.775234 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f96139a_8f36_4f22_a932_dc461fa90edc.slice/crio-eed287a60b63ab67532c7c97e3a1075a72c092f7cd5b6535078299219bb39abb WatchSource:0}: Error finding container eed287a60b63ab67532c7c97e3a1075a72c092f7cd5b6535078299219bb39abb: Status 404 returned error can't find the container with id eed287a60b63ab67532c7c97e3a1075a72c092f7cd5b6535078299219bb39abb Jun 03 20:43:38.776098 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:38.776076 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75da9761_a791_43a6_9b2a_5c4541f0b947.slice/crio-8c1184f7eb7a0ea03dd78845727c3405741e4d6a85a4c10a73fe2c474dd3abe2 WatchSource:0}: Error finding container 8c1184f7eb7a0ea03dd78845727c3405741e4d6a85a4c10a73fe2c474dd3abe2: Status 404 returned error can't find the container with id 8c1184f7eb7a0ea03dd78845727c3405741e4d6a85a4c10a73fe2c474dd3abe2 Jun 03 20:43:38.778081 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:38.778000 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52cd91a_765c_4427_81c7_caa38584c1b6.slice/crio-6eb0ce11f73a78809df003d53902a16cc253827226eb315e224ad345d3530598 WatchSource:0}: Error finding container 6eb0ce11f73a78809df003d53902a16cc253827226eb315e224ad345d3530598: Status 404 returned error can't find the container with id 6eb0ce11f73a78809df003d53902a16cc253827226eb315e224ad345d3530598 Jun 03 20:43:38.779644 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:43:38.779489 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986fede1_39d0_4a43_8526_bcb2bd8f28e9.slice/crio-3f5bec5f0dbf9480c97fc1fca3721b8aa7cbc6f4c4ad1d828c24b6633c39c5d1 WatchSource:0}: Error finding container 3f5bec5f0dbf9480c97fc1fca3721b8aa7cbc6f4c4ad1d828c24b6633c39c5d1: Status 404 returned error can't find the container with id 3f5bec5f0dbf9480c97fc1fca3721b8aa7cbc6f4c4ad1d828c24b6633c39c5d1 Jun 03 20:43:38.873891 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.873822 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:38:37 +0000 UTC" deadline="2027-12-17 10:47:21.146243036 +0000 UTC" Jun 03 20:43:38.873891 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.873885 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13478h3m42.272360869s" Jun 03 20:43:38.900313 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.900277 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:38.900475 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:38.900381 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:38.909011 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.908974 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" event={"ID":"59bc0c3d-d465-4c83-b500-d3c76c6aaeea","Type":"ContainerStarted","Data":"1da38ce3cc358ee6439de1cab019239a6c3d1c6e750313164b8304c62ed4731f"} Jun 03 20:43:38.912240 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.912213 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" event={"ID":"63aad158be7a52985bc7aa2bdf4ecbef","Type":"ContainerStarted","Data":"77af025de3c04aca2804d90c1db85fdbaf718622aae0d30e17d7e0fb54681ac1"} Jun 03 20:43:38.913341 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.913310 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vh628" event={"ID":"986fede1-39d0-4a43-8526-bcb2bd8f28e9","Type":"ContainerStarted","Data":"3f5bec5f0dbf9480c97fc1fca3721b8aa7cbc6f4c4ad1d828c24b6633c39c5d1"} Jun 03 20:43:38.918902 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.918880 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrwxg" event={"ID":"7663897a-c35c-4e7e-bbb7-1b7956d2ddb0","Type":"ContainerStarted","Data":"3837e6e201463a1e753b010816a300d5fae4e666c6478ad0ed60cd43c638bad6"} Jun 03 20:43:38.921020 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.920928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" event={"ID":"0f5b8399-e2c0-4c85-97d2-540925882e3d","Type":"ContainerStarted","Data":"a53cd74da2e7d7aaa23c53bd073d09fca63c98b3b96300c41ef7f2ca28ef667a"} Jun 03 20:43:38.922299 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.922277 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9vx5" event={"ID":"48a33e93-f74e-4aa7-85e6-301bc4355b16","Type":"ContainerStarted","Data":"9fc718a8bec4b9ab57357ed320f00a76c1f190160fc4b56fd82d45ad39b716ea"} Jun 03 20:43:38.925412 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.925388 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hvb8z" event={"ID":"4381bffc-e0ab-444d-a052-3972c1a0dbbd","Type":"ContainerStarted","Data":"f6ce043882ca08cbc7dc8ff03877a86173730cd451ef28d3490e34312fa1dcda"} Jun 03 20:43:38.928032 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.927998 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g7wxk" event={"ID":"f52cd91a-765c-4427-81c7-caa38584c1b6","Type":"ContainerStarted","Data":"6eb0ce11f73a78809df003d53902a16cc253827226eb315e224ad345d3530598"} Jun 03 20:43:38.929119 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.929097 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lf7rr" event={"ID":"75da9761-a791-43a6-9b2a-5c4541f0b947","Type":"ContainerStarted","Data":"8c1184f7eb7a0ea03dd78845727c3405741e4d6a85a4c10a73fe2c474dd3abe2"} Jun 03 20:43:38.929285 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.929246 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" podStartSLOduration=1.92923323 podStartE2EDuration="1.92923323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:38.928412859 +0000 UTC m=+3.527291826" watchObservedRunningTime="2026-06-03 20:43:38.92923323 +0000 UTC m=+3.528112263" Jun 03 20:43:38.930164 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:38.930143 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" event={"ID":"5f96139a-8f36-4f22-a932-dc461fa90edc","Type":"ContainerStarted","Data":"eed287a60b63ab67532c7c97e3a1075a72c092f7cd5b6535078299219bb39abb"} Jun 03 20:43:39.287188 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:39.286838 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:39.455065 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:39.455025 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:39.455272 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:39.455233 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:39.455343 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:39.455310 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret podName:b3c760f9-ef51-42cc-b57a-a945396666df nodeName:}" failed. No retries permitted until 2026-06-03 20:43:41.455287893 +0000 UTC m=+6.054166884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret") pod "global-pull-secret-syncer-c4cnh" (UID: "b3c760f9-ef51-42cc-b57a-a945396666df") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:39.556074 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:39.555966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:39.556248 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:39.556113 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:39.556248 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:39.556175 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs podName:a4d60725-a1d1-401e-a46c-d2d874ec1693 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:41.55615793 +0000 UTC m=+6.155036884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs") pod "network-metrics-daemon-cjp9g" (UID: "a4d60725-a1d1-401e-a46c-d2d874ec1693") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:39.656997 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:39.656954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9fz\" (UniqueName: \"kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz\") pod \"network-check-target-brbhj\" (UID: \"4f123adb-d60e-449f-b868-db33d2c1ae6a\") " pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:39.657170 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:39.657141 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:39.657170 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:39.657168 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:39.657296 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:39.657180 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ng9fz for pod openshift-network-diagnostics/network-check-target-brbhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:39.657296 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:39.657240 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz podName:4f123adb-d60e-449f-b868-db33d2c1ae6a nodeName:}" failed. No retries permitted until 2026-06-03 20:43:41.657221418 +0000 UTC m=+6.256100378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng9fz" (UniqueName: "kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz") pod "network-check-target-brbhj" (UID: "4f123adb-d60e-449f-b868-db33d2c1ae6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:39.874650 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:39.874556 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:38:37 +0000 UTC" deadline="2028-02-15 17:25:24.074716618 +0000 UTC" Jun 03 20:43:39.874650 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:39.874602 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14924h41m44.200118872s" Jun 03 20:43:39.903627 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:39.902793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:39.903627 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:39.902935 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:39.903627 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:39.903432 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:39.903627 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:39.903539 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:39.946674 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:39.946055 2563 generic.go:356] "Generic (PLEG): container finished" podID="d82e29907a2bf8a0d636ac0d1fc5392d" containerID="43a8a294691e66047db1fdc549854a43b5dae7cde7f29fb119bf04fc9e1b044d" exitCode=0 Jun 03 20:43:39.946674 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:39.946205 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" event={"ID":"d82e29907a2bf8a0d636ac0d1fc5392d","Type":"ContainerDied","Data":"43a8a294691e66047db1fdc549854a43b5dae7cde7f29fb119bf04fc9e1b044d"} Jun 03 20:43:40.899544 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:40.899511 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:40.900045 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:40.899650 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:40.978512 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:40.978160 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" event={"ID":"d82e29907a2bf8a0d636ac0d1fc5392d","Type":"ContainerStarted","Data":"c7454b3b9d986f8f94e5a259661956dda46831fcf5615d33fbff54660feb7bee"} Jun 03 20:43:41.476410 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:41.476368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:41.476607 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:41.476579 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:41.476668 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:41.476643 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret podName:b3c760f9-ef51-42cc-b57a-a945396666df nodeName:}" failed. No retries permitted until 2026-06-03 20:43:45.476624498 +0000 UTC m=+10.075503444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret") pod "global-pull-secret-syncer-c4cnh" (UID: "b3c760f9-ef51-42cc-b57a-a945396666df") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:41.577721 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:41.577679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:41.577899 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:41.577812 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:41.577899 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:41.577888 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs podName:a4d60725-a1d1-401e-a46c-d2d874ec1693 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:45.577868749 +0000 UTC m=+10.176747704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs") pod "network-metrics-daemon-cjp9g" (UID: "a4d60725-a1d1-401e-a46c-d2d874ec1693") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:41.678979 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:41.678308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9fz\" (UniqueName: \"kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz\") pod \"network-check-target-brbhj\" (UID: \"4f123adb-d60e-449f-b868-db33d2c1ae6a\") " pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:41.678979 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:41.678491 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:41.678979 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:41.678510 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:41.678979 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:41.678524 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ng9fz for pod openshift-network-diagnostics/network-check-target-brbhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:41.678979 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:41.678585 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz podName:4f123adb-d60e-449f-b868-db33d2c1ae6a nodeName:}" failed. No retries permitted until 2026-06-03 20:43:45.678566106 +0000 UTC m=+10.277445049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng9fz" (UniqueName: "kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz") pod "network-check-target-brbhj" (UID: "4f123adb-d60e-449f-b868-db33d2c1ae6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:41.900113 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:41.900075 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:41.900567 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:41.900230 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:41.900640 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:41.900083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:41.900695 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:41.900681 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:42.899583 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:42.899537 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:42.899792 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:42.899682 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:43.900064 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:43.900027 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:43.900516 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:43.900164 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:43.900516 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:43.900177 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:43.900516 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:43.900374 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:44.900324 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:44.900147 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:44.900324 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:44.900284 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:45.508970 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:45.508841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:45.509151 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:45.509031 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:45.509151 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:45.509099 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret podName:b3c760f9-ef51-42cc-b57a-a945396666df nodeName:}" failed. No retries permitted until 2026-06-03 20:43:53.509079503 +0000 UTC m=+18.107958449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret") pod "global-pull-secret-syncer-c4cnh" (UID: "b3c760f9-ef51-42cc-b57a-a945396666df") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:45.609827 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:45.609518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:45.609827 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:45.609663 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:45.609827 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:45.609723 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs podName:a4d60725-a1d1-401e-a46c-d2d874ec1693 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:53.609704511 +0000 UTC m=+18.208583456 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs") pod "network-metrics-daemon-cjp9g" (UID: "a4d60725-a1d1-401e-a46c-d2d874ec1693") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:45.710458 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:45.710420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9fz\" (UniqueName: \"kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz\") pod \"network-check-target-brbhj\" (UID: \"4f123adb-d60e-449f-b868-db33d2c1ae6a\") " pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:45.710933 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:45.710616 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:45.710933 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:45.710649 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:45.710933 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:45.710663 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ng9fz for pod openshift-network-diagnostics/network-check-target-brbhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:45.710933 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:45.710732 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz podName:4f123adb-d60e-449f-b868-db33d2c1ae6a nodeName:}" failed. No retries permitted until 2026-06-03 20:43:53.710713831 +0000 UTC m=+18.309592791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng9fz" (UniqueName: "kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz") pod "network-check-target-brbhj" (UID: "4f123adb-d60e-449f-b868-db33d2c1ae6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:45.902188 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:45.901959 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:45.902642 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:45.902270 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:45.902642 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:45.902021 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:45.902642 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:45.902442 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:46.899898 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:46.899868 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:46.900092 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:46.899993 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:47.899775 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:47.899736 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:47.900233 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:47.899794 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:47.900233 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:47.899884 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:47.900357 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:47.900329 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:48.900146 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:48.900064 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:48.900530 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:48.900183 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:49.899795 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:49.899763 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:49.899998 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:49.899808 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:49.899998 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:49.899915 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:49.900116 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:49.900044 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:50.900147 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:50.900117 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:50.900614 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:50.900240 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:51.899869 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:51.899832 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:51.900079 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:51.899832 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:51.900079 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:51.900026 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:51.900171 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:51.900100 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:52.899915 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:52.899875 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:52.900157 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:52.900014 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:53.562573 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:53.562537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:53.563027 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:53.562681 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:53.563027 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:53.562745 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret podName:b3c760f9-ef51-42cc-b57a-a945396666df nodeName:}" failed. No retries permitted until 2026-06-03 20:44:09.562729644 +0000 UTC m=+34.161608584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret") pod "global-pull-secret-syncer-c4cnh" (UID: "b3c760f9-ef51-42cc-b57a-a945396666df") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:53.663815 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:53.663775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:53.664010 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:53.663936 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:53.664088 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:53.664028 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs podName:a4d60725-a1d1-401e-a46c-d2d874ec1693 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:09.664007717 +0000 UTC m=+34.262886657 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs") pod "network-metrics-daemon-cjp9g" (UID: "a4d60725-a1d1-401e-a46c-d2d874ec1693") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:53.764506 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:53.764462 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9fz\" (UniqueName: \"kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz\") pod \"network-check-target-brbhj\" (UID: \"4f123adb-d60e-449f-b868-db33d2c1ae6a\") " pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:53.764694 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:53.764627 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:53.764694 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:53.764649 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:53.764694 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:53.764659 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ng9fz for pod openshift-network-diagnostics/network-check-target-brbhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:53.764841 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:53.764716 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz podName:4f123adb-d60e-449f-b868-db33d2c1ae6a nodeName:}" failed. No retries permitted until 2026-06-03 20:44:09.764698589 +0000 UTC m=+34.363577546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng9fz" (UniqueName: "kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz") pod "network-check-target-brbhj" (UID: "4f123adb-d60e-449f-b868-db33d2c1ae6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:53.899856 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:53.899767 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:53.900046 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:53.899774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:53.900046 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:53.899903 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:53.900046 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:53.900019 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:54.899458 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:54.899421 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:54.899862 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:54.899540 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:55.900109 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:55.900071 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:55.900562 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:55.900185 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:55.900562 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:55.900271 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:55.900562 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:55.900387 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:56.900004 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:56.899979 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:56.900107 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:56.900072 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:57.900344 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:57.900143 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:57.901065 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:57.900184 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:57.901065 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:57.900506 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:57.901065 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:57.900386 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:58.015390 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.015356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g7wxk" event={"ID":"f52cd91a-765c-4427-81c7-caa38584c1b6","Type":"ContainerStarted","Data":"48c8b320c81547c38de5e9c04c78e27ed96b3d3b5556b95bb26096dea8272f2b"} Jun 03 20:43:58.017207 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.017177 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lf7rr" event={"ID":"75da9761-a791-43a6-9b2a-5c4541f0b947","Type":"ContainerStarted","Data":"09b0e44b3a217fba077ec5f09fec84054763b375f843348c44a7eb313204f55d"} Jun 03 20:43:58.018816 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.018794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" event={"ID":"5f96139a-8f36-4f22-a932-dc461fa90edc","Type":"ContainerStarted","Data":"6f598776be62444541b9b8b62cdfd836a90ae9ed27098eca2aeec0c06cf9d62e"} Jun 03 20:43:58.022148 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.022123 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" event={"ID":"59bc0c3d-d465-4c83-b500-d3c76c6aaeea","Type":"ContainerStarted","Data":"c38ff0f03bf7eea85f7c06a40360edea14d3f765373069fe09f4d7156dd20cfa"} Jun 03 20:43:58.022256 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.022201 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" event={"ID":"59bc0c3d-d465-4c83-b500-d3c76c6aaeea","Type":"ContainerStarted","Data":"bb325a3dc3ba36eb2eba4bfb86513a08e42ac0cc16857393146e352af2df6794"} Jun 03 20:43:58.022256 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.022251 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" event={"ID":"59bc0c3d-d465-4c83-b500-d3c76c6aaeea","Type":"ContainerStarted","Data":"4915d2592947ed5f4aa26b597348fc5066d67433ef84dc679b212c925ed53b15"} Jun 03 20:43:58.022348 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.022298 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" event={"ID":"59bc0c3d-d465-4c83-b500-d3c76c6aaeea","Type":"ContainerStarted","Data":"00e5a81a33ed39e9e8a4177fc84c599cc6090d000b2a81c3f86b5491d9d1d7ab"} Jun 03 20:43:58.022348 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.022344 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" event={"ID":"59bc0c3d-d465-4c83-b500-d3c76c6aaeea","Type":"ContainerStarted","Data":"6cfd90740d542833753b19c26eb02c0d3261546e75c652532b6d56ae1e5baa46"} Jun 03 20:43:58.022426 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.022390 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" event={"ID":"59bc0c3d-d465-4c83-b500-d3c76c6aaeea","Type":"ContainerStarted","Data":"11a0ca485e187ca475551998b92307f5f621d8a02493af08ec4136a27666b29f"} Jun 03 20:43:58.023606 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.023580 2563 generic.go:356] "Generic (PLEG): container finished" podID="986fede1-39d0-4a43-8526-bcb2bd8f28e9" containerID="0694c201a91b31d409a7830cb603f970e190e312ddd1d1ea06d7ceeb1079155d" exitCode=0 Jun 03 20:43:58.023705 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.023666 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vh628" event={"ID":"986fede1-39d0-4a43-8526-bcb2bd8f28e9","Type":"ContainerDied","Data":"0694c201a91b31d409a7830cb603f970e190e312ddd1d1ea06d7ceeb1079155d"} Jun 03 20:43:58.025586 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.025564 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" event={"ID":"0f5b8399-e2c0-4c85-97d2-540925882e3d","Type":"ContainerStarted","Data":"92c306b19793a6bfc568284dd0a28448128b216bbc1914fd6a11cefad7cc688d"} Jun 03 20:43:58.027240 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.027217 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9vx5" event={"ID":"48a33e93-f74e-4aa7-85e6-301bc4355b16","Type":"ContainerStarted","Data":"8fb37f19fc8ec2c21540c93a734557440f0d51e1d3e1eeded820ab323ecd30bd"} Jun 03 20:43:58.029601 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.029578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hvb8z" event={"ID":"4381bffc-e0ab-444d-a052-3972c1a0dbbd","Type":"ContainerStarted","Data":"588e3662216d224d67a81611c4156ded16e94c30935c3672422dfe27fc6bcc7b"} Jun 03 20:43:58.032371 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.032335 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" podStartSLOduration=21.032324836 podStartE2EDuration="21.032324836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:40.994936191 +0000 UTC m=+5.593815152" watchObservedRunningTime="2026-06-03 20:43:58.032324836 +0000 UTC m=+22.631203797" Jun 03 20:43:58.033003 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.032972 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g7wxk" podStartSLOduration=3.985335328 podStartE2EDuration="22.032965155s" totalImagesPullingTime="18.047629827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:58.032260835 +0000 UTC m=+22.631139798" watchObservedRunningTime="2026-06-03 20:43:58.032965155 +0000 UTC m=+22.631844117" Jun 03 20:43:58.054739 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.054688 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lf7rr" podStartSLOduration=8.498109474 podStartE2EDuration="22.054675398s" totalImagesPullingTime="13.556565924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:58.05420061 +0000 UTC m=+22.653079574" watchObservedRunningTime="2026-06-03 20:43:58.054675398 +0000 UTC m=+22.653554363" Jun 03 20:43:58.098997 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.098934 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j9vx5" podStartSLOduration=3.867032688 podStartE2EDuration="22.098911045s" totalImagesPullingTime="18.231878357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:58.098829722 +0000 UTC m=+22.697708684" watchObservedRunningTime="2026-06-03 20:43:58.098911045 +0000 UTC m=+22.697790007" Jun 03 20:43:58.113677 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.113637 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hvb8z" podStartSLOduration=3.904995973 podStartE2EDuration="22.113624227s" totalImagesPullingTime="18.208628254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:58.11356949 +0000 UTC m=+22.712448466" watchObservedRunningTime="2026-06-03 20:43:58.113624227 +0000 UTC m=+22.712503190" Jun 03 20:43:58.130703 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.130667 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hzvvz" podStartSLOduration=4.899547647 podStartE2EDuration="23.130654134s" totalImagesPullingTime="18.231106487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:58.130250039 +0000 UTC m=+22.729129002" watchObservedRunningTime="2026-06-03 20:43:58.130654134 +0000 UTC m=+22.729533095" Jun 03 20:43:58.268270 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.268229 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf7rr_75da9761-a791-43a6-9b2a-5c4541f0b947/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:58.339657 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.339626 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf7rr_75da9761-a791-43a6-9b2a-5c4541f0b947/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:58.496786 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.496592 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 20:43:58.899470 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.899438 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:58.899743 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:58.899573 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:58.900062 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.899975 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T20:43:58.496781677Z","UUID":"32ca2345-08fb-4741-a753-4deda2040bc2","Handler":null,"Name":"","Endpoint":""} Jun 03 20:43:58.901608 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.901587 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 20:43:58.902016 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:58.901626 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 20:43:59.033628 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:59.033592 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrwxg" event={"ID":"7663897a-c35c-4e7e-bbb7-1b7956d2ddb0","Type":"ContainerStarted","Data":"7cae5e7d7cb9ae7e1bc0f3263982db0eb5824818ed80c53b3fc4188d2b5a7820"} Jun 03 20:43:59.035818 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:59.035783 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" event={"ID":"5f96139a-8f36-4f22-a932-dc461fa90edc","Type":"ContainerStarted","Data":"a2f8bd6e36fb778aee44f6a5b69ca54f4f6c276f4b9960a5ab89ac47a0ff24a7"} Jun 03 20:43:59.048339 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:59.048296 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qrwxg" podStartSLOduration=4.842681042 podStartE2EDuration="23.048283386s" totalImagesPullingTime="18.205602344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:59.048224975 +0000 UTC m=+23.647103939" watchObservedRunningTime="2026-06-03 20:43:59.048283386 +0000 UTC m=+23.647162348" Jun 03 20:43:59.161311 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:59.161213 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lf7rr_75da9761-a791-43a6-9b2a-5c4541f0b947/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:59.900353 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:59.900263 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:43:59.900546 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:59.900398 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:43:59.900546 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:59.900437 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:43:59.900546 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:59.900501 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:43:59.900546 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:59.900548 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:43:59.900783 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:43:59.900609 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:43:59.968151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:59.968120 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:43:59.968792 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:43:59.968767 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:44:00.040198 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:00.040160 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" event={"ID":"5f96139a-8f36-4f22-a932-dc461fa90edc","Type":"ContainerStarted","Data":"5e0edad46febdb538c96cb9f8ff4fb9dcdd0df14b4f7b2f435dd176437441d2b"} Jun 03 20:44:00.044915 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:00.044438 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" event={"ID":"59bc0c3d-d465-4c83-b500-d3c76c6aaeea","Type":"ContainerStarted","Data":"00745b4099a5599ce3fd136284396abd34f7023110172535d8cd8865ccde0cb8"} Jun 03 20:44:00.044915 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:00.044710 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:44:00.045191 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:00.045171 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lf7rr" Jun 03 20:44:00.060283 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:00.060236 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcphb" podStartSLOduration=3.734519438 podStartE2EDuration="24.060221481s" totalImagesPullingTime="20.325702043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:00.059888748 +0000 UTC m=+24.658767709" watchObservedRunningTime="2026-06-03 20:44:00.060221481 +0000 UTC m=+24.659100442" Jun 03 20:44:01.899640 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:01.899611 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:44:01.900244 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:01.899617 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:44:01.900244 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:01.899747 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:44:01.900244 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:01.899788 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:44:01.900244 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:01.899854 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:44:01.900244 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:01.899913 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:44:03.052712 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:03.052499 2563 generic.go:356] "Generic (PLEG): container finished" podID="986fede1-39d0-4a43-8526-bcb2bd8f28e9" containerID="f6dc62897ddda8a41fad95499f63ffe7257013e7f99c0e985830cb76c708ef01" exitCode=0 Jun 03 20:44:03.053210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:03.052585 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vh628" event={"ID":"986fede1-39d0-4a43-8526-bcb2bd8f28e9","Type":"ContainerDied","Data":"f6dc62897ddda8a41fad95499f63ffe7257013e7f99c0e985830cb76c708ef01"} Jun 03 20:44:03.056304 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:03.056283 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" event={"ID":"59bc0c3d-d465-4c83-b500-d3c76c6aaeea","Type":"ContainerStarted","Data":"88d3bf27972361d85fb1a6a90c6bc827078705f5568c607d35206925b2832ed7"} Jun 03 20:44:03.056538 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:03.056523 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:44:03.056609 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:03.056583 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:44:03.072085 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:03.072057 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:44:03.099863 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:03.099811 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" podStartSLOduration=8.757717721 podStartE2EDuration="27.099798915s" totalImagesPullingTime="18.342081194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:03.099376885 +0000 UTC m=+27.698255841" watchObservedRunningTime="2026-06-03 20:44:03.099798915 +0000 UTC m=+27.698677876" Jun 03 20:44:03.900503 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:03.900475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:44:03.900866 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:03.900475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:44:03.900866 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:03.900631 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:44:03.900866 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:03.900687 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:44:03.900866 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:03.900475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:44:03.900866 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:03.900774 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:44:04.060035 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:04.059814 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:44:04.076883 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:04.076862 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:44:04.122290 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:04.122263 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c4cnh"] Jun 03 20:44:04.122406 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:04.122353 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:44:04.122473 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:04.122452 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:44:04.125705 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:04.125680 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cjp9g"] Jun 03 20:44:04.125799 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:04.125789 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:44:04.125937 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:04.125905 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:44:04.126388 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:04.126357 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-brbhj"] Jun 03 20:44:04.126450 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:04.126434 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:44:04.126520 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:04.126504 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:44:05.063728 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:05.063698 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vh628" event={"ID":"986fede1-39d0-4a43-8526-bcb2bd8f28e9","Type":"ContainerDied","Data":"ff9a817a43f79e6ef84b9ee41fe5017eee203d5b815347a4887aa57dd9eba4e3"} Jun 03 20:44:05.064322 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:05.063622 2563 generic.go:356] "Generic (PLEG): container finished" podID="986fede1-39d0-4a43-8526-bcb2bd8f28e9" containerID="ff9a817a43f79e6ef84b9ee41fe5017eee203d5b815347a4887aa57dd9eba4e3" exitCode=0 Jun 03 20:44:05.900469 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:05.900440 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:44:05.900669 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:05.900515 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:44:05.900669 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:05.900521 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:44:05.900669 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:05.900570 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:44:05.900790 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:05.900666 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:44:05.900790 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:05.900734 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:44:07.071433 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:07.071397 2563 generic.go:356] "Generic (PLEG): container finished" podID="986fede1-39d0-4a43-8526-bcb2bd8f28e9" containerID="066ca6be5720e3385669beacda2fad86db388422a0a1a608760d4f29e35baffb" exitCode=0 Jun 03 20:44:07.072106 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:07.071465 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vh628" event={"ID":"986fede1-39d0-4a43-8526-bcb2bd8f28e9","Type":"ContainerDied","Data":"066ca6be5720e3385669beacda2fad86db388422a0a1a608760d4f29e35baffb"} Jun 03 20:44:07.903394 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:07.903360 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:44:07.903571 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:07.903483 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:44:07.903571 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:07.903502 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:44:07.903571 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:07.903496 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-brbhj" podUID="4f123adb-d60e-449f-b868-db33d2c1ae6a" Jun 03 20:44:07.903715 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:07.903598 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c4cnh" podUID="b3c760f9-ef51-42cc-b57a-a945396666df" Jun 03 20:44:07.903715 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:07.903695 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:44:09.578271 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.578238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:44:09.578710 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:09.578401 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:44:09.578710 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:09.578478 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret podName:b3c760f9-ef51-42cc-b57a-a945396666df nodeName:}" failed. No retries permitted until 2026-06-03 20:44:41.578457439 +0000 UTC m=+66.177336383 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret") pod "global-pull-secret-syncer-c4cnh" (UID: "b3c760f9-ef51-42cc-b57a-a945396666df") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:44:09.666799 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.666767 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeReady" Jun 03 20:44:09.666977 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.666921 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 20:44:09.679011 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.678988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:44:09.679129 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:09.679110 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:44:09.679171 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:09.679158 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs podName:a4d60725-a1d1-401e-a46c-d2d874ec1693 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:41.679145044 +0000 UTC m=+66.278023984 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs") pod "network-metrics-daemon-cjp9g" (UID: "a4d60725-a1d1-401e-a46c-d2d874ec1693") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:44:09.719875 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.719841 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w9jpb"] Jun 03 20:44:09.721791 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.721768 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.723760 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.723737 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7n84d"] Jun 03 20:44:09.725408 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.725389 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7n84d" Jun 03 20:44:09.727237 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.727204 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d78km\"" Jun 03 20:44:09.727237 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.727230 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 20:44:09.727400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.727249 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 20:44:09.729758 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.729740 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 20:44:09.730333 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.730134 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 20:44:09.730489 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.730468 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 20:44:09.731013 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.730983 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ql74z\"" Jun 03 20:44:09.738094 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.737609 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w9jpb"] Jun 03 20:44:09.739172 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.739150 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7n84d"] Jun 03 20:44:09.780058 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.780022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.780228 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.780083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/644071d7-1aca-4adc-ae34-91ef0eb3ccad-config-volume\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.780228 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.780124 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9fz\" (UniqueName: \"kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz\") pod \"network-check-target-brbhj\" (UID: \"4f123adb-d60e-449f-b868-db33d2c1ae6a\") " pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:44:09.780228 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.780219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gngt\" (UniqueName: \"kubernetes.io/projected/644071d7-1aca-4adc-ae34-91ef0eb3ccad-kube-api-access-7gngt\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.780386 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:09.780275 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:44:09.780386 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:09.780296 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:44:09.780386 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.780300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/644071d7-1aca-4adc-ae34-91ef0eb3ccad-tmp-dir\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.780386 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:09.780311 2563 projected.go:196] Error preparing data for projected volume kube-api-access-ng9fz for pod openshift-network-diagnostics/network-check-target-brbhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:44:09.780570 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:09.780434 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz podName:4f123adb-d60e-449f-b868-db33d2c1ae6a nodeName:}" failed. No retries permitted until 2026-06-03 20:44:41.780412765 +0000 UTC m=+66.379291720 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ng9fz" (UniqueName: "kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz") pod "network-check-target-brbhj" (UID: "4f123adb-d60e-449f-b868-db33d2c1ae6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:44:09.880865 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.880828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnk52\" (UniqueName: \"kubernetes.io/projected/fef46e08-feb6-4bd1-b811-beb040c66ec2-kube-api-access-mnk52\") pod \"ingress-canary-7n84d\" (UID: \"fef46e08-feb6-4bd1-b811-beb040c66ec2\") " pod="openshift-ingress-canary/ingress-canary-7n84d" Jun 03 20:44:09.881056 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.880898 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/644071d7-1aca-4adc-ae34-91ef0eb3ccad-tmp-dir\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.881056 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.880985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.881056 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.881035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/644071d7-1aca-4adc-ae34-91ef0eb3ccad-config-volume\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.881234 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:09.881156 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:09.881234 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.881191 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef46e08-feb6-4bd1-b811-beb040c66ec2-cert\") pod \"ingress-canary-7n84d\" (UID: \"fef46e08-feb6-4bd1-b811-beb040c66ec2\") " pod="openshift-ingress-canary/ingress-canary-7n84d" Jun 03 20:44:09.881234 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:09.881224 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls podName:644071d7-1aca-4adc-ae34-91ef0eb3ccad nodeName:}" failed. No retries permitted until 2026-06-03 20:44:10.381203095 +0000 UTC m=+34.980082050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls") pod "dns-default-w9jpb" (UID: "644071d7-1aca-4adc-ae34-91ef0eb3ccad") : secret "dns-default-metrics-tls" not found Jun 03 20:44:09.881355 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.881232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/644071d7-1aca-4adc-ae34-91ef0eb3ccad-tmp-dir\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.881355 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.881307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gngt\" (UniqueName: \"kubernetes.io/projected/644071d7-1aca-4adc-ae34-91ef0eb3ccad-kube-api-access-7gngt\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.881761 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.881551 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/644071d7-1aca-4adc-ae34-91ef0eb3ccad-config-volume\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.893607 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.893579 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gngt\" (UniqueName: \"kubernetes.io/projected/644071d7-1aca-4adc-ae34-91ef0eb3ccad-kube-api-access-7gngt\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:09.900459 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.900435 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:44:09.900586 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.900468 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:44:09.900586 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.900436 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:44:09.906594 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.906569 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 20:44:09.906724 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.906711 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 20:44:09.907416 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.906752 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 20:44:09.907416 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.907134 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9n2b\"" Jun 03 20:44:09.907416 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.907147 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 20:44:09.907416 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.907353 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kg9x\"" Jun 03 20:44:09.982253 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.982217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef46e08-feb6-4bd1-b811-beb040c66ec2-cert\") pod \"ingress-canary-7n84d\" (UID: \"fef46e08-feb6-4bd1-b811-beb040c66ec2\") " pod="openshift-ingress-canary/ingress-canary-7n84d" Jun 03 20:44:09.982445 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.982280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnk52\" (UniqueName: \"kubernetes.io/projected/fef46e08-feb6-4bd1-b811-beb040c66ec2-kube-api-access-mnk52\") pod \"ingress-canary-7n84d\" (UID: \"fef46e08-feb6-4bd1-b811-beb040c66ec2\") " pod="openshift-ingress-canary/ingress-canary-7n84d" Jun 03 20:44:09.985426 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:09.985402 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef46e08-feb6-4bd1-b811-beb040c66ec2-cert\") pod \"ingress-canary-7n84d\" (UID: \"fef46e08-feb6-4bd1-b811-beb040c66ec2\") " pod="openshift-ingress-canary/ingress-canary-7n84d" Jun 03 20:44:10.001987 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:10.001935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnk52\" (UniqueName: \"kubernetes.io/projected/fef46e08-feb6-4bd1-b811-beb040c66ec2-kube-api-access-mnk52\") pod \"ingress-canary-7n84d\" (UID: \"fef46e08-feb6-4bd1-b811-beb040c66ec2\") " pod="openshift-ingress-canary/ingress-canary-7n84d" Jun 03 20:44:10.041070 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:10.040977 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7n84d" Jun 03 20:44:10.385768 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:10.385675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:10.385914 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:10.385844 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:10.385995 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:10.385924 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls podName:644071d7-1aca-4adc-ae34-91ef0eb3ccad nodeName:}" failed. No retries permitted until 2026-06-03 20:44:11.385902906 +0000 UTC m=+35.984781867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls") pod "dns-default-w9jpb" (UID: "644071d7-1aca-4adc-ae34-91ef0eb3ccad") : secret "dns-default-metrics-tls" not found Jun 03 20:44:11.301468 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:11.301442 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7n84d"] Jun 03 20:44:11.306379 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:44:11.306350 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef46e08_feb6_4bd1_b811_beb040c66ec2.slice/crio-67daf2cff5036d49986fb848e66f195680d8647e7da41cf00004255fe7c1b38e WatchSource:0}: Error finding container 67daf2cff5036d49986fb848e66f195680d8647e7da41cf00004255fe7c1b38e: Status 404 returned error can't find the container with id 67daf2cff5036d49986fb848e66f195680d8647e7da41cf00004255fe7c1b38e Jun 03 20:44:11.392708 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:11.392682 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:11.392843 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:11.392802 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:11.392905 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:11.392859 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls podName:644071d7-1aca-4adc-ae34-91ef0eb3ccad nodeName:}" failed. No retries permitted until 2026-06-03 20:44:13.392843672 +0000 UTC m=+37.991722618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls") pod "dns-default-w9jpb" (UID: "644071d7-1aca-4adc-ae34-91ef0eb3ccad") : secret "dns-default-metrics-tls" not found Jun 03 20:44:12.085229 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:12.085188 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7n84d" event={"ID":"fef46e08-feb6-4bd1-b811-beb040c66ec2","Type":"ContainerStarted","Data":"67daf2cff5036d49986fb848e66f195680d8647e7da41cf00004255fe7c1b38e"} Jun 03 20:44:12.088349 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:12.088306 2563 generic.go:356] "Generic (PLEG): container finished" podID="986fede1-39d0-4a43-8526-bcb2bd8f28e9" containerID="f98b79b657360f2940cf8666c3c4448f8ab1d1b9ecd49e59a3ffa6837df47ca6" exitCode=0 Jun 03 20:44:12.088461 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:12.088368 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vh628" event={"ID":"986fede1-39d0-4a43-8526-bcb2bd8f28e9","Type":"ContainerDied","Data":"f98b79b657360f2940cf8666c3c4448f8ab1d1b9ecd49e59a3ffa6837df47ca6"} Jun 03 20:44:13.093109 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:13.092846 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7n84d" event={"ID":"fef46e08-feb6-4bd1-b811-beb040c66ec2","Type":"ContainerStarted","Data":"381f15374c648b1535b727ffcb9fdf6a6f71ef14760659ee90e16fef3ca502d7"} Jun 03 20:44:13.096675 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:13.096648 2563 generic.go:356] "Generic (PLEG): container finished" podID="986fede1-39d0-4a43-8526-bcb2bd8f28e9" containerID="21765b5c259bc881ac2407f09514f2d21e6af7ccb243ea3fa742e8454844bb0b" exitCode=0 Jun 03 20:44:13.096812 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:13.096695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vh628" event={"ID":"986fede1-39d0-4a43-8526-bcb2bd8f28e9","Type":"ContainerDied","Data":"21765b5c259bc881ac2407f09514f2d21e6af7ccb243ea3fa742e8454844bb0b"} Jun 03 20:44:13.110009 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:13.109959 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7n84d" podStartSLOduration=2.554883683 podStartE2EDuration="4.109914948s" totalImagesPullingTime="1.555031265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:13.109640237 +0000 UTC m=+37.708519204" watchObservedRunningTime="2026-06-03 20:44:13.109914948 +0000 UTC m=+37.708793921" Jun 03 20:44:13.406580 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:13.406479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:13.406743 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:13.406662 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:13.406806 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:13.406759 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls podName:644071d7-1aca-4adc-ae34-91ef0eb3ccad nodeName:}" failed. No retries permitted until 2026-06-03 20:44:17.406736044 +0000 UTC m=+42.005615003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls") pod "dns-default-w9jpb" (UID: "644071d7-1aca-4adc-ae34-91ef0eb3ccad") : secret "dns-default-metrics-tls" not found Jun 03 20:44:14.102028 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:14.101990 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vh628" event={"ID":"986fede1-39d0-4a43-8526-bcb2bd8f28e9","Type":"ContainerStarted","Data":"3be26c560bb9ae98e8bd3559d679dd9eb791eab22148661ae7e9ef19f82828e9"} Jun 03 20:44:14.127646 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:14.127604 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vh628" podStartSLOduration=9.791524669 podStartE2EDuration="38.127584765s" totalImagesPullingTime="28.336060096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:14.126426765 +0000 UTC m=+38.725305727" watchObservedRunningTime="2026-06-03 20:44:14.127584765 +0000 UTC m=+38.726463728" Jun 03 20:44:17.434099 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:17.434060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:17.434559 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:17.434220 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:17.434559 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:17.434287 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls podName:644071d7-1aca-4adc-ae34-91ef0eb3ccad nodeName:}" failed. No retries permitted until 2026-06-03 20:44:25.434271348 +0000 UTC m=+50.033150290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls") pod "dns-default-w9jpb" (UID: "644071d7-1aca-4adc-ae34-91ef0eb3ccad") : secret "dns-default-metrics-tls" not found Jun 03 20:44:25.490928 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:25.490882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:25.491423 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:25.491071 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:25.491423 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:25.491154 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls podName:644071d7-1aca-4adc-ae34-91ef0eb3ccad nodeName:}" failed. No retries permitted until 2026-06-03 20:44:41.491136579 +0000 UTC m=+66.090015520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls") pod "dns-default-w9jpb" (UID: "644071d7-1aca-4adc-ae34-91ef0eb3ccad") : secret "dns-default-metrics-tls" not found Jun 03 20:44:29.653543 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.653509 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc"] Jun 03 20:44:29.655807 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.655793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:29.658713 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.658694 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 20:44:29.659800 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.659781 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 20:44:29.659923 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.659833 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 20:44:29.659923 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.659840 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 20:44:29.667470 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.667449 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc"] Jun 03 20:44:29.821403 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.821346 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb6n2\" (UniqueName: \"kubernetes.io/projected/c527ab78-3d7a-455a-ad35-05497b8a0be0-kube-api-access-bb6n2\") pod \"klusterlet-addon-workmgr-756bc48b-n7hgc\" (UID: \"c527ab78-3d7a-455a-ad35-05497b8a0be0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:29.821403 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.821410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c527ab78-3d7a-455a-ad35-05497b8a0be0-klusterlet-config\") pod \"klusterlet-addon-workmgr-756bc48b-n7hgc\" (UID: \"c527ab78-3d7a-455a-ad35-05497b8a0be0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:29.821622 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.821441 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c527ab78-3d7a-455a-ad35-05497b8a0be0-tmp\") pod \"klusterlet-addon-workmgr-756bc48b-n7hgc\" (UID: \"c527ab78-3d7a-455a-ad35-05497b8a0be0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:29.922493 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.922397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb6n2\" (UniqueName: \"kubernetes.io/projected/c527ab78-3d7a-455a-ad35-05497b8a0be0-kube-api-access-bb6n2\") pod \"klusterlet-addon-workmgr-756bc48b-n7hgc\" (UID: \"c527ab78-3d7a-455a-ad35-05497b8a0be0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:29.922493 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.922450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c527ab78-3d7a-455a-ad35-05497b8a0be0-klusterlet-config\") pod \"klusterlet-addon-workmgr-756bc48b-n7hgc\" (UID: \"c527ab78-3d7a-455a-ad35-05497b8a0be0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:29.922493 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.922481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c527ab78-3d7a-455a-ad35-05497b8a0be0-tmp\") pod \"klusterlet-addon-workmgr-756bc48b-n7hgc\" (UID: \"c527ab78-3d7a-455a-ad35-05497b8a0be0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:29.922879 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.922859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c527ab78-3d7a-455a-ad35-05497b8a0be0-tmp\") pod \"klusterlet-addon-workmgr-756bc48b-n7hgc\" (UID: \"c527ab78-3d7a-455a-ad35-05497b8a0be0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:29.926185 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.926162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c527ab78-3d7a-455a-ad35-05497b8a0be0-klusterlet-config\") pod \"klusterlet-addon-workmgr-756bc48b-n7hgc\" (UID: \"c527ab78-3d7a-455a-ad35-05497b8a0be0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:29.930725 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.930701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb6n2\" (UniqueName: \"kubernetes.io/projected/c527ab78-3d7a-455a-ad35-05497b8a0be0-kube-api-access-bb6n2\") pod \"klusterlet-addon-workmgr-756bc48b-n7hgc\" (UID: \"c527ab78-3d7a-455a-ad35-05497b8a0be0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:29.964720 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:29.964690 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:30.086118 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:30.086088 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc"] Jun 03 20:44:30.089194 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:44:30.089170 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc527ab78_3d7a_455a_ad35_05497b8a0be0.slice/crio-769b60e084eaae57029497d8eb4d4f0cbd8d006e0291543ec4db28eb2df7da4e WatchSource:0}: Error finding container 769b60e084eaae57029497d8eb4d4f0cbd8d006e0291543ec4db28eb2df7da4e: Status 404 returned error can't find the container with id 769b60e084eaae57029497d8eb4d4f0cbd8d006e0291543ec4db28eb2df7da4e Jun 03 20:44:30.138109 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:30.138074 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" event={"ID":"c527ab78-3d7a-455a-ad35-05497b8a0be0","Type":"ContainerStarted","Data":"769b60e084eaae57029497d8eb4d4f0cbd8d006e0291543ec4db28eb2df7da4e"} Jun 03 20:44:35.151136 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:35.151101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" event={"ID":"c527ab78-3d7a-455a-ad35-05497b8a0be0","Type":"ContainerStarted","Data":"72f772cc39493a8a9107d4f3df4878363ecc4b55321847b6e895eeda554e55bd"} Jun 03 20:44:35.151506 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:35.151247 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:35.152874 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:35.152852 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:44:35.167715 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:35.167673 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" podStartSLOduration=2.097905029 podStartE2EDuration="6.167662299s" totalImagesPullingTime="4.06975727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:35.166132632 +0000 UTC m=+59.765011594" watchObservedRunningTime="2026-06-03 20:44:35.167662299 +0000 UTC m=+59.766541268" Jun 03 20:44:36.079546 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:36.079518 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q5hl" Jun 03 20:44:41.504317 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.504281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:44:41.504708 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:41.504436 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:41.504708 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:41.504509 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls podName:644071d7-1aca-4adc-ae34-91ef0eb3ccad nodeName:}" failed. No retries permitted until 2026-06-03 20:45:13.504492477 +0000 UTC m=+98.103371420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls") pod "dns-default-w9jpb" (UID: "644071d7-1aca-4adc-ae34-91ef0eb3ccad") : secret "dns-default-metrics-tls" not found Jun 03 20:44:41.605673 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.605634 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:44:41.609651 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.609632 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 20:44:41.618422 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.618403 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3c760f9-ef51-42cc-b57a-a945396666df-original-pull-secret\") pod \"global-pull-secret-syncer-c4cnh\" (UID: \"b3c760f9-ef51-42cc-b57a-a945396666df\") " pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:44:41.706320 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.706280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:44:41.709401 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.709383 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 20:44:41.717375 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:41.717354 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 20:44:41.717487 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:44:41.717427 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs podName:a4d60725-a1d1-401e-a46c-d2d874ec1693 nodeName:}" failed. No retries permitted until 2026-06-03 20:45:45.717406224 +0000 UTC m=+130.316285165 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs") pod "network-metrics-daemon-cjp9g" (UID: "a4d60725-a1d1-401e-a46c-d2d874ec1693") : secret "metrics-daemon-secret" not found Jun 03 20:44:41.726390 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.726366 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c4cnh" Jun 03 20:44:41.808782 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.808748 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9fz\" (UniqueName: \"kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz\") pod \"network-check-target-brbhj\" (UID: \"4f123adb-d60e-449f-b868-db33d2c1ae6a\") " pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:44:41.812399 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.812193 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 20:44:41.827398 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.827190 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 20:44:41.837611 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.837560 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng9fz\" (UniqueName: \"kubernetes.io/projected/4f123adb-d60e-449f-b868-db33d2c1ae6a-kube-api-access-ng9fz\") pod \"network-check-target-brbhj\" (UID: \"4f123adb-d60e-449f-b868-db33d2c1ae6a\") " pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:44:41.894734 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:41.894702 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c4cnh"] Jun 03 20:44:42.023550 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:42.023529 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9n2b\"" Jun 03 20:44:42.031767 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:42.031748 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:44:42.168097 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:42.168071 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-brbhj"] Jun 03 20:44:42.169752 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:42.169720 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c4cnh" event={"ID":"b3c760f9-ef51-42cc-b57a-a945396666df","Type":"ContainerStarted","Data":"773c023e9c169362f67aed5dfdcee494a2824563cb123703aa86f205076eae81"} Jun 03 20:44:42.171360 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:44:42.171335 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f123adb_d60e_449f_b868_db33d2c1ae6a.slice/crio-efe9158298e301b22fdca3059cb8ac6f3cf2d89f72c06ebaf6942cdcc10959cf WatchSource:0}: Error finding container efe9158298e301b22fdca3059cb8ac6f3cf2d89f72c06ebaf6942cdcc10959cf: Status 404 returned error can't find the container with id efe9158298e301b22fdca3059cb8ac6f3cf2d89f72c06ebaf6942cdcc10959cf Jun 03 20:44:43.174307 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:43.174268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-brbhj" event={"ID":"4f123adb-d60e-449f-b868-db33d2c1ae6a","Type":"ContainerStarted","Data":"efe9158298e301b22fdca3059cb8ac6f3cf2d89f72c06ebaf6942cdcc10959cf"} Jun 03 20:44:47.186759 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:47.186722 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c4cnh" event={"ID":"b3c760f9-ef51-42cc-b57a-a945396666df","Type":"ContainerStarted","Data":"400f89f01d7f0e26254c5415f4caf2ef946bf65adc5c489771887e35e909b600"} Jun 03 20:44:47.188174 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:47.188153 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-brbhj" event={"ID":"4f123adb-d60e-449f-b868-db33d2c1ae6a","Type":"ContainerStarted","Data":"88539cfd8d46855f5692899c79831ae2324999bac42cebc31f860dd914e4be28"} Jun 03 20:44:47.188276 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:47.188269 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:44:47.202342 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:47.202302 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c4cnh" podStartSLOduration=66.350170129 podStartE2EDuration="1m11.202287872s" totalImagesPullingTime="4.852117743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:47.201993998 +0000 UTC m=+71.800872959" watchObservedRunningTime="2026-06-03 20:44:47.202287872 +0000 UTC m=+71.801166830" Jun 03 20:44:47.217669 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:44:47.217627 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-brbhj" podStartSLOduration=66.638181886 podStartE2EDuration="1m11.217615481s" totalImagesPullingTime="4.579433595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:47.217112284 +0000 UTC m=+71.815991246" watchObservedRunningTime="2026-06-03 20:44:47.217615481 +0000 UTC m=+71.816494421" Jun 03 20:45:13.529465 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:45:13.529332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:45:13.529868 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:45:13.529503 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:45:13.529868 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:45:13.529582 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls podName:644071d7-1aca-4adc-ae34-91ef0eb3ccad nodeName:}" failed. No retries permitted until 2026-06-03 20:46:17.529564917 +0000 UTC m=+162.128443857 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls") pod "dns-default-w9jpb" (UID: "644071d7-1aca-4adc-ae34-91ef0eb3ccad") : secret "dns-default-metrics-tls" not found Jun 03 20:45:18.192837 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:45:18.192809 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-brbhj" Jun 03 20:45:45.754210 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:45:45.754147 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:45:45.754634 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:45:45.754294 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 20:45:45.754634 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:45:45.754378 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs podName:a4d60725-a1d1-401e-a46c-d2d874ec1693 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:47.754358807 +0000 UTC m=+252.353237748 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs") pod "network-metrics-daemon-cjp9g" (UID: "a4d60725-a1d1-401e-a46c-d2d874ec1693") : secret "metrics-daemon-secret" not found Jun 03 20:46:12.734419 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:12.734377 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w9jpb" podUID="644071d7-1aca-4adc-ae34-91ef0eb3ccad" Jun 03 20:46:12.914516 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:12.914481 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cjp9g" podUID="a4d60725-a1d1-401e-a46c-d2d874ec1693" Jun 03 20:46:13.387647 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:13.387618 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9jpb" Jun 03 20:46:17.563620 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:17.563583 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:46:17.564020 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:17.563698 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:46:17.564020 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:17.563769 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls podName:644071d7-1aca-4adc-ae34-91ef0eb3ccad nodeName:}" failed. No retries permitted until 2026-06-03 20:48:19.563750762 +0000 UTC m=+284.162629723 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls") pod "dns-default-w9jpb" (UID: "644071d7-1aca-4adc-ae34-91ef0eb3ccad") : secret "dns-default-metrics-tls" not found Jun 03 20:46:27.900030 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:27.899936 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:46:34.436795 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:34.436763 2563 generic.go:356] "Generic (PLEG): container finished" podID="c527ab78-3d7a-455a-ad35-05497b8a0be0" containerID="72f772cc39493a8a9107d4f3df4878363ecc4b55321847b6e895eeda554e55bd" exitCode=1 Jun 03 20:46:34.437269 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:34.436819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" event={"ID":"c527ab78-3d7a-455a-ad35-05497b8a0be0","Type":"ContainerDied","Data":"72f772cc39493a8a9107d4f3df4878363ecc4b55321847b6e895eeda554e55bd"} Jun 03 20:46:34.437269 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:34.437129 2563 scope.go:117] "RemoveContainer" containerID="72f772cc39493a8a9107d4f3df4878363ecc4b55321847b6e895eeda554e55bd" Jun 03 20:46:35.151798 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:35.151762 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:46:35.441538 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:35.441452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" event={"ID":"c527ab78-3d7a-455a-ad35-05497b8a0be0","Type":"ContainerStarted","Data":"b6d4adb1f592f5ee02bc3294bbc276e8c7d2244c4e2a95c63c9b8a6d862e86aa"} Jun 03 20:46:35.441925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:35.441662 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:46:35.442911 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:35.442579 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756bc48b-n7hgc" Jun 03 20:46:47.364428 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.364393 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt"] Jun 03 20:46:47.366331 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.366314 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" Jun 03 20:46:47.370906 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.370878 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 20:46:47.371065 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.370917 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 20:46:47.371065 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.370925 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:46:47.371748 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.371730 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 20:46:47.371826 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.371745 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dmlpl\"" Jun 03 20:46:47.389159 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.389134 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt"] Jun 03 20:46:47.463682 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.463643 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-lfp8d"] Jun 03 20:46:47.463979 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.463955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8e065fe-a286-4947-839d-9d4526cbd0d4-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt\" (UID: \"b8e065fe-a286-4947-839d-9d4526cbd0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" Jun 03 20:46:47.464048 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.464002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8e065fe-a286-4947-839d-9d4526cbd0d4-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt\" (UID: \"b8e065fe-a286-4947-839d-9d4526cbd0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" Jun 03 20:46:47.464120 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.464062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gxq2\" (UniqueName: \"kubernetes.io/projected/b8e065fe-a286-4947-839d-9d4526cbd0d4-kube-api-access-2gxq2\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt\" (UID: \"b8e065fe-a286-4947-839d-9d4526cbd0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" Jun 03 20:46:47.465742 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.465726 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78999dd999-znxzk"] Jun 03 20:46:47.465875 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.465860 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.467428 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.467408 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85c74bff45-m9bnm"] Jun 03 20:46:47.467522 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.467503 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.468834 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.468810 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 20:46:47.468834 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.468815 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 20:46:47.469111 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.469095 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.469724 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.469704 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:46:47.469830 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.469768 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gspdh\"" Jun 03 20:46:47.469830 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.469825 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 20:46:47.473539 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.473521 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 20:46:47.473786 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.473771 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 20:46:47.474306 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.474286 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 20:46:47.474583 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.474569 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 20:46:47.475217 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.475195 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 20:46:47.475333 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.475202 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qqw74\"" Jun 03 20:46:47.475333 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.475314 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q449h\"" Jun 03 20:46:47.475445 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.475330 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 20:46:47.475445 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.475358 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 20:46:47.477654 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.477618 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 20:46:47.478171 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.478158 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 20:46:47.482124 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.481652 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 20:46:47.482600 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.482584 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78999dd999-znxzk"] Jun 03 20:46:47.483406 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.483386 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-lfp8d"] Jun 03 20:46:47.484549 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.484532 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 20:46:47.500092 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.500068 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85c74bff45-m9bnm"] Jun 03 20:46:47.564567 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-trusted-ca\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.564567 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-installation-pull-secrets\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.564815 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564605 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8e065fe-a286-4947-839d-9d4526cbd0d4-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt\" (UID: \"b8e065fe-a286-4947-839d-9d4526cbd0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" Jun 03 20:46:47.564815 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8e065fe-a286-4947-839d-9d4526cbd0d4-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt\" (UID: \"b8e065fe-a286-4947-839d-9d4526cbd0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" Jun 03 20:46:47.564815 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-image-registry-private-configuration\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.564815 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs2dc\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-kube-api-access-bs2dc\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.564815 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-certificates\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.564815 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.564815 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564756 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c206b8a-2d18-41f4-83b5-67f49d8848c7-serving-cert\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.564815 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-stats-auth\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.564815 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564799 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c206b8a-2d18-41f4-83b5-67f49d8848c7-config\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.565227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gxq2\" (UniqueName: \"kubernetes.io/projected/b8e065fe-a286-4947-839d-9d4526cbd0d4-kube-api-access-2gxq2\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt\" (UID: \"b8e065fe-a286-4947-839d-9d4526cbd0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" Jun 03 20:46:47.565227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.565227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.565227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564904 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncpx2\" (UniqueName: \"kubernetes.io/projected/9a663e3f-2a94-475e-89de-3fa4de960eb2-kube-api-access-ncpx2\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.565227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c206b8a-2d18-41f4-83b5-67f49d8848c7-trusted-ca\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.565227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.564986 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-bound-sa-token\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.565227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.565013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-ca-trust-extracted\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.565227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.565033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvn7k\" (UniqueName: \"kubernetes.io/projected/1c206b8a-2d18-41f4-83b5-67f49d8848c7-kube-api-access-dvn7k\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.565227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.565065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-default-certificate\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.565227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.565168 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8e065fe-a286-4947-839d-9d4526cbd0d4-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt\" (UID: \"b8e065fe-a286-4947-839d-9d4526cbd0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" Jun 03 20:46:47.566892 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.566875 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8e065fe-a286-4947-839d-9d4526cbd0d4-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt\" (UID: \"b8e065fe-a286-4947-839d-9d4526cbd0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" Jun 03 20:46:47.575552 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.575519 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gxq2\" (UniqueName: \"kubernetes.io/projected/b8e065fe-a286-4947-839d-9d4526cbd0d4-kube-api-access-2gxq2\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt\" (UID: \"b8e065fe-a286-4947-839d-9d4526cbd0d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" Jun 03 20:46:47.665877 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.665786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-image-registry-private-configuration\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.665877 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.665829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs2dc\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-kube-api-access-bs2dc\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.665877 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.665855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-certificates\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.666168 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.665885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.666168 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.665909 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c206b8a-2d18-41f4-83b5-67f49d8848c7-serving-cert\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.666168 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.665970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-stats-auth\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.666168 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.665993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c206b8a-2d18-41f4-83b5-67f49d8848c7-config\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.666168 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.666168 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:47.666036 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 20:46:47.666168 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.666168 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncpx2\" (UniqueName: \"kubernetes.io/projected/9a663e3f-2a94-475e-89de-3fa4de960eb2-kube-api-access-ncpx2\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.666168 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:47.666105 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs podName:9a663e3f-2a94-475e-89de-3fa4de960eb2 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:48.166086323 +0000 UTC m=+192.764965264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs") pod "router-default-85c74bff45-m9bnm" (UID: "9a663e3f-2a94-475e-89de-3fa4de960eb2") : secret "router-metrics-certs-default" not found Jun 03 20:46:47.666168 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c206b8a-2d18-41f4-83b5-67f49d8848c7-trusted-ca\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.666659 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666176 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-bound-sa-token\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.666659 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-ca-trust-extracted\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.666659 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvn7k\" (UniqueName: \"kubernetes.io/projected/1c206b8a-2d18-41f4-83b5-67f49d8848c7-kube-api-access-dvn7k\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.666659 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-default-certificate\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.666659 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-trusted-ca\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.666659 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:47.666419 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle podName:9a663e3f-2a94-475e-89de-3fa4de960eb2 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:48.166399499 +0000 UTC m=+192.765278458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle") pod "router-default-85c74bff45-m9bnm" (UID: "9a663e3f-2a94-475e-89de-3fa4de960eb2") : configmap references non-existent config key: service-ca.crt Jun 03 20:46:47.666659 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:47.666452 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:46:47.666659 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:47.666472 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78999dd999-znxzk: secret "image-registry-tls" not found Jun 03 20:46:47.666659 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:47.666527 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls podName:6d1440fa-a1f5-4ff2-b505-480e40d38ac4 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:48.166509876 +0000 UTC m=+192.765388835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls") pod "image-registry-78999dd999-znxzk" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4") : secret "image-registry-tls" not found Jun 03 20:46:47.666659 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666452 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-installation-pull-secrets\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.666659 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-certificates\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.667224 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666868 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-ca-trust-extracted\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.667224 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.666929 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c206b8a-2d18-41f4-83b5-67f49d8848c7-config\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.667400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.667378 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c206b8a-2d18-41f4-83b5-67f49d8848c7-trusted-ca\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.667400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.667392 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-trusted-ca\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.668629 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.668604 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c206b8a-2d18-41f4-83b5-67f49d8848c7-serving-cert\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.668919 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.668894 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-image-registry-private-configuration\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.669130 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.669115 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-default-certificate\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.669174 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.669131 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-stats-auth\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.669662 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.669641 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-installation-pull-secrets\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.674613 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.674587 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncpx2\" (UniqueName: \"kubernetes.io/projected/9a663e3f-2a94-475e-89de-3fa4de960eb2-kube-api-access-ncpx2\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:47.674706 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.674686 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs2dc\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-kube-api-access-bs2dc\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.674859 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.674843 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvn7k\" (UniqueName: \"kubernetes.io/projected/1c206b8a-2d18-41f4-83b5-67f49d8848c7-kube-api-access-dvn7k\") pod \"console-operator-85bd8fd97d-lfp8d\" (UID: \"1c206b8a-2d18-41f4-83b5-67f49d8848c7\") " pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.675842 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.675818 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-bound-sa-token\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:47.678659 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.678643 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" Jun 03 20:46:47.775680 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.775647 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:47.796818 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.796789 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt"] Jun 03 20:46:47.800553 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:46:47.800518 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e065fe_a286_4947_839d_9d4526cbd0d4.slice/crio-3a4ed74848772a4744978aea96817a2a16795e9c930f61741fd5d5190839fc42 WatchSource:0}: Error finding container 3a4ed74848772a4744978aea96817a2a16795e9c930f61741fd5d5190839fc42: Status 404 returned error can't find the container with id 3a4ed74848772a4744978aea96817a2a16795e9c930f61741fd5d5190839fc42 Jun 03 20:46:47.893148 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:47.893121 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-lfp8d"] Jun 03 20:46:47.896016 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:46:47.895989 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c206b8a_2d18_41f4_83b5_67f49d8848c7.slice/crio-791a5bee8ef4b9a2405055aeb14fdc71d4ebd10874db2aacb902a65fe41d02ad WatchSource:0}: Error finding container 791a5bee8ef4b9a2405055aeb14fdc71d4ebd10874db2aacb902a65fe41d02ad: Status 404 returned error can't find the container with id 791a5bee8ef4b9a2405055aeb14fdc71d4ebd10874db2aacb902a65fe41d02ad Jun 03 20:46:48.170837 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:48.170796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:48.171049 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:48.170865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:48.171049 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:48.170899 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:48.171049 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:48.171022 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:46:48.171049 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:48.171031 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle podName:9a663e3f-2a94-475e-89de-3fa4de960eb2 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:49.171008652 +0000 UTC m=+193.769887593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle") pod "router-default-85c74bff45-m9bnm" (UID: "9a663e3f-2a94-475e-89de-3fa4de960eb2") : configmap references non-existent config key: service-ca.crt Jun 03 20:46:48.171275 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:48.171037 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78999dd999-znxzk: secret "image-registry-tls" not found Jun 03 20:46:48.171275 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:48.171022 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 20:46:48.171275 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:48.171128 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls podName:6d1440fa-a1f5-4ff2-b505-480e40d38ac4 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:49.171108066 +0000 UTC m=+193.769987020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls") pod "image-registry-78999dd999-znxzk" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4") : secret "image-registry-tls" not found Jun 03 20:46:48.171275 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:48.171162 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs podName:9a663e3f-2a94-475e-89de-3fa4de960eb2 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:49.171145758 +0000 UTC m=+193.770024715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs") pod "router-default-85c74bff45-m9bnm" (UID: "9a663e3f-2a94-475e-89de-3fa4de960eb2") : secret "router-metrics-certs-default" not found Jun 03 20:46:48.475527 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:48.475403 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" event={"ID":"b8e065fe-a286-4947-839d-9d4526cbd0d4","Type":"ContainerStarted","Data":"3a4ed74848772a4744978aea96817a2a16795e9c930f61741fd5d5190839fc42"} Jun 03 20:46:48.476933 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:48.476876 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" event={"ID":"1c206b8a-2d18-41f4-83b5-67f49d8848c7","Type":"ContainerStarted","Data":"791a5bee8ef4b9a2405055aeb14fdc71d4ebd10874db2aacb902a65fe41d02ad"} Jun 03 20:46:49.179469 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:49.179422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:49.179675 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:49.179538 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:49.179675 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:49.179577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:49.179675 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:49.179599 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:46:49.179675 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:49.179625 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78999dd999-znxzk: secret "image-registry-tls" not found Jun 03 20:46:49.179675 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:49.179669 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 20:46:49.179935 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:49.179695 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls podName:6d1440fa-a1f5-4ff2-b505-480e40d38ac4 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:51.179673285 +0000 UTC m=+195.778552246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls") pod "image-registry-78999dd999-znxzk" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4") : secret "image-registry-tls" not found Jun 03 20:46:49.179935 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:49.179715 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs podName:9a663e3f-2a94-475e-89de-3fa4de960eb2 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:51.179705073 +0000 UTC m=+195.778584026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs") pod "router-default-85c74bff45-m9bnm" (UID: "9a663e3f-2a94-475e-89de-3fa4de960eb2") : secret "router-metrics-certs-default" not found Jun 03 20:46:49.179935 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:49.179730 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle podName:9a663e3f-2a94-475e-89de-3fa4de960eb2 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:51.179721321 +0000 UTC m=+195.778600260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle") pod "router-default-85c74bff45-m9bnm" (UID: "9a663e3f-2a94-475e-89de-3fa4de960eb2") : configmap references non-existent config key: service-ca.crt Jun 03 20:46:50.483870 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:50.483831 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" event={"ID":"b8e065fe-a286-4947-839d-9d4526cbd0d4","Type":"ContainerStarted","Data":"348af521fa765feeb0fadcab84a5d17b3f702f41f80d9b3661cd4c83afaa753d"} Jun 03 20:46:50.485471 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:50.485453 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/0.log" Jun 03 20:46:50.485590 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:50.485486 2563 generic.go:356] "Generic (PLEG): container finished" podID="1c206b8a-2d18-41f4-83b5-67f49d8848c7" containerID="667bd733fad9243cf398b6cac041b6576d35c5b27003b27dda4a31675d7bd45d" exitCode=255 Jun 03 20:46:50.485590 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:50.485510 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" event={"ID":"1c206b8a-2d18-41f4-83b5-67f49d8848c7","Type":"ContainerDied","Data":"667bd733fad9243cf398b6cac041b6576d35c5b27003b27dda4a31675d7bd45d"} Jun 03 20:46:50.485779 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:50.485763 2563 scope.go:117] "RemoveContainer" containerID="667bd733fad9243cf398b6cac041b6576d35c5b27003b27dda4a31675d7bd45d" Jun 03 20:46:50.499855 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:50.499811 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" podStartSLOduration=1.448468736 podStartE2EDuration="3.499795251s" totalImagesPullingTime="2.051326515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:50.498833064 +0000 UTC m=+195.097712029" watchObservedRunningTime="2026-06-03 20:46:50.499795251 +0000 UTC m=+195.098674210" Jun 03 20:46:51.194576 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:51.194540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:51.194576 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:51.194580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:51.194840 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:51.194628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:51.194840 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:51.194716 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 20:46:51.194840 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:51.194715 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle podName:9a663e3f-2a94-475e-89de-3fa4de960eb2 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:55.194693908 +0000 UTC m=+199.793572857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle") pod "router-default-85c74bff45-m9bnm" (UID: "9a663e3f-2a94-475e-89de-3fa4de960eb2") : configmap references non-existent config key: service-ca.crt Jun 03 20:46:51.194840 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:51.194756 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:46:51.194840 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:51.194782 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78999dd999-znxzk: secret "image-registry-tls" not found Jun 03 20:46:51.194840 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:51.194763 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs podName:9a663e3f-2a94-475e-89de-3fa4de960eb2 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:55.194751172 +0000 UTC m=+199.793630111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs") pod "router-default-85c74bff45-m9bnm" (UID: "9a663e3f-2a94-475e-89de-3fa4de960eb2") : secret "router-metrics-certs-default" not found Jun 03 20:46:51.194840 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:51.194828 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls podName:6d1440fa-a1f5-4ff2-b505-480e40d38ac4 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:55.194816693 +0000 UTC m=+199.793695632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls") pod "image-registry-78999dd999-znxzk" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4") : secret "image-registry-tls" not found Jun 03 20:46:51.490023 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:51.489931 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 20:46:51.490378 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:51.490337 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/0.log" Jun 03 20:46:51.490378 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:51.490369 2563 generic.go:356] "Generic (PLEG): container finished" podID="1c206b8a-2d18-41f4-83b5-67f49d8848c7" containerID="b679942fead4f697a271250b378d1935fb0024d699866ddef670a83fdae8b99b" exitCode=255 Jun 03 20:46:51.490448 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:51.490402 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" event={"ID":"1c206b8a-2d18-41f4-83b5-67f49d8848c7","Type":"ContainerDied","Data":"b679942fead4f697a271250b378d1935fb0024d699866ddef670a83fdae8b99b"} Jun 03 20:46:51.490481 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:51.490460 2563 scope.go:117] "RemoveContainer" containerID="667bd733fad9243cf398b6cac041b6576d35c5b27003b27dda4a31675d7bd45d" Jun 03 20:46:51.490670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:51.490650 2563 scope.go:117] "RemoveContainer" containerID="b679942fead4f697a271250b378d1935fb0024d699866ddef670a83fdae8b99b" Jun 03 20:46:51.490856 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:51.490832 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-lfp8d_openshift-console-operator(1c206b8a-2d18-41f4-83b5-67f49d8848c7)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" podUID="1c206b8a-2d18-41f4-83b5-67f49d8848c7" Jun 03 20:46:52.499030 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:52.499004 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 20:46:52.499406 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:52.499309 2563 scope.go:117] "RemoveContainer" containerID="b679942fead4f697a271250b378d1935fb0024d699866ddef670a83fdae8b99b" Jun 03 20:46:52.499457 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:52.499441 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-lfp8d_openshift-console-operator(1c206b8a-2d18-41f4-83b5-67f49d8848c7)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" podUID="1c206b8a-2d18-41f4-83b5-67f49d8848c7" Jun 03 20:46:54.343386 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:54.343361 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hvb8z_4381bffc-e0ab-444d-a052-3972c1a0dbbd/dns-node-resolver/0.log" Jun 03 20:46:55.145294 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:55.145268 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g7wxk_f52cd91a-765c-4427-81c7-caa38584c1b6/node-ca/0.log" Jun 03 20:46:55.223908 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:55.223870 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:55.223908 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:55.223923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:46:55.224148 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:55.224050 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:46:55.224148 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:55.224065 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78999dd999-znxzk: secret "image-registry-tls" not found Jun 03 20:46:55.224148 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:55.224073 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle podName:9a663e3f-2a94-475e-89de-3fa4de960eb2 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:03.22405466 +0000 UTC m=+207.822933599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle") pod "router-default-85c74bff45-m9bnm" (UID: "9a663e3f-2a94-475e-89de-3fa4de960eb2") : configmap references non-existent config key: service-ca.crt Jun 03 20:46:55.224148 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:55.224108 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls podName:6d1440fa-a1f5-4ff2-b505-480e40d38ac4 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:03.224096981 +0000 UTC m=+207.822975957 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls") pod "image-registry-78999dd999-znxzk" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4") : secret "image-registry-tls" not found Jun 03 20:46:55.224281 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:55.224158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:46:55.224281 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:55.224230 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 20:46:55.224281 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:55.224261 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs podName:9a663e3f-2a94-475e-89de-3fa4de960eb2 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:03.224253437 +0000 UTC m=+207.823132377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs") pod "router-default-85c74bff45-m9bnm" (UID: "9a663e3f-2a94-475e-89de-3fa4de960eb2") : secret "router-metrics-certs-default" not found Jun 03 20:46:55.946700 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:55.946670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7n84d_fef46e08-feb6-4bd1-b811-beb040c66ec2/serve-healthcheck-canary/0.log" Jun 03 20:46:56.945532 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:56.945498 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt_b8e065fe-a286-4947-839d-9d4526cbd0d4/kube-storage-version-migrator-operator/0.log" Jun 03 20:46:57.776484 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:57.776446 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:57.776841 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:57.776507 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:46:57.776841 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:46:57.776818 2563 scope.go:117] "RemoveContainer" containerID="b679942fead4f697a271250b378d1935fb0024d699866ddef670a83fdae8b99b" Jun 03 20:46:57.777016 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:46:57.776996 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-lfp8d_openshift-console-operator(1c206b8a-2d18-41f4-83b5-67f49d8848c7)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" podUID="1c206b8a-2d18-41f4-83b5-67f49d8848c7" Jun 03 20:47:03.286851 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:03.286804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:47:03.286851 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:03.286856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:47:03.287293 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:03.286915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:47:03.287471 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:03.287449 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a663e3f-2a94-475e-89de-3fa4de960eb2-service-ca-bundle\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:47:03.289316 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:03.289291 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a663e3f-2a94-475e-89de-3fa4de960eb2-metrics-certs\") pod \"router-default-85c74bff45-m9bnm\" (UID: \"9a663e3f-2a94-475e-89de-3fa4de960eb2\") " pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:47:03.289316 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:03.289306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls\") pod \"image-registry-78999dd999-znxzk\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:47:03.384651 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:03.384605 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:47:03.389910 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:03.389884 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:47:03.520502 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:03.520466 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78999dd999-znxzk"] Jun 03 20:47:03.523859 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:47:03.523830 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1440fa_a1f5_4ff2_b505_480e40d38ac4.slice/crio-82f6ec94655cec1e086abb9465a15f2fa13a1482b5f83a507f16a25331f816ad WatchSource:0}: Error finding container 82f6ec94655cec1e086abb9465a15f2fa13a1482b5f83a507f16a25331f816ad: Status 404 returned error can't find the container with id 82f6ec94655cec1e086abb9465a15f2fa13a1482b5f83a507f16a25331f816ad Jun 03 20:47:03.528677 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:03.528650 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78999dd999-znxzk" event={"ID":"6d1440fa-a1f5-4ff2-b505-480e40d38ac4","Type":"ContainerStarted","Data":"82f6ec94655cec1e086abb9465a15f2fa13a1482b5f83a507f16a25331f816ad"} Jun 03 20:47:03.537253 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:03.537229 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85c74bff45-m9bnm"] Jun 03 20:47:03.540100 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:47:03.540069 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a663e3f_2a94_475e_89de_3fa4de960eb2.slice/crio-73b55b524777853c993dfe1f57f6c2c0b2ee3d3a3af3e3eeedca0f5701ad9c60 WatchSource:0}: Error finding container 73b55b524777853c993dfe1f57f6c2c0b2ee3d3a3af3e3eeedca0f5701ad9c60: Status 404 returned error can't find the container with id 73b55b524777853c993dfe1f57f6c2c0b2ee3d3a3af3e3eeedca0f5701ad9c60 Jun 03 20:47:04.533840 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:04.533796 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85c74bff45-m9bnm" event={"ID":"9a663e3f-2a94-475e-89de-3fa4de960eb2","Type":"ContainerStarted","Data":"46218a19787b5c08a7fb202525dab12b3c84a704688ec734a51586b3579e8e68"} Jun 03 20:47:04.534292 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:04.533866 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85c74bff45-m9bnm" event={"ID":"9a663e3f-2a94-475e-89de-3fa4de960eb2","Type":"ContainerStarted","Data":"73b55b524777853c993dfe1f57f6c2c0b2ee3d3a3af3e3eeedca0f5701ad9c60"} Jun 03 20:47:04.535259 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:04.535241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78999dd999-znxzk" event={"ID":"6d1440fa-a1f5-4ff2-b505-480e40d38ac4","Type":"ContainerStarted","Data":"285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10"} Jun 03 20:47:04.535380 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:04.535364 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:47:04.554200 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:04.554156 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85c74bff45-m9bnm" podStartSLOduration=17.554142838 podStartE2EDuration="17.554142838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:04.552618429 +0000 UTC m=+209.151497426" watchObservedRunningTime="2026-06-03 20:47:04.554142838 +0000 UTC m=+209.153021800" Jun 03 20:47:04.572768 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:04.572719 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78999dd999-znxzk" podStartSLOduration=17.572706469 podStartE2EDuration="17.572706469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:04.571600473 +0000 UTC m=+209.170479451" watchObservedRunningTime="2026-06-03 20:47:04.572706469 +0000 UTC m=+209.171585431" Jun 03 20:47:05.391028 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:05.390992 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:47:05.394432 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:05.394409 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:47:05.539469 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:05.539435 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:47:05.540532 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:05.540511 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85c74bff45-m9bnm" Jun 03 20:47:09.900084 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:09.900053 2563 scope.go:117] "RemoveContainer" containerID="b679942fead4f697a271250b378d1935fb0024d699866ddef670a83fdae8b99b" Jun 03 20:47:10.556299 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:10.556272 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 20:47:10.556473 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:10.556356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" event={"ID":"1c206b8a-2d18-41f4-83b5-67f49d8848c7","Type":"ContainerStarted","Data":"aee25f385d7248e4f6751d0e407bd269022b0c1a87fc44d7ee94deaf44bc9671"} Jun 03 20:47:10.556731 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:10.556706 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:47:10.561417 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:10.561394 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" Jun 03 20:47:10.573712 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:10.573675 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85bd8fd97d-lfp8d" podStartSLOduration=21.617631122 podStartE2EDuration="23.573663266s" totalImagesPullingTime="1.956032144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:10.573047139 +0000 UTC m=+215.171926124" watchObservedRunningTime="2026-06-03 20:47:10.573663266 +0000 UTC m=+215.172542227" Jun 03 20:47:16.168628 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.168592 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vbhs4"] Jun 03 20:47:16.171870 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.171851 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.180681 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.180658 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 20:47:16.180681 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.180670 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 20:47:16.181835 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.181810 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 20:47:16.181888 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.181849 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 20:47:16.181924 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.181897 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vxtnl\"" Jun 03 20:47:16.195052 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.195021 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbhs4"] Jun 03 20:47:16.212055 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.212030 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-56b467f5ff-w75kx"] Jun 03 20:47:16.217785 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.217765 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-w75kx" Jun 03 20:47:16.220201 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.220179 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 20:47:16.220476 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.220460 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 20:47:16.220664 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.220648 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78999dd999-znxzk"] Jun 03 20:47:16.221506 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.221487 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-njw8p\"" Jun 03 20:47:16.227577 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.227555 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-w75kx"] Jun 03 20:47:16.287595 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.287563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2lhb\" (UniqueName: \"kubernetes.io/projected/1f3337fa-5dcd-4432-88dc-fd9a7ed5f324-kube-api-access-f2lhb\") pod \"downloads-56b467f5ff-w75kx\" (UID: \"1f3337fa-5dcd-4432-88dc-fd9a7ed5f324\") " pod="openshift-console/downloads-56b467f5ff-w75kx" Jun 03 20:47:16.287742 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.287615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0410bcc3-0e5b-45e6-975e-06204dbf5c09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.287742 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.287655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0410bcc3-0e5b-45e6-975e-06204dbf5c09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.287742 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.287698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pdps\" (UniqueName: \"kubernetes.io/projected/0410bcc3-0e5b-45e6-975e-06204dbf5c09-kube-api-access-7pdps\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.287742 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.287725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0410bcc3-0e5b-45e6-975e-06204dbf5c09-data-volume\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.287879 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.287744 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0410bcc3-0e5b-45e6-975e-06204dbf5c09-crio-socket\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.388660 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.388609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pdps\" (UniqueName: \"kubernetes.io/projected/0410bcc3-0e5b-45e6-975e-06204dbf5c09-kube-api-access-7pdps\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.388660 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.388669 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0410bcc3-0e5b-45e6-975e-06204dbf5c09-data-volume\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.388932 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.388698 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0410bcc3-0e5b-45e6-975e-06204dbf5c09-crio-socket\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.388932 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.388727 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2lhb\" (UniqueName: \"kubernetes.io/projected/1f3337fa-5dcd-4432-88dc-fd9a7ed5f324-kube-api-access-f2lhb\") pod \"downloads-56b467f5ff-w75kx\" (UID: \"1f3337fa-5dcd-4432-88dc-fd9a7ed5f324\") " pod="openshift-console/downloads-56b467f5ff-w75kx" Jun 03 20:47:16.388932 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.388758 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0410bcc3-0e5b-45e6-975e-06204dbf5c09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.388932 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.388782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0410bcc3-0e5b-45e6-975e-06204dbf5c09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.388932 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.388833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0410bcc3-0e5b-45e6-975e-06204dbf5c09-crio-socket\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.389176 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.389074 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0410bcc3-0e5b-45e6-975e-06204dbf5c09-data-volume\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.389347 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.389322 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0410bcc3-0e5b-45e6-975e-06204dbf5c09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.391317 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.391288 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0410bcc3-0e5b-45e6-975e-06204dbf5c09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.396809 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.396787 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pdps\" (UniqueName: \"kubernetes.io/projected/0410bcc3-0e5b-45e6-975e-06204dbf5c09-kube-api-access-7pdps\") pod \"insights-runtime-extractor-vbhs4\" (UID: \"0410bcc3-0e5b-45e6-975e-06204dbf5c09\") " pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.397147 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.397129 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2lhb\" (UniqueName: \"kubernetes.io/projected/1f3337fa-5dcd-4432-88dc-fd9a7ed5f324-kube-api-access-f2lhb\") pod \"downloads-56b467f5ff-w75kx\" (UID: \"1f3337fa-5dcd-4432-88dc-fd9a7ed5f324\") " pod="openshift-console/downloads-56b467f5ff-w75kx" Jun 03 20:47:16.480788 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.480697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vbhs4" Jun 03 20:47:16.528589 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.528561 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-w75kx" Jun 03 20:47:16.614967 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.614633 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vbhs4"] Jun 03 20:47:16.619403 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:47:16.619369 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0410bcc3_0e5b_45e6_975e_06204dbf5c09.slice/crio-e45d54ec45c01bdd12f345a2915f15430c4cf55944de7cdc6763719480eb10e5 WatchSource:0}: Error finding container e45d54ec45c01bdd12f345a2915f15430c4cf55944de7cdc6763719480eb10e5: Status 404 returned error can't find the container with id e45d54ec45c01bdd12f345a2915f15430c4cf55944de7cdc6763719480eb10e5 Jun 03 20:47:16.665315 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:16.665290 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-w75kx"] Jun 03 20:47:16.668233 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:47:16.668209 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3337fa_5dcd_4432_88dc_fd9a7ed5f324.slice/crio-67be3d302fd1dc37688677a0e20d356255668e5d1c373d66490dc65b77a00940 WatchSource:0}: Error finding container 67be3d302fd1dc37688677a0e20d356255668e5d1c373d66490dc65b77a00940: Status 404 returned error can't find the container with id 67be3d302fd1dc37688677a0e20d356255668e5d1c373d66490dc65b77a00940 Jun 03 20:47:17.579772 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:17.579733 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-w75kx" event={"ID":"1f3337fa-5dcd-4432-88dc-fd9a7ed5f324","Type":"ContainerStarted","Data":"67be3d302fd1dc37688677a0e20d356255668e5d1c373d66490dc65b77a00940"} Jun 03 20:47:17.581720 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:17.581692 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbhs4" event={"ID":"0410bcc3-0e5b-45e6-975e-06204dbf5c09","Type":"ContainerStarted","Data":"39761c8fc3f699d38d264ed14f20234ce68a3089cbf198f8b34fee64ca40860b"} Jun 03 20:47:17.581816 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:17.581743 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbhs4" event={"ID":"0410bcc3-0e5b-45e6-975e-06204dbf5c09","Type":"ContainerStarted","Data":"b9d53da678adbe0f219b9c57002f7e25d5ceb7da81fef51df7444c73b7a7b507"} Jun 03 20:47:17.581816 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:17.581766 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbhs4" event={"ID":"0410bcc3-0e5b-45e6-975e-06204dbf5c09","Type":"ContainerStarted","Data":"e45d54ec45c01bdd12f345a2915f15430c4cf55944de7cdc6763719480eb10e5"} Jun 03 20:47:19.262749 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.262663 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5"] Jun 03 20:47:19.265987 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.265967 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.269312 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.269282 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 20:47:19.269436 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.269311 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 20:47:19.270523 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.270503 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 20:47:19.270642 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.270557 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-j5q4p\"" Jun 03 20:47:19.271548 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.271243 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 20:47:19.271548 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.271272 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 20:47:19.281152 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.281129 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5"] Jun 03 20:47:19.415155 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.414928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c4748f0-0956-4272-adc8-c3a174466aa0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.415155 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.415045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c4748f0-0956-4272-adc8-c3a174466aa0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.415155 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.415072 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99nw7\" (UniqueName: \"kubernetes.io/projected/5c4748f0-0956-4272-adc8-c3a174466aa0-kube-api-access-99nw7\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.415155 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.415099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c4748f0-0956-4272-adc8-c3a174466aa0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.516154 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.516062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c4748f0-0956-4272-adc8-c3a174466aa0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.516154 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.516145 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c4748f0-0956-4272-adc8-c3a174466aa0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.516391 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.516175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99nw7\" (UniqueName: \"kubernetes.io/projected/5c4748f0-0956-4272-adc8-c3a174466aa0-kube-api-access-99nw7\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.516391 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.516199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c4748f0-0956-4272-adc8-c3a174466aa0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.517051 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.517025 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c4748f0-0956-4272-adc8-c3a174466aa0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.519146 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.519123 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c4748f0-0956-4272-adc8-c3a174466aa0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.519294 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.519272 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c4748f0-0956-4272-adc8-c3a174466aa0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.527020 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.526963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99nw7\" (UniqueName: \"kubernetes.io/projected/5c4748f0-0956-4272-adc8-c3a174466aa0-kube-api-access-99nw7\") pod \"prometheus-operator-7f7d445d84-qx9f5\" (UID: \"5c4748f0-0956-4272-adc8-c3a174466aa0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.581736 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.581696 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" Jun 03 20:47:19.592495 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.592266 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vbhs4" event={"ID":"0410bcc3-0e5b-45e6-975e-06204dbf5c09","Type":"ContainerStarted","Data":"06a3dc11d90301790e47b2a8fb28fe2d1b2e57d1358d210504e672945cd0c3d9"} Jun 03 20:47:19.610506 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.610446 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vbhs4" podStartSLOduration=1.527101682 podStartE2EDuration="3.610422298s" totalImagesPullingTime="2.083320616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:47:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:19.60960901 +0000 UTC m=+224.208487994" watchObservedRunningTime="2026-06-03 20:47:19.610422298 +0000 UTC m=+224.209301261" Jun 03 20:47:19.725096 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:19.724979 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5"] Jun 03 20:47:19.728049 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:47:19.728018 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4748f0_0956_4272_adc8_c3a174466aa0.slice/crio-9f1d268ed8fef4b96187d4ec4eb782499dc3716c015a29a28d17cd7d2fd3626b WatchSource:0}: Error finding container 9f1d268ed8fef4b96187d4ec4eb782499dc3716c015a29a28d17cd7d2fd3626b: Status 404 returned error can't find the container with id 9f1d268ed8fef4b96187d4ec4eb782499dc3716c015a29a28d17cd7d2fd3626b Jun 03 20:47:20.597993 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:20.597904 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" event={"ID":"5c4748f0-0956-4272-adc8-c3a174466aa0","Type":"ContainerStarted","Data":"9f1d268ed8fef4b96187d4ec4eb782499dc3716c015a29a28d17cd7d2fd3626b"} Jun 03 20:47:20.869430 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:20.869347 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85997cf9-49lxp"] Jun 03 20:47:20.872962 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:20.872920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:20.876589 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:20.876566 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gqcfk\"" Jun 03 20:47:20.876589 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:20.876566 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 20:47:20.876786 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:20.876687 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 20:47:20.876845 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:20.876814 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 20:47:20.876845 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:20.876823 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 20:47:20.876958 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:20.876890 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 20:47:20.883215 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:20.883183 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85997cf9-49lxp"] Jun 03 20:47:21.029934 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.029887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-serving-cert\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.030177 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.029983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-oauth-serving-cert\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.030177 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.030030 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-oauth-config\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.030177 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.030061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprnk\" (UniqueName: \"kubernetes.io/projected/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-kube-api-access-hprnk\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.030177 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.030095 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-config\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.030177 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.030121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-service-ca\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.131381 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.131287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-oauth-serving-cert\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.131381 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.131357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-oauth-config\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.131665 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.131392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprnk\" (UniqueName: \"kubernetes.io/projected/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-kube-api-access-hprnk\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.131665 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.131426 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-config\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.131665 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.131453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-service-ca\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.131665 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.131506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-serving-cert\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.132887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.132131 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-oauth-serving-cert\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.132887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.132731 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-service-ca\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.132887 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.132849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-config\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.135534 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.135475 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-oauth-config\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.136195 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.136176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-serving-cert\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.146449 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.146417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprnk\" (UniqueName: \"kubernetes.io/projected/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-kube-api-access-hprnk\") pod \"console-85997cf9-49lxp\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.185353 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.185314 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:21.357493 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.357415 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85997cf9-49lxp"] Jun 03 20:47:21.361893 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:47:21.361865 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bbd807_7289_4e7d_ae1e_4ecdfc688aca.slice/crio-bfeec048ec89a006ab35aa9c81d5fac9b4d7ff1d4f02e147b864e2770434eb9c WatchSource:0}: Error finding container bfeec048ec89a006ab35aa9c81d5fac9b4d7ff1d4f02e147b864e2770434eb9c: Status 404 returned error can't find the container with id bfeec048ec89a006ab35aa9c81d5fac9b4d7ff1d4f02e147b864e2770434eb9c Jun 03 20:47:21.604024 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.603984 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85997cf9-49lxp" event={"ID":"69bbd807-7289-4e7d-ae1e-4ecdfc688aca","Type":"ContainerStarted","Data":"bfeec048ec89a006ab35aa9c81d5fac9b4d7ff1d4f02e147b864e2770434eb9c"} Jun 03 20:47:21.605936 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.605881 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" event={"ID":"5c4748f0-0956-4272-adc8-c3a174466aa0","Type":"ContainerStarted","Data":"6de7d39ad4177c5e11ffb5cb3598c91236d21d9387d5b4401188b373453aed16"} Jun 03 20:47:21.605936 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.605932 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" event={"ID":"5c4748f0-0956-4272-adc8-c3a174466aa0","Type":"ContainerStarted","Data":"bfe2d64ad2b412acc67f9605e3d074a78ef918fd4365bcfbfe770333ff4cdaff"} Jun 03 20:47:21.626812 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:21.626753 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-qx9f5" podStartSLOduration=1.439043345 podStartE2EDuration="2.626732225s" totalImagesPullingTime="1.18768888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:21.625203543 +0000 UTC m=+226.224082505" watchObservedRunningTime="2026-06-03 20:47:21.626732225 +0000 UTC m=+226.225611189" Jun 03 20:47:23.577522 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.577477 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97"] Jun 03 20:47:23.581036 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.581013 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.583921 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.583694 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 20:47:23.583921 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.583712 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vt4hw\"" Jun 03 20:47:23.583921 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.583733 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 20:47:23.590957 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.590873 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97"] Jun 03 20:47:23.620540 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.620509 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-frcph"] Jun 03 20:47:23.624237 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.624210 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.627117 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.627066 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 20:47:23.627244 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.627119 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 20:47:23.627352 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.627331 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c5g8v\"" Jun 03 20:47:23.627509 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.627463 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 20:47:23.654876 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.654845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.655049 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.654912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.655049 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.654961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg4t6\" (UniqueName: \"kubernetes.io/projected/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-kube-api-access-vg4t6\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.655049 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.655007 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.755763 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.755731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-textfile\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.755763 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.755767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ee6199d-5238-4d67-9c0c-266651ad194b-metrics-client-ca\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.755999 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.755798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.755999 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.755856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.755999 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.755887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg4t6\" (UniqueName: \"kubernetes.io/projected/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-kube-api-access-vg4t6\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.755999 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.755914 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ee6199d-5238-4d67-9c0c-266651ad194b-sys\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.755999 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.755976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.756209 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.756003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.756209 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.756038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-accelerators-collector-config\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.756209 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.756078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr8k4\" (UniqueName: \"kubernetes.io/projected/9ee6199d-5238-4d67-9c0c-266651ad194b-kube-api-access-gr8k4\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.756209 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.756105 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-wtmp\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.756209 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.756130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ee6199d-5238-4d67-9c0c-266651ad194b-root\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.756209 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.756162 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-tls\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.756596 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.756548 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.759154 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.759129 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.759459 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.759439 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.765357 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.765320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg4t6\" (UniqueName: \"kubernetes.io/projected/7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a-kube-api-access-vg4t6\") pod \"openshift-state-metrics-65f78d5c66-vbd97\" (UID: \"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.857237 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-accelerators-collector-config\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857237 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857194 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr8k4\" (UniqueName: \"kubernetes.io/projected/9ee6199d-5238-4d67-9c0c-266651ad194b-kube-api-access-gr8k4\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857237 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-wtmp\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857483 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ee6199d-5238-4d67-9c0c-266651ad194b-root\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857483 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-tls\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857483 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857335 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-textfile\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857483 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ee6199d-5238-4d67-9c0c-266651ad194b-metrics-client-ca\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857483 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ee6199d-5238-4d67-9c0c-266651ad194b-sys\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857483 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857445 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857765 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857480 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-wtmp\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857765 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ee6199d-5238-4d67-9c0c-266651ad194b-root\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857880 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857785 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-accelerators-collector-config\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.857880 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857862 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ee6199d-5238-4d67-9c0c-266651ad194b-sys\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.858022 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.857985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-textfile\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.858179 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.858150 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ee6199d-5238-4d67-9c0c-266651ad194b-metrics-client-ca\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.860279 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.860165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.860371 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.860288 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ee6199d-5238-4d67-9c0c-266651ad194b-node-exporter-tls\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.894618 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.893575 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" Jun 03 20:47:23.897311 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.897243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr8k4\" (UniqueName: \"kubernetes.io/projected/9ee6199d-5238-4d67-9c0c-266651ad194b-kube-api-access-gr8k4\") pod \"node-exporter-frcph\" (UID: \"9ee6199d-5238-4d67-9c0c-266651ad194b\") " pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:23.935525 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:23.935491 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-frcph" Jun 03 20:47:24.322714 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:47:24.322518 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee6199d_5238_4d67_9c0c_266651ad194b.slice/crio-cdf58ff37e489831801adbcffc84a45e4ea41dc0e202bdc19f86a5d7ca8db429 WatchSource:0}: Error finding container cdf58ff37e489831801adbcffc84a45e4ea41dc0e202bdc19f86a5d7ca8db429: Status 404 returned error can't find the container with id cdf58ff37e489831801adbcffc84a45e4ea41dc0e202bdc19f86a5d7ca8db429 Jun 03 20:47:24.459560 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:24.459479 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97"] Jun 03 20:47:24.463896 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:47:24.463866 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e54c3ad_f616_4e27_9d23_9a2b5b7cf80a.slice/crio-5c1e554c54d7561df36d434dad8ae1d015b8b7381c017ceca3bd3aaabf1db34a WatchSource:0}: Error finding container 5c1e554c54d7561df36d434dad8ae1d015b8b7381c017ceca3bd3aaabf1db34a: Status 404 returned error can't find the container with id 5c1e554c54d7561df36d434dad8ae1d015b8b7381c017ceca3bd3aaabf1db34a Jun 03 20:47:24.630657 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:24.630607 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85997cf9-49lxp" event={"ID":"69bbd807-7289-4e7d-ae1e-4ecdfc688aca","Type":"ContainerStarted","Data":"9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847"} Jun 03 20:47:24.633043 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:24.632996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" event={"ID":"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a","Type":"ContainerStarted","Data":"324976d51eefc9225750fc25e7c249e03dec50da78e4a40627c5f34a700e6909"} Jun 03 20:47:24.633180 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:24.633063 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" event={"ID":"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a","Type":"ContainerStarted","Data":"67e2125d754804542a07d1205b1d5983420df44cd81682f1338a698e23e83972"} Jun 03 20:47:24.633180 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:24.633093 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" event={"ID":"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a","Type":"ContainerStarted","Data":"5c1e554c54d7561df36d434dad8ae1d015b8b7381c017ceca3bd3aaabf1db34a"} Jun 03 20:47:24.634905 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:24.634876 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frcph" event={"ID":"9ee6199d-5238-4d67-9c0c-266651ad194b","Type":"ContainerStarted","Data":"cdf58ff37e489831801adbcffc84a45e4ea41dc0e202bdc19f86a5d7ca8db429"} Jun 03 20:47:24.651428 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:24.651374 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85997cf9-49lxp" podStartSLOduration=1.647695432 podStartE2EDuration="4.651357716s" totalImagesPullingTime="3.003662284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:24.649727677 +0000 UTC m=+229.248606640" watchObservedRunningTime="2026-06-03 20:47:24.651357716 +0000 UTC m=+229.250236677" Jun 03 20:47:25.641845 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:25.641764 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frcph" event={"ID":"9ee6199d-5238-4d67-9c0c-266651ad194b","Type":"ContainerStarted","Data":"f4363cf53bd0c151c642c8a1b5d40ad96d78ba4f26e4358d7aac0d39378d8e0c"} Jun 03 20:47:25.644683 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:25.644652 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" event={"ID":"7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a","Type":"ContainerStarted","Data":"56dad0f67c5e8d7f809f6830bd76b02c461df04548250a3c52e68e007f7ad9cf"} Jun 03 20:47:25.677871 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:25.677796 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vbd97" podStartSLOduration=1.7761671890000001 podStartE2EDuration="2.677772879s" totalImagesPullingTime="901.60569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:25.676526775 +0000 UTC m=+230.275405738" watchObservedRunningTime="2026-06-03 20:47:25.677772879 +0000 UTC m=+230.276651845" Jun 03 20:47:26.226729 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:26.226684 2563 patch_prober.go:28] interesting pod/image-registry-78999dd999-znxzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:47:26.226919 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:26.226751 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78999dd999-znxzk" podUID="6d1440fa-a1f5-4ff2-b505-480e40d38ac4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:47:26.650568 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:26.650529 2563 generic.go:356] "Generic (PLEG): container finished" podID="9ee6199d-5238-4d67-9c0c-266651ad194b" containerID="f4363cf53bd0c151c642c8a1b5d40ad96d78ba4f26e4358d7aac0d39378d8e0c" exitCode=0 Jun 03 20:47:26.651049 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:26.650641 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frcph" event={"ID":"9ee6199d-5238-4d67-9c0c-266651ad194b","Type":"ContainerDied","Data":"f4363cf53bd0c151c642c8a1b5d40ad96d78ba4f26e4358d7aac0d39378d8e0c"} Jun 03 20:47:27.657888 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:27.657850 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frcph" event={"ID":"9ee6199d-5238-4d67-9c0c-266651ad194b","Type":"ContainerStarted","Data":"5fd6770ad5caf4d10e7a9b3f01f156c23ff8c64b0b32cb4fae6e59fdc92ff713"} Jun 03 20:47:27.658347 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:27.657917 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frcph" event={"ID":"9ee6199d-5238-4d67-9c0c-266651ad194b","Type":"ContainerStarted","Data":"89c3dfc3f9c4d4852b42340af0f44f80ebd14e997f0da4df63cee230e70cbf36"} Jun 03 20:47:27.677155 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:27.677106 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-frcph" podStartSLOduration=3.42015802 podStartE2EDuration="4.67708655s" totalImagesPullingTime="1.178930439s" totalInitContainerRuntime="77.998091ms" isStatefulPod=true podCreationTimestamp="2026-06-03 20:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:27.675631259 +0000 UTC m=+232.274510249" watchObservedRunningTime="2026-06-03 20:47:27.67708655 +0000 UTC m=+232.275965513" Jun 03 20:47:28.390722 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.390690 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p"] Jun 03 20:47:28.394000 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.393974 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" Jun 03 20:47:28.396283 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.396260 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 20:47:28.396283 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.396275 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-r27x2\"" Jun 03 20:47:28.405026 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.404987 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p"] Jun 03 20:47:28.500065 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.500023 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s9b5\" (UniqueName: \"kubernetes.io/projected/4e3bc557-1fb6-41df-95a3-45303dd7bf78-kube-api-access-2s9b5\") pod \"monitoring-plugin-9b9fc658-7xv9p\" (UID: \"4e3bc557-1fb6-41df-95a3-45303dd7bf78\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" Jun 03 20:47:28.500232 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.500157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3bc557-1fb6-41df-95a3-45303dd7bf78-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-7xv9p\" (UID: \"4e3bc557-1fb6-41df-95a3-45303dd7bf78\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" Jun 03 20:47:28.601415 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.601379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s9b5\" (UniqueName: \"kubernetes.io/projected/4e3bc557-1fb6-41df-95a3-45303dd7bf78-kube-api-access-2s9b5\") pod \"monitoring-plugin-9b9fc658-7xv9p\" (UID: \"4e3bc557-1fb6-41df-95a3-45303dd7bf78\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" Jun 03 20:47:28.601591 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.601496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3bc557-1fb6-41df-95a3-45303dd7bf78-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-7xv9p\" (UID: \"4e3bc557-1fb6-41df-95a3-45303dd7bf78\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" Jun 03 20:47:28.604093 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.604069 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3bc557-1fb6-41df-95a3-45303dd7bf78-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-7xv9p\" (UID: \"4e3bc557-1fb6-41df-95a3-45303dd7bf78\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" Jun 03 20:47:28.611055 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.611029 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s9b5\" (UniqueName: \"kubernetes.io/projected/4e3bc557-1fb6-41df-95a3-45303dd7bf78-kube-api-access-2s9b5\") pod \"monitoring-plugin-9b9fc658-7xv9p\" (UID: \"4e3bc557-1fb6-41df-95a3-45303dd7bf78\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" Jun 03 20:47:28.705842 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:28.705750 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" Jun 03 20:47:31.185645 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:31.185614 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:31.186083 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:31.185682 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:47:31.187145 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:31.187120 2563 patch_prober.go:28] interesting pod/console-85997cf9-49lxp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jun 03 20:47:31.187278 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:31.187170 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85997cf9-49lxp" podUID="69bbd807-7289-4e7d-ae1e-4ecdfc688aca" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jun 03 20:47:34.003335 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:34.003287 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p"] Jun 03 20:47:34.005645 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:47:34.005619 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e3bc557_1fb6_41df_95a3_45303dd7bf78.slice/crio-64786b97de8c44ccb0753e86ebc08a5e3e468b72986a37acf6bf0c880ca95f19 WatchSource:0}: Error finding container 64786b97de8c44ccb0753e86ebc08a5e3e468b72986a37acf6bf0c880ca95f19: Status 404 returned error can't find the container with id 64786b97de8c44ccb0753e86ebc08a5e3e468b72986a37acf6bf0c880ca95f19 Jun 03 20:47:34.690747 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:34.690668 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" event={"ID":"4e3bc557-1fb6-41df-95a3-45303dd7bf78","Type":"ContainerStarted","Data":"64786b97de8c44ccb0753e86ebc08a5e3e468b72986a37acf6bf0c880ca95f19"} Jun 03 20:47:34.693997 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:34.692839 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-w75kx" event={"ID":"1f3337fa-5dcd-4432-88dc-fd9a7ed5f324","Type":"ContainerStarted","Data":"5672cccd449a5791f9015ca5119c19caf4898256af85dc4a0b3efa71fdb859c4"} Jun 03 20:47:34.693997 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:34.693920 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-56b467f5ff-w75kx" Jun 03 20:47:34.707835 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:34.707772 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-56b467f5ff-w75kx" Jun 03 20:47:34.716432 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:34.713732 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-56b467f5ff-w75kx" podStartSLOduration=1.395731289 podStartE2EDuration="18.713714879s" totalImagesPullingTime="17.31798359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:34.711 +0000 UTC m=+239.309878962" watchObservedRunningTime="2026-06-03 20:47:34.713714879 +0000 UTC m=+239.312593832" Jun 03 20:47:35.699050 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:35.698935 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" event={"ID":"4e3bc557-1fb6-41df-95a3-45303dd7bf78","Type":"ContainerStarted","Data":"71cec30af93da657832264461cd780a7e4f0f58f7819b67e590eb613254c0e45"} Jun 03 20:47:35.699050 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:35.699031 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" Jun 03 20:47:35.709027 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:35.709001 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" Jun 03 20:47:35.717908 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:35.717859 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-9b9fc658-7xv9p" podStartSLOduration=6.28763356 podStartE2EDuration="7.717835086s" totalImagesPullingTime="1.430201526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:35.71690184 +0000 UTC m=+240.315780803" watchObservedRunningTime="2026-06-03 20:47:35.717835086 +0000 UTC m=+240.316714059" Jun 03 20:47:36.226819 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:36.226779 2563 patch_prober.go:28] interesting pod/image-registry-78999dd999-znxzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:47:36.227023 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:36.226843 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78999dd999-znxzk" podUID="6d1440fa-a1f5-4ff2-b505-480e40d38ac4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:47:41.186042 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.185999 2563 patch_prober.go:28] interesting pod/console-85997cf9-49lxp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jun 03 20:47:41.186543 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.186062 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85997cf9-49lxp" podUID="69bbd807-7289-4e7d-ae1e-4ecdfc688aca" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jun 03 20:47:41.241363 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.241295 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78999dd999-znxzk" podUID="6d1440fa-a1f5-4ff2-b505-480e40d38ac4" containerName="registry" containerID="cri-o://285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10" gracePeriod=30 Jun 03 20:47:41.527130 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.527107 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:47:41.616548 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.616515 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-trusted-ca\") pod \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " Jun 03 20:47:41.616723 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.616554 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-ca-trust-extracted\") pod \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " Jun 03 20:47:41.616723 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.616577 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-certificates\") pod \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " Jun 03 20:47:41.616723 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.616608 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-image-registry-private-configuration\") pod \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " Jun 03 20:47:41.616893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.616731 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-bound-sa-token\") pod \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " Jun 03 20:47:41.616893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.616804 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs2dc\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-kube-api-access-bs2dc\") pod \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " Jun 03 20:47:41.616893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.616844 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls\") pod \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " Jun 03 20:47:41.617077 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.616976 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6d1440fa-a1f5-4ff2-b505-480e40d38ac4" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:47:41.617129 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.617112 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-trusted-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:47:41.617753 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.617727 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6d1440fa-a1f5-4ff2-b505-480e40d38ac4" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:47:41.619406 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.619362 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6d1440fa-a1f5-4ff2-b505-480e40d38ac4" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:47:41.619635 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.619610 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6d1440fa-a1f5-4ff2-b505-480e40d38ac4" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:47:41.619747 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.619632 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6d1440fa-a1f5-4ff2-b505-480e40d38ac4" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:47:41.619747 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.619695 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-kube-api-access-bs2dc" (OuterVolumeSpecName: "kube-api-access-bs2dc") pod "6d1440fa-a1f5-4ff2-b505-480e40d38ac4" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4"). InnerVolumeSpecName "kube-api-access-bs2dc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:47:41.627462 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.627430 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6d1440fa-a1f5-4ff2-b505-480e40d38ac4" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:47:41.717934 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.717892 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-installation-pull-secrets\") pod \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\" (UID: \"6d1440fa-a1f5-4ff2-b505-480e40d38ac4\") " Jun 03 20:47:41.718207 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.718179 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs2dc\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-kube-api-access-bs2dc\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:47:41.718207 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.718208 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:47:41.718371 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.718222 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-ca-trust-extracted\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:47:41.718371 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.718234 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-registry-certificates\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:47:41.718371 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.718246 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-image-registry-private-configuration\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:47:41.718371 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.718260 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-bound-sa-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:47:41.720384 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.720352 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6d1440fa-a1f5-4ff2-b505-480e40d38ac4" (UID: "6d1440fa-a1f5-4ff2-b505-480e40d38ac4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:47:41.723701 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.723678 2563 generic.go:356] "Generic (PLEG): container finished" podID="6d1440fa-a1f5-4ff2-b505-480e40d38ac4" containerID="285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10" exitCode=0 Jun 03 20:47:41.723804 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.723721 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78999dd999-znxzk" Jun 03 20:47:41.723804 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.723763 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78999dd999-znxzk" event={"ID":"6d1440fa-a1f5-4ff2-b505-480e40d38ac4","Type":"ContainerDied","Data":"285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10"} Jun 03 20:47:41.723891 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.723811 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78999dd999-znxzk" event={"ID":"6d1440fa-a1f5-4ff2-b505-480e40d38ac4","Type":"ContainerDied","Data":"82f6ec94655cec1e086abb9465a15f2fa13a1482b5f83a507f16a25331f816ad"} Jun 03 20:47:41.723891 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.723838 2563 scope.go:117] "RemoveContainer" containerID="285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10" Jun 03 20:47:41.733432 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.733411 2563 scope.go:117] "RemoveContainer" containerID="285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10" Jun 03 20:47:41.733738 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:47:41.733712 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10\": container with ID starting with 285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10 not found: ID does not exist" containerID="285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10" Jun 03 20:47:41.733836 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.733750 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10"} err="failed to get container status \"285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10\": rpc error: code = NotFound desc = could not find container \"285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10\": container with ID starting with 285ad34a43242aa5f87f31a794e7168eac997aac1f1cc4982dce86d9eca26b10 not found: ID does not exist" Jun 03 20:47:41.746526 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.746476 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78999dd999-znxzk"] Jun 03 20:47:41.750476 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.750450 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78999dd999-znxzk"] Jun 03 20:47:41.819663 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.819628 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6d1440fa-a1f5-4ff2-b505-480e40d38ac4-installation-pull-secrets\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:47:41.905467 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:41.905434 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d1440fa-a1f5-4ff2-b505-480e40d38ac4" path="/var/lib/kubelet/pods/6d1440fa-a1f5-4ff2-b505-480e40d38ac4/volumes" Jun 03 20:47:47.770140 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:47.770098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:47:47.772395 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:47.772365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d60725-a1d1-401e-a46c-d2d874ec1693-metrics-certs\") pod \"network-metrics-daemon-cjp9g\" (UID: \"a4d60725-a1d1-401e-a46c-d2d874ec1693\") " pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:47:48.003732 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:48.003701 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kg9x\"" Jun 03 20:47:48.011728 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:48.011706 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjp9g" Jun 03 20:47:48.171999 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:48.171977 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cjp9g"] Jun 03 20:47:48.174304 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:47:48.174284 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d60725_a1d1_401e_a46c_d2d874ec1693.slice/crio-5ca8193628e9664a99939c1e0c9e99a47aeedb028c986d41e8d4f4e3f4122235 WatchSource:0}: Error finding container 5ca8193628e9664a99939c1e0c9e99a47aeedb028c986d41e8d4f4e3f4122235: Status 404 returned error can't find the container with id 5ca8193628e9664a99939c1e0c9e99a47aeedb028c986d41e8d4f4e3f4122235 Jun 03 20:47:48.750126 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:48.750081 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cjp9g" event={"ID":"a4d60725-a1d1-401e-a46c-d2d874ec1693","Type":"ContainerStarted","Data":"5ca8193628e9664a99939c1e0c9e99a47aeedb028c986d41e8d4f4e3f4122235"} Jun 03 20:47:49.755906 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:49.755860 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cjp9g" event={"ID":"a4d60725-a1d1-401e-a46c-d2d874ec1693","Type":"ContainerStarted","Data":"7876c8c6d74d0df49442a0c81ac1cda5781ebf2eb3e9289730acbad043a08691"} Jun 03 20:47:50.762746 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:50.762710 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cjp9g" event={"ID":"a4d60725-a1d1-401e-a46c-d2d874ec1693","Type":"ContainerStarted","Data":"7f4c2282545e907321f13b453ffe0de535343e6b312ea05e96f24ae6dfe9c150"} Jun 03 20:47:50.778614 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:50.778569 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cjp9g" podStartSLOduration=253.398072612 podStartE2EDuration="4m14.778554265s" totalImagesPullingTime="1.380481653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:50.777091304 +0000 UTC m=+255.375970265" watchObservedRunningTime="2026-06-03 20:47:50.778554265 +0000 UTC m=+255.377433227" Jun 03 20:47:51.186024 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:51.185991 2563 patch_prober.go:28] interesting pod/console-85997cf9-49lxp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jun 03 20:47:51.186230 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:47:51.186042 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85997cf9-49lxp" podUID="69bbd807-7289-4e7d-ae1e-4ecdfc688aca" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jun 03 20:48:01.186245 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:01.186158 2563 patch_prober.go:28] interesting pod/console-85997cf9-49lxp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jun 03 20:48:01.186245 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:01.186214 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85997cf9-49lxp" podUID="69bbd807-7289-4e7d-ae1e-4ecdfc688aca" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jun 03 20:48:11.186515 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:11.186474 2563 patch_prober.go:28] interesting pod/console-85997cf9-49lxp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jun 03 20:48:11.187001 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:11.186525 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85997cf9-49lxp" podUID="69bbd807-7289-4e7d-ae1e-4ecdfc688aca" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jun 03 20:48:16.388704 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:48:16.388656 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w9jpb" podUID="644071d7-1aca-4adc-ae34-91ef0eb3ccad" Jun 03 20:48:16.850474 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:16.850443 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9jpb" Jun 03 20:48:19.042700 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:19.042668 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85997cf9-49lxp"] Jun 03 20:48:19.625388 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:19.625340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:48:19.627673 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:19.627644 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/644071d7-1aca-4adc-ae34-91ef0eb3ccad-metrics-tls\") pod \"dns-default-w9jpb\" (UID: \"644071d7-1aca-4adc-ae34-91ef0eb3ccad\") " pod="openshift-dns/dns-default-w9jpb" Jun 03 20:48:19.853959 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:19.853909 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d78km\"" Jun 03 20:48:19.862157 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:19.862124 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9jpb" Jun 03 20:48:20.022712 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:20.022682 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w9jpb"] Jun 03 20:48:20.025904 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:48:20.025877 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644071d7_1aca_4adc_ae34_91ef0eb3ccad.slice/crio-049069e8a6285239a99e61902fa89f30d66a0d2c681cead02ab27fc951f9271e WatchSource:0}: Error finding container 049069e8a6285239a99e61902fa89f30d66a0d2c681cead02ab27fc951f9271e: Status 404 returned error can't find the container with id 049069e8a6285239a99e61902fa89f30d66a0d2c681cead02ab27fc951f9271e Jun 03 20:48:20.868415 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:20.868383 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9jpb" event={"ID":"644071d7-1aca-4adc-ae34-91ef0eb3ccad","Type":"ContainerStarted","Data":"049069e8a6285239a99e61902fa89f30d66a0d2c681cead02ab27fc951f9271e"} Jun 03 20:48:21.873837 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:21.873744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9jpb" event={"ID":"644071d7-1aca-4adc-ae34-91ef0eb3ccad","Type":"ContainerStarted","Data":"7e07509ff8f08d91f915e6f1c78cf7a3e83af62d8e06961a78b61f76c95c6ccb"} Jun 03 20:48:21.873837 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:21.873799 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9jpb" event={"ID":"644071d7-1aca-4adc-ae34-91ef0eb3ccad","Type":"ContainerStarted","Data":"2ebd2b420aed12c7e22ac22098aa5f689a110695c45938f12fbeab8f32aec7ac"} Jun 03 20:48:21.874331 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:21.873865 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w9jpb" Jun 03 20:48:21.875298 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:21.875277 2563 generic.go:356] "Generic (PLEG): container finished" podID="b8e065fe-a286-4947-839d-9d4526cbd0d4" containerID="348af521fa765feeb0fadcab84a5d17b3f702f41f80d9b3661cd4c83afaa753d" exitCode=0 Jun 03 20:48:21.875393 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:21.875334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" event={"ID":"b8e065fe-a286-4947-839d-9d4526cbd0d4","Type":"ContainerDied","Data":"348af521fa765feeb0fadcab84a5d17b3f702f41f80d9b3661cd4c83afaa753d"} Jun 03 20:48:21.875576 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:21.875563 2563 scope.go:117] "RemoveContainer" containerID="348af521fa765feeb0fadcab84a5d17b3f702f41f80d9b3661cd4c83afaa753d" Jun 03 20:48:21.890094 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:21.890050 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w9jpb" podStartSLOduration=251.326917244 podStartE2EDuration="4m12.890030912s" totalImagesPullingTime="1.563113668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:48:21.889221327 +0000 UTC m=+286.488100291" watchObservedRunningTime="2026-06-03 20:48:21.890030912 +0000 UTC m=+286.488909870" Jun 03 20:48:22.882710 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:22.882317 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt" event={"ID":"b8e065fe-a286-4947-839d-9d4526cbd0d4","Type":"ContainerStarted","Data":"0ff89a5e05db62f50889e572a05e09a3067de4ee8c79bea6cb40f9867ec345d0"} Jun 03 20:48:31.884726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:31.884695 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w9jpb" Jun 03 20:48:35.851280 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:35.851255 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 20:48:35.851626 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:35.851318 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 20:48:35.862684 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:35.862665 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 20:48:44.062402 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.062360 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85997cf9-49lxp" podUID="69bbd807-7289-4e7d-ae1e-4ecdfc688aca" containerName="console" containerID="cri-o://9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847" gracePeriod=15 Jun 03 20:48:44.302717 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.302695 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:48:44.323978 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.323882 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-oauth-serving-cert\") pod \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " Jun 03 20:48:44.323978 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.323927 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-serving-cert\") pod \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " Jun 03 20:48:44.323978 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.323976 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-config\") pod \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " Jun 03 20:48:44.324195 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.324011 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-oauth-config\") pod \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " Jun 03 20:48:44.324195 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.324081 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-service-ca\") pod \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " Jun 03 20:48:44.324195 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.324106 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hprnk\" (UniqueName: \"kubernetes.io/projected/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-kube-api-access-hprnk\") pod \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\" (UID: \"69bbd807-7289-4e7d-ae1e-4ecdfc688aca\") " Jun 03 20:48:44.324350 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.324297 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "69bbd807-7289-4e7d-ae1e-4ecdfc688aca" (UID: "69bbd807-7289-4e7d-ae1e-4ecdfc688aca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:44.324477 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.324447 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-config" (OuterVolumeSpecName: "console-config") pod "69bbd807-7289-4e7d-ae1e-4ecdfc688aca" (UID: "69bbd807-7289-4e7d-ae1e-4ecdfc688aca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:44.324588 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.324560 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-service-ca" (OuterVolumeSpecName: "service-ca") pod "69bbd807-7289-4e7d-ae1e-4ecdfc688aca" (UID: "69bbd807-7289-4e7d-ae1e-4ecdfc688aca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:44.326476 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.326426 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "69bbd807-7289-4e7d-ae1e-4ecdfc688aca" (UID: "69bbd807-7289-4e7d-ae1e-4ecdfc688aca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:44.326476 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.326431 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-kube-api-access-hprnk" (OuterVolumeSpecName: "kube-api-access-hprnk") pod "69bbd807-7289-4e7d-ae1e-4ecdfc688aca" (UID: "69bbd807-7289-4e7d-ae1e-4ecdfc688aca"). InnerVolumeSpecName "kube-api-access-hprnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:48:44.326650 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.326506 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "69bbd807-7289-4e7d-ae1e-4ecdfc688aca" (UID: "69bbd807-7289-4e7d-ae1e-4ecdfc688aca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:44.425093 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.425052 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-oauth-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:48:44.425093 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.425087 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:48:44.425093 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.425100 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hprnk\" (UniqueName: \"kubernetes.io/projected/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-kube-api-access-hprnk\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:48:44.425325 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.425113 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-oauth-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:48:44.425325 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.425125 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:48:44.425325 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.425138 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69bbd807-7289-4e7d-ae1e-4ecdfc688aca-console-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:48:44.959381 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.959345 2563 generic.go:356] "Generic (PLEG): container finished" podID="69bbd807-7289-4e7d-ae1e-4ecdfc688aca" containerID="9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847" exitCode=0 Jun 03 20:48:44.959550 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.959388 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85997cf9-49lxp" Jun 03 20:48:44.959550 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.959435 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85997cf9-49lxp" event={"ID":"69bbd807-7289-4e7d-ae1e-4ecdfc688aca","Type":"ContainerDied","Data":"9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847"} Jun 03 20:48:44.959550 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.959483 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85997cf9-49lxp" event={"ID":"69bbd807-7289-4e7d-ae1e-4ecdfc688aca","Type":"ContainerDied","Data":"bfeec048ec89a006ab35aa9c81d5fac9b4d7ff1d4f02e147b864e2770434eb9c"} Jun 03 20:48:44.959550 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.959503 2563 scope.go:117] "RemoveContainer" containerID="9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847" Jun 03 20:48:44.968731 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.968711 2563 scope.go:117] "RemoveContainer" containerID="9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847" Jun 03 20:48:44.969019 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:48:44.968993 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847\": container with ID starting with 9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847 not found: ID does not exist" containerID="9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847" Jun 03 20:48:44.969077 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.969030 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847"} err="failed to get container status \"9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847\": rpc error: code = NotFound desc = could not find container \"9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847\": container with ID starting with 9fe1194dd662001987862da6aa002e96dc0c8f10f0ee7f562322d7e1465a5847 not found: ID does not exist" Jun 03 20:48:44.979428 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.979394 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85997cf9-49lxp"] Jun 03 20:48:44.983417 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:44.983395 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85997cf9-49lxp"] Jun 03 20:48:45.905601 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:45.905568 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69bbd807-7289-4e7d-ae1e-4ecdfc688aca" path="/var/lib/kubelet/pods/69bbd807-7289-4e7d-ae1e-4ecdfc688aca/volumes" Jun 03 20:48:47.932845 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.932811 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-64c66f54c4-hntz4"] Jun 03 20:48:47.933794 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.933773 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69bbd807-7289-4e7d-ae1e-4ecdfc688aca" containerName="console" Jun 03 20:48:47.933925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.933914 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="69bbd807-7289-4e7d-ae1e-4ecdfc688aca" containerName="console" Jun 03 20:48:47.934052 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.934042 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d1440fa-a1f5-4ff2-b505-480e40d38ac4" containerName="registry" Jun 03 20:48:47.934136 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.934127 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d1440fa-a1f5-4ff2-b505-480e40d38ac4" containerName="registry" Jun 03 20:48:47.934299 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.934289 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d1440fa-a1f5-4ff2-b505-480e40d38ac4" containerName="registry" Jun 03 20:48:47.934391 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.934382 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="69bbd807-7289-4e7d-ae1e-4ecdfc688aca" containerName="console" Jun 03 20:48:47.937876 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.937856 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:47.940816 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.940793 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-npqbl\"" Jun 03 20:48:47.941061 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.941040 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 20:48:47.941240 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.941221 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 20:48:47.941359 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.940845 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 20:48:47.941479 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.941396 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 20:48:47.941955 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.941916 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 20:48:47.948012 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.947992 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64c66f54c4-hntz4"] Jun 03 20:48:47.950180 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.950152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-federate-client-tls\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:47.950285 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.950236 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/225fc59e-6d41-41fb-81fe-f17f5692db94-metrics-client-ca\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:47.950340 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.950288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:47.950340 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.950329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/225fc59e-6d41-41fb-81fe-f17f5692db94-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:47.950469 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.950357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/225fc59e-6d41-41fb-81fe-f17f5692db94-serving-certs-ca-bundle\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:47.950469 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.950404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-telemeter-client-tls\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:47.950469 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.950434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-secret-telemeter-client\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:47.950469 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.950457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grr8t\" (UniqueName: \"kubernetes.io/projected/225fc59e-6d41-41fb-81fe-f17f5692db94-kube-api-access-grr8t\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:47.956248 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:47.953621 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 20:48:48.050836 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.050802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/225fc59e-6d41-41fb-81fe-f17f5692db94-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.050836 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.050837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/225fc59e-6d41-41fb-81fe-f17f5692db94-serving-certs-ca-bundle\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.051101 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.050861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-telemeter-client-tls\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.051101 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.050888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-secret-telemeter-client\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.051101 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.050912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grr8t\" (UniqueName: \"kubernetes.io/projected/225fc59e-6d41-41fb-81fe-f17f5692db94-kube-api-access-grr8t\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.051101 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.050976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-federate-client-tls\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.051445 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.051361 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/225fc59e-6d41-41fb-81fe-f17f5692db94-metrics-client-ca\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.051518 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.051502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.052254 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.052224 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/225fc59e-6d41-41fb-81fe-f17f5692db94-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.052365 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.052224 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/225fc59e-6d41-41fb-81fe-f17f5692db94-serving-certs-ca-bundle\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.055046 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.052710 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/225fc59e-6d41-41fb-81fe-f17f5692db94-metrics-client-ca\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.055046 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.054353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.058048 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.055607 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-federate-client-tls\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.059011 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.058980 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-telemeter-client-tls\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.059231 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.059211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/225fc59e-6d41-41fb-81fe-f17f5692db94-secret-telemeter-client\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.061016 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.060996 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grr8t\" (UniqueName: \"kubernetes.io/projected/225fc59e-6d41-41fb-81fe-f17f5692db94-kube-api-access-grr8t\") pod \"telemeter-client-64c66f54c4-hntz4\" (UID: \"225fc59e-6d41-41fb-81fe-f17f5692db94\") " pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.258494 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.258405 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" Jun 03 20:48:48.417638 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.417603 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64c66f54c4-hntz4"] Jun 03 20:48:48.420692 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:48:48.420661 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod225fc59e_6d41_41fb_81fe_f17f5692db94.slice/crio-cbf790d44c4752978cc850fe293101ec7a3cef13ac851fab9def57d16780e4ce WatchSource:0}: Error finding container cbf790d44c4752978cc850fe293101ec7a3cef13ac851fab9def57d16780e4ce: Status 404 returned error can't find the container with id cbf790d44c4752978cc850fe293101ec7a3cef13ac851fab9def57d16780e4ce Jun 03 20:48:48.422586 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.422569 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:48:48.976429 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:48.976387 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" event={"ID":"225fc59e-6d41-41fb-81fe-f17f5692db94","Type":"ContainerStarted","Data":"cbf790d44c4752978cc850fe293101ec7a3cef13ac851fab9def57d16780e4ce"} Jun 03 20:48:49.981560 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:49.981522 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" event={"ID":"225fc59e-6d41-41fb-81fe-f17f5692db94","Type":"ContainerStarted","Data":"84b7cc7592e34fbbcf9915559f5c64f807498f7472cdafc81e9aa8aeaf26a6ea"} Jun 03 20:48:50.987174 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:50.987139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" event={"ID":"225fc59e-6d41-41fb-81fe-f17f5692db94","Type":"ContainerStarted","Data":"7edf67411c92d00b3306f5196c8abf5b9d61c1d0b0b19ba74d60d9a305ba671a"} Jun 03 20:48:50.987581 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:50.987202 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" event={"ID":"225fc59e-6d41-41fb-81fe-f17f5692db94","Type":"ContainerStarted","Data":"dcee6884e87fffc6f0d7d0537e161643882704a4c7d9e47c74a79e4dec05d3a2"} Jun 03 20:48:51.010053 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.010004 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-64c66f54c4-hntz4" podStartSLOduration=1.7129473160000002 podStartE2EDuration="4.009986784s" totalImagesPullingTime="2.297039468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:48:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:48:51.009180179 +0000 UTC m=+315.608059141" watchObservedRunningTime="2026-06-03 20:48:51.009986784 +0000 UTC m=+315.608865763" Jun 03 20:48:51.562149 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.562119 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bf9c4cd9c-v2zzq"] Jun 03 20:48:51.564343 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.564322 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.567057 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.567016 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gqcfk\"" Jun 03 20:48:51.567186 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.567087 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 20:48:51.567186 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.567093 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 20:48:51.567186 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.567112 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 20:48:51.568116 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.568098 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 20:48:51.568238 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.568213 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 20:48:51.573324 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.573304 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 20:48:51.574935 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.574914 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf9c4cd9c-v2zzq"] Jun 03 20:48:51.577594 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.577568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-serving-cert\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.577717 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.577606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-config\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.577717 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.577675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hd8\" (UniqueName: \"kubernetes.io/projected/c7aeabca-d096-4135-b2f3-83cd7ce63083-kube-api-access-42hd8\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.577830 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.577731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-trusted-ca-bundle\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.577830 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.577767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-oauth-serving-cert\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.577830 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.577805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-oauth-config\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.577987 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.577870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-service-ca\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.678874 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.678836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hd8\" (UniqueName: \"kubernetes.io/projected/c7aeabca-d096-4135-b2f3-83cd7ce63083-kube-api-access-42hd8\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.679093 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.678907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-trusted-ca-bundle\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.679093 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.678969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-oauth-serving-cert\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.679093 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.679002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-oauth-config\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.679093 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.679035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-service-ca\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.679300 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.679093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-serving-cert\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.679300 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.679117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-config\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.679867 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.679808 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-oauth-serving-cert\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.680006 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.679879 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-service-ca\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.680006 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.679929 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-trusted-ca-bundle\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.680006 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.679929 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-config\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.681584 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.681559 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-oauth-config\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.681664 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.681628 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-serving-cert\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.687488 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.687467 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hd8\" (UniqueName: \"kubernetes.io/projected/c7aeabca-d096-4135-b2f3-83cd7ce63083-kube-api-access-42hd8\") pod \"console-7bf9c4cd9c-v2zzq\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:51.876035 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:51.875930 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:48:52.034428 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:52.034392 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf9c4cd9c-v2zzq"] Jun 03 20:48:52.038783 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:48:52.038745 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7aeabca_d096_4135_b2f3_83cd7ce63083.slice/crio-64ef4020ea4e0b6bb54637ebfdcf1bc1b0e692a1913ddfe5c9379f0393110a6c WatchSource:0}: Error finding container 64ef4020ea4e0b6bb54637ebfdcf1bc1b0e692a1913ddfe5c9379f0393110a6c: Status 404 returned error can't find the container with id 64ef4020ea4e0b6bb54637ebfdcf1bc1b0e692a1913ddfe5c9379f0393110a6c Jun 03 20:48:52.999913 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:52.999875 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf9c4cd9c-v2zzq" event={"ID":"c7aeabca-d096-4135-b2f3-83cd7ce63083","Type":"ContainerStarted","Data":"e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b"} Jun 03 20:48:53.000113 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:52.999924 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf9c4cd9c-v2zzq" event={"ID":"c7aeabca-d096-4135-b2f3-83cd7ce63083","Type":"ContainerStarted","Data":"64ef4020ea4e0b6bb54637ebfdcf1bc1b0e692a1913ddfe5c9379f0393110a6c"} Jun 03 20:48:53.021570 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:48:53.021522 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bf9c4cd9c-v2zzq" podStartSLOduration=2.021507587 podStartE2EDuration="2.021507587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:48:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:48:53.021296036 +0000 UTC m=+317.620174997" watchObservedRunningTime="2026-06-03 20:48:53.021507587 +0000 UTC m=+317.620386548" Jun 03 20:49:01.876346 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:49:01.876301 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:49:01.876800 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:49:01.876380 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:49:01.880882 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:49:01.880858 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:49:02.037263 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:49:02.037235 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:50:10.569384 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.569350 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b74d844d4-qhhmg"] Jun 03 20:50:10.572698 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.572675 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.584497 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.584471 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b74d844d4-qhhmg"] Jun 03 20:50:10.604484 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.604448 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-console-config\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.604724 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.604696 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-serving-cert\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.604850 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.604783 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-oauth-config\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.604850 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.604829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-oauth-serving-cert\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.605029 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.604854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvfg7\" (UniqueName: \"kubernetes.io/projected/44acf114-425f-4196-a892-36b21955a3d6-kube-api-access-vvfg7\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.605029 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.604895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-service-ca\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.605029 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.604926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-trusted-ca-bundle\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.706321 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.706285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-oauth-config\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.706321 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.706324 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-oauth-serving-cert\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.706567 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.706341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvfg7\" (UniqueName: \"kubernetes.io/projected/44acf114-425f-4196-a892-36b21955a3d6-kube-api-access-vvfg7\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.706567 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.706364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-service-ca\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.706567 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.706396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-trusted-ca-bundle\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.706567 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.706418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-console-config\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.706567 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.706443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-serving-cert\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.707198 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.707172 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-oauth-serving-cert\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.707380 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.707351 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-console-config\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.707519 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.707256 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-service-ca\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.707610 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.707586 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-trusted-ca-bundle\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.709066 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.709043 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-oauth-config\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.709468 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.709446 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-serving-cert\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.716252 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.716231 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvfg7\" (UniqueName: \"kubernetes.io/projected/44acf114-425f-4196-a892-36b21955a3d6-kube-api-access-vvfg7\") pod \"console-b74d844d4-qhhmg\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:10.883719 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:10.883628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:11.010120 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:11.010091 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b74d844d4-qhhmg"] Jun 03 20:50:11.012874 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:50:11.012850 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44acf114_425f_4196_a892_36b21955a3d6.slice/crio-4631ebd42b8f97bc5ddcb00762226316315c188171553ef79333675b4944a972 WatchSource:0}: Error finding container 4631ebd42b8f97bc5ddcb00762226316315c188171553ef79333675b4944a972: Status 404 returned error can't find the container with id 4631ebd42b8f97bc5ddcb00762226316315c188171553ef79333675b4944a972 Jun 03 20:50:11.276423 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:11.276390 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b74d844d4-qhhmg" event={"ID":"44acf114-425f-4196-a892-36b21955a3d6","Type":"ContainerStarted","Data":"3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396"} Jun 03 20:50:11.276593 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:11.276445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b74d844d4-qhhmg" event={"ID":"44acf114-425f-4196-a892-36b21955a3d6","Type":"ContainerStarted","Data":"4631ebd42b8f97bc5ddcb00762226316315c188171553ef79333675b4944a972"} Jun 03 20:50:20.884132 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:20.884076 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:20.884132 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:20.884146 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:20.888856 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:20.888835 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:20.910790 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:20.910746 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b74d844d4-qhhmg" podStartSLOduration=10.910734123 podStartE2EDuration="10.910734123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:50:11.293186995 +0000 UTC m=+395.892065975" watchObservedRunningTime="2026-06-03 20:50:20.910734123 +0000 UTC m=+405.509613085" Jun 03 20:50:21.316541 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:21.316517 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:50:21.360988 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:21.360920 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf9c4cd9c-v2zzq"] Jun 03 20:50:46.386732 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.386671 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bf9c4cd9c-v2zzq" podUID="c7aeabca-d096-4135-b2f3-83cd7ce63083" containerName="console" containerID="cri-o://e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b" gracePeriod=15 Jun 03 20:50:46.628060 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.628038 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:50:46.802389 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.802362 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-oauth-config\") pod \"c7aeabca-d096-4135-b2f3-83cd7ce63083\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " Jun 03 20:50:46.802559 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.802402 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-trusted-ca-bundle\") pod \"c7aeabca-d096-4135-b2f3-83cd7ce63083\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " Jun 03 20:50:46.802559 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.802437 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-serving-cert\") pod \"c7aeabca-d096-4135-b2f3-83cd7ce63083\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " Jun 03 20:50:46.802559 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.802474 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42hd8\" (UniqueName: \"kubernetes.io/projected/c7aeabca-d096-4135-b2f3-83cd7ce63083-kube-api-access-42hd8\") pod \"c7aeabca-d096-4135-b2f3-83cd7ce63083\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " Jun 03 20:50:46.802559 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.802505 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-service-ca\") pod \"c7aeabca-d096-4135-b2f3-83cd7ce63083\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " Jun 03 20:50:46.802559 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.802545 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-config\") pod \"c7aeabca-d096-4135-b2f3-83cd7ce63083\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " Jun 03 20:50:46.802809 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.802578 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-oauth-serving-cert\") pod \"c7aeabca-d096-4135-b2f3-83cd7ce63083\" (UID: \"c7aeabca-d096-4135-b2f3-83cd7ce63083\") " Jun 03 20:50:46.803052 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.803024 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c7aeabca-d096-4135-b2f3-83cd7ce63083" (UID: "c7aeabca-d096-4135-b2f3-83cd7ce63083"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:50:46.803163 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.803039 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-config" (OuterVolumeSpecName: "console-config") pod "c7aeabca-d096-4135-b2f3-83cd7ce63083" (UID: "c7aeabca-d096-4135-b2f3-83cd7ce63083"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:50:46.803163 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.803051 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7aeabca-d096-4135-b2f3-83cd7ce63083" (UID: "c7aeabca-d096-4135-b2f3-83cd7ce63083"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:50:46.803163 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.803059 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7aeabca-d096-4135-b2f3-83cd7ce63083" (UID: "c7aeabca-d096-4135-b2f3-83cd7ce63083"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:50:46.804579 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.804558 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7aeabca-d096-4135-b2f3-83cd7ce63083-kube-api-access-42hd8" (OuterVolumeSpecName: "kube-api-access-42hd8") pod "c7aeabca-d096-4135-b2f3-83cd7ce63083" (UID: "c7aeabca-d096-4135-b2f3-83cd7ce63083"). InnerVolumeSpecName "kube-api-access-42hd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:50:46.804579 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.804565 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7aeabca-d096-4135-b2f3-83cd7ce63083" (UID: "c7aeabca-d096-4135-b2f3-83cd7ce63083"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:50:46.804705 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.804631 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7aeabca-d096-4135-b2f3-83cd7ce63083" (UID: "c7aeabca-d096-4135-b2f3-83cd7ce63083"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:50:46.903687 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.903650 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-trusted-ca-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:50:46.903687 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.903680 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:50:46.903687 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.903689 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42hd8\" (UniqueName: \"kubernetes.io/projected/c7aeabca-d096-4135-b2f3-83cd7ce63083-kube-api-access-42hd8\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:50:46.903687 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.903698 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:50:46.903969 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.903709 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:50:46.903969 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.903717 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7aeabca-d096-4135-b2f3-83cd7ce63083-oauth-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:50:46.903969 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:46.903725 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7aeabca-d096-4135-b2f3-83cd7ce63083-console-oauth-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:50:47.405515 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:47.405481 2563 generic.go:356] "Generic (PLEG): container finished" podID="c7aeabca-d096-4135-b2f3-83cd7ce63083" containerID="e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b" exitCode=0 Jun 03 20:50:47.406015 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:47.405522 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf9c4cd9c-v2zzq" event={"ID":"c7aeabca-d096-4135-b2f3-83cd7ce63083","Type":"ContainerDied","Data":"e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b"} Jun 03 20:50:47.406015 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:47.405526 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf9c4cd9c-v2zzq" Jun 03 20:50:47.406015 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:47.405568 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf9c4cd9c-v2zzq" event={"ID":"c7aeabca-d096-4135-b2f3-83cd7ce63083","Type":"ContainerDied","Data":"64ef4020ea4e0b6bb54637ebfdcf1bc1b0e692a1913ddfe5c9379f0393110a6c"} Jun 03 20:50:47.406015 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:47.405589 2563 scope.go:117] "RemoveContainer" containerID="e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b" Jun 03 20:50:47.413987 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:47.413969 2563 scope.go:117] "RemoveContainer" containerID="e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b" Jun 03 20:50:47.414245 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:50:47.414225 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b\": container with ID starting with e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b not found: ID does not exist" containerID="e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b" Jun 03 20:50:47.414283 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:47.414254 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b"} err="failed to get container status \"e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b\": rpc error: code = NotFound desc = could not find container \"e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b\": container with ID starting with e577d217173b9c79bef6e8e3992fae29932d14d01f6c3e7dbadae1bc4c1c406b not found: ID does not exist" Jun 03 20:50:47.427255 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:47.427231 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf9c4cd9c-v2zzq"] Jun 03 20:50:47.428379 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:47.428361 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bf9c4cd9c-v2zzq"] Jun 03 20:50:47.905040 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:47.905015 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7aeabca-d096-4135-b2f3-83cd7ce63083" path="/var/lib/kubelet/pods/c7aeabca-d096-4135-b2f3-83cd7ce63083/volumes" Jun 03 20:50:49.717014 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.716982 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q"] Jun 03 20:50:49.717375 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.717255 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7aeabca-d096-4135-b2f3-83cd7ce63083" containerName="console" Jun 03 20:50:49.717375 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.717266 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7aeabca-d096-4135-b2f3-83cd7ce63083" containerName="console" Jun 03 20:50:49.717375 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.717319 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7aeabca-d096-4135-b2f3-83cd7ce63083" containerName="console" Jun 03 20:50:49.721475 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.721459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:50:49.724391 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.724369 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:50:49.724515 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.724405 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:50:49.725411 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.725394 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9lnn\"" Jun 03 20:50:49.729600 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.729557 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q"] Jun 03 20:50:49.825223 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.825189 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:50:49.825223 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.825227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:50:49.825449 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.825252 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwkp4\" (UniqueName: \"kubernetes.io/projected/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-kube-api-access-bwkp4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:50:49.926597 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.926559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:50:49.926793 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.926622 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:50:49.926793 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.926660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwkp4\" (UniqueName: \"kubernetes.io/projected/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-kube-api-access-bwkp4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:50:49.930932 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.927331 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:50:49.930932 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.927405 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:50:49.936360 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:49.936328 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwkp4\" (UniqueName: \"kubernetes.io/projected/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-kube-api-access-bwkp4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:50:50.031024 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:50.031000 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:50:50.159893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:50.159863 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q"] Jun 03 20:50:50.162150 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:50:50.162126 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e44514_65aa_49f8_9c1e_f7cfcf8b3ac0.slice/crio-fa44499c2b6b1e2dd3af3886d047ef651d32409d9d5ad64f1e159ee7a0b29852 WatchSource:0}: Error finding container fa44499c2b6b1e2dd3af3886d047ef651d32409d9d5ad64f1e159ee7a0b29852: Status 404 returned error can't find the container with id fa44499c2b6b1e2dd3af3886d047ef651d32409d9d5ad64f1e159ee7a0b29852 Jun 03 20:50:50.419520 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:50.419431 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" event={"ID":"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0","Type":"ContainerStarted","Data":"fa44499c2b6b1e2dd3af3886d047ef651d32409d9d5ad64f1e159ee7a0b29852"} Jun 03 20:50:55.442381 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:55.442298 2563 generic.go:356] "Generic (PLEG): container finished" podID="55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" containerID="c33b21023b241fc603bb54b8bebc39f66b7373ab6493f1808c4189b25588dbd9" exitCode=0 Jun 03 20:50:55.442731 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:55.442377 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" event={"ID":"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0","Type":"ContainerDied","Data":"c33b21023b241fc603bb54b8bebc39f66b7373ab6493f1808c4189b25588dbd9"} Jun 03 20:50:57.451982 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:57.451882 2563 generic.go:356] "Generic (PLEG): container finished" podID="55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" containerID="43fc505264b6f577e78bbc1937ff4f39f02737dcf8fcc8174873329c9f03564f" exitCode=0 Jun 03 20:50:57.451982 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:50:57.451926 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" event={"ID":"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0","Type":"ContainerDied","Data":"43fc505264b6f577e78bbc1937ff4f39f02737dcf8fcc8174873329c9f03564f"} Jun 03 20:51:03.479609 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:03.479520 2563 generic.go:356] "Generic (PLEG): container finished" podID="55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" containerID="d54cdc11939a8bea6c4a0ade9426b5dddf19963ef44c5d75ed1f7a6fed8f1a51" exitCode=0 Jun 03 20:51:03.479988 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:03.479611 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" event={"ID":"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0","Type":"ContainerDied","Data":"d54cdc11939a8bea6c4a0ade9426b5dddf19963ef44c5d75ed1f7a6fed8f1a51"} Jun 03 20:51:04.603011 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:04.602987 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:51:04.643929 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:04.643901 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-util\") pod \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " Jun 03 20:51:04.644075 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:04.643968 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwkp4\" (UniqueName: \"kubernetes.io/projected/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-kube-api-access-bwkp4\") pod \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " Jun 03 20:51:04.644075 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:04.643988 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-bundle\") pod \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\" (UID: \"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0\") " Jun 03 20:51:04.644711 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:04.644685 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-bundle" (OuterVolumeSpecName: "bundle") pod "55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" (UID: "55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:04.646105 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:04.646083 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-kube-api-access-bwkp4" (OuterVolumeSpecName: "kube-api-access-bwkp4") pod "55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" (UID: "55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0"). InnerVolumeSpecName "kube-api-access-bwkp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:51:04.650251 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:04.650224 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-util" (OuterVolumeSpecName: "util") pod "55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" (UID: "55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:04.744827 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:04.744732 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:51:04.744827 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:04.744763 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwkp4\" (UniqueName: \"kubernetes.io/projected/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-kube-api-access-bwkp4\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:51:04.744827 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:04.744777 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:51:05.487660 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:05.487617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" event={"ID":"55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0","Type":"ContainerDied","Data":"fa44499c2b6b1e2dd3af3886d047ef651d32409d9d5ad64f1e159ee7a0b29852"} Jun 03 20:51:05.487660 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:05.487647 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dpn86q" Jun 03 20:51:05.487868 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:05.487674 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa44499c2b6b1e2dd3af3886d047ef651d32409d9d5ad64f1e159ee7a0b29852" Jun 03 20:51:12.619216 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.619181 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7"] Jun 03 20:51:12.620221 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.619451 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" containerName="extract" Jun 03 20:51:12.620221 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.619462 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" containerName="extract" Jun 03 20:51:12.620221 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.619483 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" containerName="util" Jun 03 20:51:12.620221 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.619488 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" containerName="util" Jun 03 20:51:12.620221 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.619495 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" containerName="pull" Jun 03 20:51:12.620221 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.619501 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" containerName="pull" Jun 03 20:51:12.620221 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.619551 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="55e44514-65aa-49f8-9c1e-f7cfcf8b3ac0" containerName="extract" Jun 03 20:51:12.639315 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.639291 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7"] Jun 03 20:51:12.639448 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.639379 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7" Jun 03 20:51:12.642207 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.642183 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:51:12.642550 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.642531 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 20:51:12.642637 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.642572 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-92kjx\"" Jun 03 20:51:12.697508 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.697475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02444eaf-e3eb-454a-897d-f694236644a6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8nhv7\" (UID: \"02444eaf-e3eb-454a-897d-f694236644a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7" Jun 03 20:51:12.697688 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.697538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7psk\" (UniqueName: \"kubernetes.io/projected/02444eaf-e3eb-454a-897d-f694236644a6-kube-api-access-g7psk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8nhv7\" (UID: \"02444eaf-e3eb-454a-897d-f694236644a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7" Jun 03 20:51:12.797899 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.797857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02444eaf-e3eb-454a-897d-f694236644a6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8nhv7\" (UID: \"02444eaf-e3eb-454a-897d-f694236644a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7" Jun 03 20:51:12.798105 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.797991 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7psk\" (UniqueName: \"kubernetes.io/projected/02444eaf-e3eb-454a-897d-f694236644a6-kube-api-access-g7psk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8nhv7\" (UID: \"02444eaf-e3eb-454a-897d-f694236644a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7" Jun 03 20:51:12.798266 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.798248 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02444eaf-e3eb-454a-897d-f694236644a6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8nhv7\" (UID: \"02444eaf-e3eb-454a-897d-f694236644a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7" Jun 03 20:51:12.806586 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.806562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7psk\" (UniqueName: \"kubernetes.io/projected/02444eaf-e3eb-454a-897d-f694236644a6-kube-api-access-g7psk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-8nhv7\" (UID: \"02444eaf-e3eb-454a-897d-f694236644a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7" Jun 03 20:51:12.949098 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:12.949019 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7" Jun 03 20:51:13.101688 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:13.101656 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7"] Jun 03 20:51:13.104972 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:51:13.104928 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02444eaf_e3eb_454a_897d_f694236644a6.slice/crio-108b7499ac63742018e283c4888e5d83d1701631d82969c4e3b816bf54396005 WatchSource:0}: Error finding container 108b7499ac63742018e283c4888e5d83d1701631d82969c4e3b816bf54396005: Status 404 returned error can't find the container with id 108b7499ac63742018e283c4888e5d83d1701631d82969c4e3b816bf54396005 Jun 03 20:51:13.525770 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:13.525733 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7" event={"ID":"02444eaf-e3eb-454a-897d-f694236644a6","Type":"ContainerStarted","Data":"108b7499ac63742018e283c4888e5d83d1701631d82969c4e3b816bf54396005"} Jun 03 20:51:15.535960 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:15.535911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7" event={"ID":"02444eaf-e3eb-454a-897d-f694236644a6","Type":"ContainerStarted","Data":"17420f2e608732be697659ff68f1a4f16acdede9f7e24d8fa5edc8b3967dcd43"} Jun 03 20:51:15.564051 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:15.563999 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-8nhv7" podStartSLOduration=1.759055013 podStartE2EDuration="3.563985718s" totalImagesPullingTime="1.804930705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:15.563764687 +0000 UTC m=+460.162643649" watchObservedRunningTime="2026-06-03 20:51:15.563985718 +0000 UTC m=+460.162864680" Jun 03 20:51:16.742109 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.742074 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz"] Jun 03 20:51:16.744468 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.744453 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:16.746906 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.746883 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:51:16.746906 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.746894 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:51:16.747096 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.746924 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9lnn\"" Jun 03 20:51:16.752845 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.752822 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz"] Jun 03 20:51:16.835268 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.835216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:16.835268 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.835277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7mpf\" (UniqueName: \"kubernetes.io/projected/7d2c25f2-091d-4954-bf60-c34de8289d5e-kube-api-access-g7mpf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:16.835484 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.835341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:16.936685 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.936648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7mpf\" (UniqueName: \"kubernetes.io/projected/7d2c25f2-091d-4954-bf60-c34de8289d5e-kube-api-access-g7mpf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:16.936884 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.936711 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:16.936884 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.936745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:16.937106 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.937088 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:16.937145 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.937122 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:16.947682 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:16.947663 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7mpf\" (UniqueName: \"kubernetes.io/projected/7d2c25f2-091d-4954-bf60-c34de8289d5e-kube-api-access-g7mpf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:17.054361 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:17.054336 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:17.180970 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:17.180924 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz"] Jun 03 20:51:17.183759 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:51:17.183721 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2c25f2_091d_4954_bf60_c34de8289d5e.slice/crio-6871bb217fea48a4e990883c9f4205e49deb06ffa1848d1c767bd955fd48bd86 WatchSource:0}: Error finding container 6871bb217fea48a4e990883c9f4205e49deb06ffa1848d1c767bd955fd48bd86: Status 404 returned error can't find the container with id 6871bb217fea48a4e990883c9f4205e49deb06ffa1848d1c767bd955fd48bd86 Jun 03 20:51:17.545276 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:17.545248 2563 generic.go:356] "Generic (PLEG): container finished" podID="7d2c25f2-091d-4954-bf60-c34de8289d5e" containerID="1169ec6ac725b59eeafc46525781b881d74febf323ba75f309a09079344bfb4c" exitCode=0 Jun 03 20:51:17.545442 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:17.545316 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" event={"ID":"7d2c25f2-091d-4954-bf60-c34de8289d5e","Type":"ContainerDied","Data":"1169ec6ac725b59eeafc46525781b881d74febf323ba75f309a09079344bfb4c"} Jun 03 20:51:17.545442 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:17.545353 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" event={"ID":"7d2c25f2-091d-4954-bf60-c34de8289d5e","Type":"ContainerStarted","Data":"6871bb217fea48a4e990883c9f4205e49deb06ffa1848d1c767bd955fd48bd86"} Jun 03 20:51:18.258556 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.258484 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl"] Jun 03 20:51:18.271325 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.271296 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl"] Jun 03 20:51:18.271463 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.271393 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" Jun 03 20:51:18.274267 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.274237 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 20:51:18.275304 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.275279 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 20:51:18.275399 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.275288 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qtl64\"" Jun 03 20:51:18.348289 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.348243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b316c08f-e13b-4612-809a-b124c69f0768-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-ww6sl\" (UID: \"b316c08f-e13b-4612-809a-b124c69f0768\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" Jun 03 20:51:18.348463 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.348361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwwpv\" (UniqueName: \"kubernetes.io/projected/b316c08f-e13b-4612-809a-b124c69f0768-kube-api-access-fwwpv\") pod \"cert-manager-webhook-7dc76cbb94-ww6sl\" (UID: \"b316c08f-e13b-4612-809a-b124c69f0768\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" Jun 03 20:51:18.449773 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.449731 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b316c08f-e13b-4612-809a-b124c69f0768-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-ww6sl\" (UID: \"b316c08f-e13b-4612-809a-b124c69f0768\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" Jun 03 20:51:18.449989 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.449814 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwwpv\" (UniqueName: \"kubernetes.io/projected/b316c08f-e13b-4612-809a-b124c69f0768-kube-api-access-fwwpv\") pod \"cert-manager-webhook-7dc76cbb94-ww6sl\" (UID: \"b316c08f-e13b-4612-809a-b124c69f0768\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" Jun 03 20:51:18.458828 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.458801 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwwpv\" (UniqueName: \"kubernetes.io/projected/b316c08f-e13b-4612-809a-b124c69f0768-kube-api-access-fwwpv\") pod \"cert-manager-webhook-7dc76cbb94-ww6sl\" (UID: \"b316c08f-e13b-4612-809a-b124c69f0768\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" Jun 03 20:51:18.458975 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.458833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b316c08f-e13b-4612-809a-b124c69f0768-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-ww6sl\" (UID: \"b316c08f-e13b-4612-809a-b124c69f0768\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" Jun 03 20:51:18.592656 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.592623 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" Jun 03 20:51:18.734966 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:18.734911 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl"] Jun 03 20:51:19.432647 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:51:19.432609 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb316c08f_e13b_4612_809a_b124c69f0768.slice/crio-744edbaef2dcb120beda4c51a2ef2b099bcd715f4da2f1b185f9281d0ebec4ea WatchSource:0}: Error finding container 744edbaef2dcb120beda4c51a2ef2b099bcd715f4da2f1b185f9281d0ebec4ea: Status 404 returned error can't find the container with id 744edbaef2dcb120beda4c51a2ef2b099bcd715f4da2f1b185f9281d0ebec4ea Jun 03 20:51:19.556902 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:19.556837 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" event={"ID":"b316c08f-e13b-4612-809a-b124c69f0768","Type":"ContainerStarted","Data":"744edbaef2dcb120beda4c51a2ef2b099bcd715f4da2f1b185f9281d0ebec4ea"} Jun 03 20:51:19.558910 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:19.558869 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" event={"ID":"7d2c25f2-091d-4954-bf60-c34de8289d5e","Type":"ContainerStarted","Data":"91140f61b3b67645986b5b360a5420f31bce2246dca903802e766715b4dd7da2"} Jun 03 20:51:20.565877 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:20.565835 2563 generic.go:356] "Generic (PLEG): container finished" podID="7d2c25f2-091d-4954-bf60-c34de8289d5e" containerID="91140f61b3b67645986b5b360a5420f31bce2246dca903802e766715b4dd7da2" exitCode=0 Jun 03 20:51:20.565877 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:20.565892 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" event={"ID":"7d2c25f2-091d-4954-bf60-c34de8289d5e","Type":"ContainerDied","Data":"91140f61b3b67645986b5b360a5420f31bce2246dca903802e766715b4dd7da2"} Jun 03 20:51:21.084213 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.084179 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t"] Jun 03 20:51:21.086289 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.086274 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t" Jun 03 20:51:21.088680 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.088656 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gq2h9\"" Jun 03 20:51:21.097325 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.097303 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t"] Jun 03 20:51:21.176540 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.176498 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvtrj\" (UniqueName: \"kubernetes.io/projected/8d2f198d-03bc-48f8-9afd-9f219a8b3a3d-kube-api-access-fvtrj\") pod \"cert-manager-cainjector-5d99449ffd-l8j6t\" (UID: \"8d2f198d-03bc-48f8-9afd-9f219a8b3a3d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t" Jun 03 20:51:21.176722 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.176620 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d2f198d-03bc-48f8-9afd-9f219a8b3a3d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-l8j6t\" (UID: \"8d2f198d-03bc-48f8-9afd-9f219a8b3a3d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t" Jun 03 20:51:21.278357 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.278316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d2f198d-03bc-48f8-9afd-9f219a8b3a3d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-l8j6t\" (UID: \"8d2f198d-03bc-48f8-9afd-9f219a8b3a3d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t" Jun 03 20:51:21.278542 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.278430 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvtrj\" (UniqueName: \"kubernetes.io/projected/8d2f198d-03bc-48f8-9afd-9f219a8b3a3d-kube-api-access-fvtrj\") pod \"cert-manager-cainjector-5d99449ffd-l8j6t\" (UID: \"8d2f198d-03bc-48f8-9afd-9f219a8b3a3d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t" Jun 03 20:51:21.287093 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.287064 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d2f198d-03bc-48f8-9afd-9f219a8b3a3d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-l8j6t\" (UID: \"8d2f198d-03bc-48f8-9afd-9f219a8b3a3d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t" Jun 03 20:51:21.287227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.287074 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvtrj\" (UniqueName: \"kubernetes.io/projected/8d2f198d-03bc-48f8-9afd-9f219a8b3a3d-kube-api-access-fvtrj\") pod \"cert-manager-cainjector-5d99449ffd-l8j6t\" (UID: \"8d2f198d-03bc-48f8-9afd-9f219a8b3a3d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t" Jun 03 20:51:21.395626 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.395549 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t" Jun 03 20:51:21.529694 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.529672 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t"] Jun 03 20:51:21.531767 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:51:21.531741 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d2f198d_03bc_48f8_9afd_9f219a8b3a3d.slice/crio-5831470a597b60c4ef89f3022784047f100a434c6bc96fb972cab7fca4aa8a2f WatchSource:0}: Error finding container 5831470a597b60c4ef89f3022784047f100a434c6bc96fb972cab7fca4aa8a2f: Status 404 returned error can't find the container with id 5831470a597b60c4ef89f3022784047f100a434c6bc96fb972cab7fca4aa8a2f Jun 03 20:51:21.575552 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.575519 2563 generic.go:356] "Generic (PLEG): container finished" podID="7d2c25f2-091d-4954-bf60-c34de8289d5e" containerID="a4ecdbe3154b05563b8942029e03aed3ddb3bb44e4cf78184721137c1ed17309" exitCode=0 Jun 03 20:51:21.576028 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.575605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" event={"ID":"7d2c25f2-091d-4954-bf60-c34de8289d5e","Type":"ContainerDied","Data":"a4ecdbe3154b05563b8942029e03aed3ddb3bb44e4cf78184721137c1ed17309"} Jun 03 20:51:21.576922 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:21.576895 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t" event={"ID":"8d2f198d-03bc-48f8-9afd-9f219a8b3a3d","Type":"ContainerStarted","Data":"5831470a597b60c4ef89f3022784047f100a434c6bc96fb972cab7fca4aa8a2f"} Jun 03 20:51:22.583554 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.583523 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t" event={"ID":"8d2f198d-03bc-48f8-9afd-9f219a8b3a3d","Type":"ContainerStarted","Data":"127a848b1937a5c38fca44426173f42cb9bca29001f37a7bf8ba594e0e155704"} Jun 03 20:51:22.585281 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.585252 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" event={"ID":"b316c08f-e13b-4612-809a-b124c69f0768","Type":"ContainerStarted","Data":"ebcf6c9fc4fbdbd403812c6d02f254b5d5b05c0a213d359313d3e0dd3b834317"} Jun 03 20:51:22.585512 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.585491 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" Jun 03 20:51:22.599994 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.599373 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l8j6t" podStartSLOduration=0.659961987 podStartE2EDuration="1.599280741s" totalImagesPullingTime="939.318754ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:22.597782208 +0000 UTC m=+467.196661171" watchObservedRunningTime="2026-06-03 20:51:22.599280741 +0000 UTC m=+467.198159707" Jun 03 20:51:22.622165 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.621295 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" podStartSLOduration=1.584274937 podStartE2EDuration="4.621265337s" totalImagesPullingTime="3.0369904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:22.619683777 +0000 UTC m=+467.218562741" watchObservedRunningTime="2026-06-03 20:51:22.621265337 +0000 UTC m=+467.220144299" Jun 03 20:51:22.731590 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.731516 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:22.790690 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.790661 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-bundle\") pod \"7d2c25f2-091d-4954-bf60-c34de8289d5e\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " Jun 03 20:51:22.790878 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.790713 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-util\") pod \"7d2c25f2-091d-4954-bf60-c34de8289d5e\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " Jun 03 20:51:22.790878 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.790785 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7mpf\" (UniqueName: \"kubernetes.io/projected/7d2c25f2-091d-4954-bf60-c34de8289d5e-kube-api-access-g7mpf\") pod \"7d2c25f2-091d-4954-bf60-c34de8289d5e\" (UID: \"7d2c25f2-091d-4954-bf60-c34de8289d5e\") " Jun 03 20:51:22.791184 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.791149 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-bundle" (OuterVolumeSpecName: "bundle") pod "7d2c25f2-091d-4954-bf60-c34de8289d5e" (UID: "7d2c25f2-091d-4954-bf60-c34de8289d5e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:22.792914 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.792888 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2c25f2-091d-4954-bf60-c34de8289d5e-kube-api-access-g7mpf" (OuterVolumeSpecName: "kube-api-access-g7mpf") pod "7d2c25f2-091d-4954-bf60-c34de8289d5e" (UID: "7d2c25f2-091d-4954-bf60-c34de8289d5e"). InnerVolumeSpecName "kube-api-access-g7mpf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:51:22.795092 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.795065 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-util" (OuterVolumeSpecName: "util") pod "7d2c25f2-091d-4954-bf60-c34de8289d5e" (UID: "7d2c25f2-091d-4954-bf60-c34de8289d5e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:22.891475 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.891437 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7mpf\" (UniqueName: \"kubernetes.io/projected/7d2c25f2-091d-4954-bf60-c34de8289d5e-kube-api-access-g7mpf\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:51:22.891475 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.891470 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:51:22.891475 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:22.891479 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d2c25f2-091d-4954-bf60-c34de8289d5e-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:51:23.591402 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:23.591367 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" event={"ID":"7d2c25f2-091d-4954-bf60-c34de8289d5e","Type":"ContainerDied","Data":"6871bb217fea48a4e990883c9f4205e49deb06ffa1848d1c767bd955fd48bd86"} Jun 03 20:51:23.591402 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:23.591404 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft82zz" Jun 03 20:51:23.591847 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:23.591421 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6871bb217fea48a4e990883c9f4205e49deb06ffa1848d1c767bd955fd48bd86" Jun 03 20:51:28.593481 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:28.593449 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww6sl" Jun 03 20:51:29.356400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.356361 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8"] Jun 03 20:51:29.356731 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.356713 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2c25f2-091d-4954-bf60-c34de8289d5e" containerName="extract" Jun 03 20:51:29.356822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.356734 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2c25f2-091d-4954-bf60-c34de8289d5e" containerName="extract" Jun 03 20:51:29.356822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.356748 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2c25f2-091d-4954-bf60-c34de8289d5e" containerName="util" Jun 03 20:51:29.356822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.356755 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2c25f2-091d-4954-bf60-c34de8289d5e" containerName="util" Jun 03 20:51:29.356822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.356775 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2c25f2-091d-4954-bf60-c34de8289d5e" containerName="pull" Jun 03 20:51:29.356822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.356785 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2c25f2-091d-4954-bf60-c34de8289d5e" containerName="pull" Jun 03 20:51:29.357090 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.356889 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d2c25f2-091d-4954-bf60-c34de8289d5e" containerName="extract" Jun 03 20:51:29.358653 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.358632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8" Jun 03 20:51:29.361289 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.361269 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 20:51:29.361456 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.361441 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-72ftf\"" Jun 03 20:51:29.362444 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.362428 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:51:29.369728 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.369707 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8"] Jun 03 20:51:29.447296 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.447261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e224fc53-37ff-4a85-af9a-96073e53553b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zcjk8\" (UID: \"e224fc53-37ff-4a85-af9a-96073e53553b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8" Jun 03 20:51:29.447296 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.447299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkwxg\" (UniqueName: \"kubernetes.io/projected/e224fc53-37ff-4a85-af9a-96073e53553b-kube-api-access-vkwxg\") pod \"openshift-lws-operator-fd8ccff4c-zcjk8\" (UID: \"e224fc53-37ff-4a85-af9a-96073e53553b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8" Jun 03 20:51:29.548237 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.548185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e224fc53-37ff-4a85-af9a-96073e53553b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zcjk8\" (UID: \"e224fc53-37ff-4a85-af9a-96073e53553b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8" Jun 03 20:51:29.548237 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.548236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwxg\" (UniqueName: \"kubernetes.io/projected/e224fc53-37ff-4a85-af9a-96073e53553b-kube-api-access-vkwxg\") pod \"openshift-lws-operator-fd8ccff4c-zcjk8\" (UID: \"e224fc53-37ff-4a85-af9a-96073e53553b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8" Jun 03 20:51:29.548649 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.548629 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e224fc53-37ff-4a85-af9a-96073e53553b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zcjk8\" (UID: \"e224fc53-37ff-4a85-af9a-96073e53553b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8" Jun 03 20:51:29.556628 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.556600 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkwxg\" (UniqueName: \"kubernetes.io/projected/e224fc53-37ff-4a85-af9a-96073e53553b-kube-api-access-vkwxg\") pod \"openshift-lws-operator-fd8ccff4c-zcjk8\" (UID: \"e224fc53-37ff-4a85-af9a-96073e53553b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8" Jun 03 20:51:29.667346 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.667260 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8" Jun 03 20:51:29.791317 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:29.791295 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8"] Jun 03 20:51:29.793412 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:51:29.793391 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode224fc53_37ff_4a85_af9a_96073e53553b.slice/crio-aacbabd8f3dff93726e3202e796548142c892393539001aae21154f9661f98af WatchSource:0}: Error finding container aacbabd8f3dff93726e3202e796548142c892393539001aae21154f9661f98af: Status 404 returned error can't find the container with id aacbabd8f3dff93726e3202e796548142c892393539001aae21154f9661f98af Jun 03 20:51:30.621090 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:30.621055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8" event={"ID":"e224fc53-37ff-4a85-af9a-96073e53553b","Type":"ContainerStarted","Data":"aacbabd8f3dff93726e3202e796548142c892393539001aae21154f9661f98af"} Jun 03 20:51:32.631549 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:32.631512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8" event={"ID":"e224fc53-37ff-4a85-af9a-96073e53553b","Type":"ContainerStarted","Data":"b2036224033607284e4c814057d6f306c5f7d3b302997f8581c16d5cbe87c1bc"} Jun 03 20:51:32.649959 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:32.649899 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zcjk8" podStartSLOduration=1.3117027669999999 podStartE2EDuration="3.649884073s" totalImagesPullingTime="2.338181306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:32.647300918 +0000 UTC m=+477.246179879" watchObservedRunningTime="2026-06-03 20:51:32.649884073 +0000 UTC m=+477.248763035" Jun 03 20:51:37.163284 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.163243 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp"] Jun 03 20:51:37.166340 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.166317 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:37.168859 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.168839 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:51:37.168988 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.168874 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:51:37.169707 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.169692 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9lnn\"" Jun 03 20:51:37.173827 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.173795 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp"] Jun 03 20:51:37.311705 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.311665 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:37.311705 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.311704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:37.311983 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.311819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpv4z\" (UniqueName: \"kubernetes.io/projected/d4d6905a-627a-49bf-bfbf-0c18641d70c0-kube-api-access-vpv4z\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:37.413178 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.413139 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:37.413178 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.413178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:37.413413 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.413213 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpv4z\" (UniqueName: \"kubernetes.io/projected/d4d6905a-627a-49bf-bfbf-0c18641d70c0-kube-api-access-vpv4z\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:37.413699 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.413672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:37.413761 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.413672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:37.421554 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.421516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpv4z\" (UniqueName: \"kubernetes.io/projected/d4d6905a-627a-49bf-bfbf-0c18641d70c0-kube-api-access-vpv4z\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:37.476366 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.476332 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:37.605564 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.605539 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp"] Jun 03 20:51:37.607923 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:51:37.607897 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d6905a_627a_49bf_bfbf_0c18641d70c0.slice/crio-6609f8b12fadb43d2c90531acd829b76bdbaf5de5b88ca59aa0dc3a39b6968ae WatchSource:0}: Error finding container 6609f8b12fadb43d2c90531acd829b76bdbaf5de5b88ca59aa0dc3a39b6968ae: Status 404 returned error can't find the container with id 6609f8b12fadb43d2c90531acd829b76bdbaf5de5b88ca59aa0dc3a39b6968ae Jun 03 20:51:37.654907 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:37.654878 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" event={"ID":"d4d6905a-627a-49bf-bfbf-0c18641d70c0","Type":"ContainerStarted","Data":"6609f8b12fadb43d2c90531acd829b76bdbaf5de5b88ca59aa0dc3a39b6968ae"} Jun 03 20:51:38.660637 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:38.660602 2563 generic.go:356] "Generic (PLEG): container finished" podID="d4d6905a-627a-49bf-bfbf-0c18641d70c0" containerID="b31ab63dc3afd9e57b36b413ea1381c0f0f2ab0ef4b9ca21f09cbe7ecd2d4cdb" exitCode=0 Jun 03 20:51:38.660637 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:38.660640 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" event={"ID":"d4d6905a-627a-49bf-bfbf-0c18641d70c0","Type":"ContainerDied","Data":"b31ab63dc3afd9e57b36b413ea1381c0f0f2ab0ef4b9ca21f09cbe7ecd2d4cdb"} Jun 03 20:51:39.667131 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:39.667090 2563 generic.go:356] "Generic (PLEG): container finished" podID="d4d6905a-627a-49bf-bfbf-0c18641d70c0" containerID="956c8128d19054f3926444a701804012c3c4302cc99cd8bd8faa19f9420b6b25" exitCode=0 Jun 03 20:51:39.667500 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:39.667182 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" event={"ID":"d4d6905a-627a-49bf-bfbf-0c18641d70c0","Type":"ContainerDied","Data":"956c8128d19054f3926444a701804012c3c4302cc99cd8bd8faa19f9420b6b25"} Jun 03 20:51:40.674478 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:40.674447 2563 generic.go:356] "Generic (PLEG): container finished" podID="d4d6905a-627a-49bf-bfbf-0c18641d70c0" containerID="6754e049a95e04c93967d6a476c73afce8af7424748cefe3dfd17d044e937853" exitCode=0 Jun 03 20:51:40.674478 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:40.674484 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" event={"ID":"d4d6905a-627a-49bf-bfbf-0c18641d70c0","Type":"ContainerDied","Data":"6754e049a95e04c93967d6a476c73afce8af7424748cefe3dfd17d044e937853"} Jun 03 20:51:41.803109 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:41.803079 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:41.953767 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:41.953684 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-util\") pod \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " Jun 03 20:51:41.953767 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:41.953717 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpv4z\" (UniqueName: \"kubernetes.io/projected/d4d6905a-627a-49bf-bfbf-0c18641d70c0-kube-api-access-vpv4z\") pod \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " Jun 03 20:51:41.953767 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:41.953744 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-bundle\") pod \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\" (UID: \"d4d6905a-627a-49bf-bfbf-0c18641d70c0\") " Jun 03 20:51:41.954490 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:41.954457 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-bundle" (OuterVolumeSpecName: "bundle") pod "d4d6905a-627a-49bf-bfbf-0c18641d70c0" (UID: "d4d6905a-627a-49bf-bfbf-0c18641d70c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:41.955744 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:41.955719 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d6905a-627a-49bf-bfbf-0c18641d70c0-kube-api-access-vpv4z" (OuterVolumeSpecName: "kube-api-access-vpv4z") pod "d4d6905a-627a-49bf-bfbf-0c18641d70c0" (UID: "d4d6905a-627a-49bf-bfbf-0c18641d70c0"). InnerVolumeSpecName "kube-api-access-vpv4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:51:41.959400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:41.959376 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-util" (OuterVolumeSpecName: "util") pod "d4d6905a-627a-49bf-bfbf-0c18641d70c0" (UID: "d4d6905a-627a-49bf-bfbf-0c18641d70c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:51:42.054745 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:42.054706 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:51:42.054745 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:42.054738 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpv4z\" (UniqueName: \"kubernetes.io/projected/d4d6905a-627a-49bf-bfbf-0c18641d70c0-kube-api-access-vpv4z\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:51:42.054745 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:42.054748 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4d6905a-627a-49bf-bfbf-0c18641d70c0-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:51:42.687915 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:42.687888 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" Jun 03 20:51:42.687915 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:42.687907 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhkvtp" event={"ID":"d4d6905a-627a-49bf-bfbf-0c18641d70c0","Type":"ContainerDied","Data":"6609f8b12fadb43d2c90531acd829b76bdbaf5de5b88ca59aa0dc3a39b6968ae"} Jun 03 20:51:42.688180 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:42.687965 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6609f8b12fadb43d2c90531acd829b76bdbaf5de5b88ca59aa0dc3a39b6968ae" Jun 03 20:51:48.916753 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.916717 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2"] Jun 03 20:51:48.917241 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.917034 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d6905a-627a-49bf-bfbf-0c18641d70c0" containerName="pull" Jun 03 20:51:48.917241 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.917047 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d6905a-627a-49bf-bfbf-0c18641d70c0" containerName="pull" Jun 03 20:51:48.917241 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.917058 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d6905a-627a-49bf-bfbf-0c18641d70c0" containerName="util" Jun 03 20:51:48.917241 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.917063 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d6905a-627a-49bf-bfbf-0c18641d70c0" containerName="util" Jun 03 20:51:48.917241 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.917070 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d6905a-627a-49bf-bfbf-0c18641d70c0" containerName="extract" Jun 03 20:51:48.917241 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.917075 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d6905a-627a-49bf-bfbf-0c18641d70c0" containerName="extract" Jun 03 20:51:48.917241 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.917137 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d6905a-627a-49bf-bfbf-0c18641d70c0" containerName="extract" Jun 03 20:51:48.921671 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.921648 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:48.927539 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.927516 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 20:51:48.928546 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.928524 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 20:51:48.928643 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.928559 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 20:51:48.928643 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.928618 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 20:51:48.928900 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.928886 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zlkj8\"" Jun 03 20:51:48.937636 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:48.937613 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2"] Jun 03 20:51:49.114570 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.114531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdrcq\" (UniqueName: \"kubernetes.io/projected/aacaad25-f33e-4b58-a137-0ff56921a11f-kube-api-access-tdrcq\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.114570 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.114571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aacaad25-f33e-4b58-a137-0ff56921a11f-manifests\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.114820 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.114598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aacaad25-f33e-4b58-a137-0ff56921a11f-tmp\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.114820 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.114623 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aacaad25-f33e-4b58-a137-0ff56921a11f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.114820 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.114717 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aacaad25-f33e-4b58-a137-0ff56921a11f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.215678 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.215595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdrcq\" (UniqueName: \"kubernetes.io/projected/aacaad25-f33e-4b58-a137-0ff56921a11f-kube-api-access-tdrcq\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.215678 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.215633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aacaad25-f33e-4b58-a137-0ff56921a11f-manifests\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.215678 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.215664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aacaad25-f33e-4b58-a137-0ff56921a11f-tmp\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.215916 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.215700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aacaad25-f33e-4b58-a137-0ff56921a11f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.215916 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.215744 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aacaad25-f33e-4b58-a137-0ff56921a11f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.216118 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.216095 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aacaad25-f33e-4b58-a137-0ff56921a11f-manifests\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.218032 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.218011 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aacaad25-f33e-4b58-a137-0ff56921a11f-tmp\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.218266 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.218249 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aacaad25-f33e-4b58-a137-0ff56921a11f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.218466 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.218447 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aacaad25-f33e-4b58-a137-0ff56921a11f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.226079 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.226057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdrcq\" (UniqueName: \"kubernetes.io/projected/aacaad25-f33e-4b58-a137-0ff56921a11f-kube-api-access-tdrcq\") pod \"opendatahub-operator-controller-manager-5965b9645d-lflx2\" (UID: \"aacaad25-f33e-4b58-a137-0ff56921a11f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.231830 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.231807 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:49.370469 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.370439 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2"] Jun 03 20:51:49.373588 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:51:49.373558 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaacaad25_f33e_4b58_a137_0ff56921a11f.slice/crio-258ee702616bc4891ed815f9fbd415d962d625d7d0862d5d05d3e4c943473789 WatchSource:0}: Error finding container 258ee702616bc4891ed815f9fbd415d962d625d7d0862d5d05d3e4c943473789: Status 404 returned error can't find the container with id 258ee702616bc4891ed815f9fbd415d962d625d7d0862d5d05d3e4c943473789 Jun 03 20:51:49.718200 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:49.718166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" event={"ID":"aacaad25-f33e-4b58-a137-0ff56921a11f","Type":"ContainerStarted","Data":"258ee702616bc4891ed815f9fbd415d962d625d7d0862d5d05d3e4c943473789"} Jun 03 20:51:52.734383 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:52.734302 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" event={"ID":"aacaad25-f33e-4b58-a137-0ff56921a11f","Type":"ContainerStarted","Data":"d7c6f7302a34c41f86b6328f4acb9bf8eb7b99b7f984efad7b8a0c78a5e71475"} Jun 03 20:51:53.740859 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:53.740770 2563 generic.go:356] "Generic (PLEG): container finished" podID="aacaad25-f33e-4b58-a137-0ff56921a11f" containerID="d7c6f7302a34c41f86b6328f4acb9bf8eb7b99b7f984efad7b8a0c78a5e71475" exitCode=0 Jun 03 20:51:53.740859 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:53.740807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" event={"ID":"aacaad25-f33e-4b58-a137-0ff56921a11f","Type":"ContainerDied","Data":"d7c6f7302a34c41f86b6328f4acb9bf8eb7b99b7f984efad7b8a0c78a5e71475"} Jun 03 20:51:54.746988 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:54.746919 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" event={"ID":"aacaad25-f33e-4b58-a137-0ff56921a11f","Type":"ContainerStarted","Data":"d1f924342a763ba2e8a3bd5e392cd20799806504e48eda4c0aba7dc1833341bd"} Jun 03 20:51:54.747372 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:54.747040 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:51:54.769625 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:51:54.769578 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" podStartSLOduration=2.486558954 podStartE2EDuration="6.769565408s" totalImagesPullingTime="3.290165042s" totalInitContainerRuntime="992.841412ms" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:54.767047589 +0000 UTC m=+499.365926551" watchObservedRunningTime="2026-06-03 20:51:54.769565408 +0000 UTC m=+499.368444370" Jun 03 20:52:05.752465 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:05.752433 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lflx2" Jun 03 20:52:08.245128 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.245095 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll"] Jun 03 20:52:08.253342 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.253315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" Jun 03 20:52:08.256729 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.256706 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 20:52:08.257130 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.257109 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wfrbp\"" Jun 03 20:52:08.258871 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.258852 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 20:52:08.276510 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.276483 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll"] Jun 03 20:52:08.372117 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.372081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3330a564-1ef7-4948-bb63-2a740296e4c3-tls-certs\") pod \"kube-auth-proxy-5b6d85b7bd-xnhll\" (UID: \"3330a564-1ef7-4948-bb63-2a740296e4c3\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" Jun 03 20:52:08.372321 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.372130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q59b\" (UniqueName: \"kubernetes.io/projected/3330a564-1ef7-4948-bb63-2a740296e4c3-kube-api-access-6q59b\") pod \"kube-auth-proxy-5b6d85b7bd-xnhll\" (UID: \"3330a564-1ef7-4948-bb63-2a740296e4c3\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" Jun 03 20:52:08.372321 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.372223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3330a564-1ef7-4948-bb63-2a740296e4c3-tmp\") pod \"kube-auth-proxy-5b6d85b7bd-xnhll\" (UID: \"3330a564-1ef7-4948-bb63-2a740296e4c3\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" Jun 03 20:52:08.419685 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.419646 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4ffk4"] Jun 03 20:52:08.423157 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.423142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:08.426955 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.426921 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 20:52:08.427057 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.426958 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xlktf\"" Jun 03 20:52:08.440291 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.440269 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4ffk4"] Jun 03 20:52:08.473287 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.473259 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3330a564-1ef7-4948-bb63-2a740296e4c3-tmp\") pod \"kube-auth-proxy-5b6d85b7bd-xnhll\" (UID: \"3330a564-1ef7-4948-bb63-2a740296e4c3\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" Jun 03 20:52:08.473443 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.473310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3330a564-1ef7-4948-bb63-2a740296e4c3-tls-certs\") pod \"kube-auth-proxy-5b6d85b7bd-xnhll\" (UID: \"3330a564-1ef7-4948-bb63-2a740296e4c3\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" Jun 03 20:52:08.473443 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.473338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87075c79-e028-4d7b-bd88-b8449d405131-cert\") pod \"odh-model-controller-6dc94f689f-4ffk4\" (UID: \"87075c79-e028-4d7b-bd88-b8449d405131\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:08.473443 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.473362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q59b\" (UniqueName: \"kubernetes.io/projected/3330a564-1ef7-4948-bb63-2a740296e4c3-kube-api-access-6q59b\") pod \"kube-auth-proxy-5b6d85b7bd-xnhll\" (UID: \"3330a564-1ef7-4948-bb63-2a740296e4c3\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" Jun 03 20:52:08.473443 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.473392 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgzjl\" (UniqueName: \"kubernetes.io/projected/87075c79-e028-4d7b-bd88-b8449d405131-kube-api-access-qgzjl\") pod \"odh-model-controller-6dc94f689f-4ffk4\" (UID: \"87075c79-e028-4d7b-bd88-b8449d405131\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:08.475583 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.475560 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3330a564-1ef7-4948-bb63-2a740296e4c3-tmp\") pod \"kube-auth-proxy-5b6d85b7bd-xnhll\" (UID: \"3330a564-1ef7-4948-bb63-2a740296e4c3\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" Jun 03 20:52:08.475706 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.475694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3330a564-1ef7-4948-bb63-2a740296e4c3-tls-certs\") pod \"kube-auth-proxy-5b6d85b7bd-xnhll\" (UID: \"3330a564-1ef7-4948-bb63-2a740296e4c3\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" Jun 03 20:52:08.481023 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.480999 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q59b\" (UniqueName: \"kubernetes.io/projected/3330a564-1ef7-4948-bb63-2a740296e4c3-kube-api-access-6q59b\") pod \"kube-auth-proxy-5b6d85b7bd-xnhll\" (UID: \"3330a564-1ef7-4948-bb63-2a740296e4c3\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" Jun 03 20:52:08.562980 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.562927 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" Jun 03 20:52:08.574376 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.574353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgzjl\" (UniqueName: \"kubernetes.io/projected/87075c79-e028-4d7b-bd88-b8449d405131-kube-api-access-qgzjl\") pod \"odh-model-controller-6dc94f689f-4ffk4\" (UID: \"87075c79-e028-4d7b-bd88-b8449d405131\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:08.574515 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.574499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87075c79-e028-4d7b-bd88-b8449d405131-cert\") pod \"odh-model-controller-6dc94f689f-4ffk4\" (UID: \"87075c79-e028-4d7b-bd88-b8449d405131\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:08.574620 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:52:08.574607 2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 20:52:08.574675 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:52:08.574663 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87075c79-e028-4d7b-bd88-b8449d405131-cert podName:87075c79-e028-4d7b-bd88-b8449d405131 nodeName:}" failed. No retries permitted until 2026-06-03 20:52:09.074645542 +0000 UTC m=+513.673524482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87075c79-e028-4d7b-bd88-b8449d405131-cert") pod "odh-model-controller-6dc94f689f-4ffk4" (UID: "87075c79-e028-4d7b-bd88-b8449d405131") : secret "odh-model-controller-webhook-cert" not found Jun 03 20:52:08.583530 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.583498 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgzjl\" (UniqueName: \"kubernetes.io/projected/87075c79-e028-4d7b-bd88-b8449d405131-kube-api-access-qgzjl\") pod \"odh-model-controller-6dc94f689f-4ffk4\" (UID: \"87075c79-e028-4d7b-bd88-b8449d405131\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:08.692187 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.692161 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll"] Jun 03 20:52:08.694282 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:52:08.694255 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3330a564_1ef7_4948_bb63_2a740296e4c3.slice/crio-5479d7e4889365882f06b560b28bf9c6760d0a750a0825f883033b860b5fea35 WatchSource:0}: Error finding container 5479d7e4889365882f06b560b28bf9c6760d0a750a0825f883033b860b5fea35: Status 404 returned error can't find the container with id 5479d7e4889365882f06b560b28bf9c6760d0a750a0825f883033b860b5fea35 Jun 03 20:52:08.810648 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:08.810611 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" event={"ID":"3330a564-1ef7-4948-bb63-2a740296e4c3","Type":"ContainerStarted","Data":"5479d7e4889365882f06b560b28bf9c6760d0a750a0825f883033b860b5fea35"} Jun 03 20:52:09.079198 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.079160 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87075c79-e028-4d7b-bd88-b8449d405131-cert\") pod \"odh-model-controller-6dc94f689f-4ffk4\" (UID: \"87075c79-e028-4d7b-bd88-b8449d405131\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:09.079376 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:52:09.079281 2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 20:52:09.079376 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:52:09.079355 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87075c79-e028-4d7b-bd88-b8449d405131-cert podName:87075c79-e028-4d7b-bd88-b8449d405131 nodeName:}" failed. No retries permitted until 2026-06-03 20:52:10.079338429 +0000 UTC m=+514.678217368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87075c79-e028-4d7b-bd88-b8449d405131-cert") pod "odh-model-controller-6dc94f689f-4ffk4" (UID: "87075c79-e028-4d7b-bd88-b8449d405131") : secret "odh-model-controller-webhook-cert" not found Jun 03 20:52:09.143261 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.143226 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9j652"] Jun 03 20:52:09.147762 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.147742 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9j652" Jun 03 20:52:09.150222 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.150199 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 20:52:09.150337 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.150244 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-c7g6m\"" Jun 03 20:52:09.162031 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.162004 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9j652"] Jun 03 20:52:09.182392 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.182361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09aa54a4-159d-4876-afb1-068172e4d966-tls-certs\") pod \"model-serving-api-5dd488fc48-9j652\" (UID: \"09aa54a4-159d-4876-afb1-068172e4d966\") " pod="opendatahub/model-serving-api-5dd488fc48-9j652" Jun 03 20:52:09.182572 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.182428 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwc6l\" (UniqueName: \"kubernetes.io/projected/09aa54a4-159d-4876-afb1-068172e4d966-kube-api-access-kwc6l\") pod \"model-serving-api-5dd488fc48-9j652\" (UID: \"09aa54a4-159d-4876-afb1-068172e4d966\") " pod="opendatahub/model-serving-api-5dd488fc48-9j652" Jun 03 20:52:09.283128 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.283091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwc6l\" (UniqueName: \"kubernetes.io/projected/09aa54a4-159d-4876-afb1-068172e4d966-kube-api-access-kwc6l\") pod \"model-serving-api-5dd488fc48-9j652\" (UID: \"09aa54a4-159d-4876-afb1-068172e4d966\") " pod="opendatahub/model-serving-api-5dd488fc48-9j652" Jun 03 20:52:09.283539 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.283179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09aa54a4-159d-4876-afb1-068172e4d966-tls-certs\") pod \"model-serving-api-5dd488fc48-9j652\" (UID: \"09aa54a4-159d-4876-afb1-068172e4d966\") " pod="opendatahub/model-serving-api-5dd488fc48-9j652" Jun 03 20:52:09.285717 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.285692 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09aa54a4-159d-4876-afb1-068172e4d966-tls-certs\") pod \"model-serving-api-5dd488fc48-9j652\" (UID: \"09aa54a4-159d-4876-afb1-068172e4d966\") " pod="opendatahub/model-serving-api-5dd488fc48-9j652" Jun 03 20:52:09.292295 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.292272 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwc6l\" (UniqueName: \"kubernetes.io/projected/09aa54a4-159d-4876-afb1-068172e4d966-kube-api-access-kwc6l\") pod \"model-serving-api-5dd488fc48-9j652\" (UID: \"09aa54a4-159d-4876-afb1-068172e4d966\") " pod="opendatahub/model-serving-api-5dd488fc48-9j652" Jun 03 20:52:09.457929 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.457818 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9j652" Jun 03 20:52:09.610558 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.610521 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9j652"] Jun 03 20:52:09.614401 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:52:09.614353 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09aa54a4_159d_4876_afb1_068172e4d966.slice/crio-5970ae82674f19cb2237a9fb9a02808672d3a76aac0bd47e2138513027f6f24d WatchSource:0}: Error finding container 5970ae82674f19cb2237a9fb9a02808672d3a76aac0bd47e2138513027f6f24d: Status 404 returned error can't find the container with id 5970ae82674f19cb2237a9fb9a02808672d3a76aac0bd47e2138513027f6f24d Jun 03 20:52:09.820657 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:09.820588 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9j652" event={"ID":"09aa54a4-159d-4876-afb1-068172e4d966","Type":"ContainerStarted","Data":"5970ae82674f19cb2237a9fb9a02808672d3a76aac0bd47e2138513027f6f24d"} Jun 03 20:52:10.066475 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.066439 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw"] Jun 03 20:52:10.071368 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.071299 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:10.074487 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.074311 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:52:10.074487 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.074321 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:52:10.075270 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.075161 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9lnn\"" Jun 03 20:52:10.078200 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.078177 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw"] Jun 03 20:52:10.089136 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.089114 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87075c79-e028-4d7b-bd88-b8449d405131-cert\") pod \"odh-model-controller-6dc94f689f-4ffk4\" (UID: \"87075c79-e028-4d7b-bd88-b8449d405131\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:10.091843 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.091818 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87075c79-e028-4d7b-bd88-b8449d405131-cert\") pod \"odh-model-controller-6dc94f689f-4ffk4\" (UID: \"87075c79-e028-4d7b-bd88-b8449d405131\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:10.190118 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.190077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:10.190308 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.190137 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:10.190308 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.190269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgnnt\" (UniqueName: \"kubernetes.io/projected/5193a1d9-5efe-41c4-af76-333dda4c016a-kube-api-access-bgnnt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:10.233106 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.233059 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:10.291177 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.291134 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgnnt\" (UniqueName: \"kubernetes.io/projected/5193a1d9-5efe-41c4-af76-333dda4c016a-kube-api-access-bgnnt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:10.291627 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.291211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:10.291627 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.291250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:10.291770 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.291747 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:10.292397 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.292353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:10.301216 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.301177 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgnnt\" (UniqueName: \"kubernetes.io/projected/5193a1d9-5efe-41c4-af76-333dda4c016a-kube-api-access-bgnnt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:10.385742 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.385711 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:10.422171 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:10.422143 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4ffk4"] Jun 03 20:52:11.193058 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:52:11.193011 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87075c79_e028_4d7b_bd88_b8449d405131.slice/crio-f8b6fff41790441b077cce534ab8d073aa98c1e2bc226edc98b35f92ad0ce2f7 WatchSource:0}: Error finding container f8b6fff41790441b077cce534ab8d073aa98c1e2bc226edc98b35f92ad0ce2f7: Status 404 returned error can't find the container with id f8b6fff41790441b077cce534ab8d073aa98c1e2bc226edc98b35f92ad0ce2f7 Jun 03 20:52:11.342199 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:11.342169 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw"] Jun 03 20:52:11.597912 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:52:11.597881 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5193a1d9_5efe_41c4_af76_333dda4c016a.slice/crio-b99c488f6817da42480ef09a054684e91b6f36bdd51abc2da0d261079c00ad2a WatchSource:0}: Error finding container b99c488f6817da42480ef09a054684e91b6f36bdd51abc2da0d261079c00ad2a: Status 404 returned error can't find the container with id b99c488f6817da42480ef09a054684e91b6f36bdd51abc2da0d261079c00ad2a Jun 03 20:52:11.833151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:11.833102 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" event={"ID":"87075c79-e028-4d7b-bd88-b8449d405131","Type":"ContainerStarted","Data":"f8b6fff41790441b077cce534ab8d073aa98c1e2bc226edc98b35f92ad0ce2f7"} Jun 03 20:52:11.834511 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:11.834481 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" event={"ID":"5193a1d9-5efe-41c4-af76-333dda4c016a","Type":"ContainerStarted","Data":"b99c488f6817da42480ef09a054684e91b6f36bdd51abc2da0d261079c00ad2a"} Jun 03 20:52:12.840805 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:12.840771 2563 generic.go:356] "Generic (PLEG): container finished" podID="5193a1d9-5efe-41c4-af76-333dda4c016a" containerID="e229ae4424514a6939071b9a8472986d0b2125f346e611c435a9e9a70263d85b" exitCode=0 Jun 03 20:52:12.841255 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:12.840855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" event={"ID":"5193a1d9-5efe-41c4-af76-333dda4c016a","Type":"ContainerDied","Data":"e229ae4424514a6939071b9a8472986d0b2125f346e611c435a9e9a70263d85b"} Jun 03 20:52:12.842683 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:12.842659 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" event={"ID":"3330a564-1ef7-4948-bb63-2a740296e4c3","Type":"ContainerStarted","Data":"ff7a81b7d20f5d9ad85dffbaa100c0d0d492ea4fef7ca52a1635c468c21a48bd"} Jun 03 20:52:12.844528 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:12.844486 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9j652" event={"ID":"09aa54a4-159d-4876-afb1-068172e4d966","Type":"ContainerStarted","Data":"56b25ed5d80cead132eb0fdd794123d7b3cd049f45600246462a4fcacac67eca"} Jun 03 20:52:12.844718 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:12.844698 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-9j652" Jun 03 20:52:12.872929 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:12.872868 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-9j652" podStartSLOduration=1.140757158 podStartE2EDuration="3.872848231s" totalImagesPullingTime="2.732091073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:12.871476754 +0000 UTC m=+517.470355717" watchObservedRunningTime="2026-06-03 20:52:12.872848231 +0000 UTC m=+517.471727195" Jun 03 20:52:12.888677 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:12.888615 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-xnhll" podStartSLOduration=1.225962069 podStartE2EDuration="4.888601155s" totalImagesPullingTime="3.662639086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:12.887787156 +0000 UTC m=+517.486666133" watchObservedRunningTime="2026-06-03 20:52:12.888601155 +0000 UTC m=+517.487480116" Jun 03 20:52:15.861700 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:15.861663 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" event={"ID":"87075c79-e028-4d7b-bd88-b8449d405131","Type":"ContainerStarted","Data":"da24ea567dd6318ed004753e2eab8817b64352347b9a22dc3bb3fd78817b8096"} Jun 03 20:52:15.862168 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:15.861771 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:15.863479 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:15.863452 2563 generic.go:356] "Generic (PLEG): container finished" podID="5193a1d9-5efe-41c4-af76-333dda4c016a" containerID="75150434833c56a52bf18f07589e5d83ffe53d9a4ea5ec29932267fd78c3605b" exitCode=0 Jun 03 20:52:15.863566 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:15.863491 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" event={"ID":"5193a1d9-5efe-41c4-af76-333dda4c016a","Type":"ContainerDied","Data":"75150434833c56a52bf18f07589e5d83ffe53d9a4ea5ec29932267fd78c3605b"} Jun 03 20:52:15.883715 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:15.883671 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" podStartSLOduration=4.162257865 podStartE2EDuration="7.883656s" totalImagesPullingTime="3.721398135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:15.881658189 +0000 UTC m=+520.480537151" watchObservedRunningTime="2026-06-03 20:52:15.883656 +0000 UTC m=+520.482534962" Jun 03 20:52:16.869989 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:16.869937 2563 generic.go:356] "Generic (PLEG): container finished" podID="5193a1d9-5efe-41c4-af76-333dda4c016a" containerID="feab329a011379d2bb7302dd4fd955071a1aeb7d8b86f37170308dd43c08e4ad" exitCode=0 Jun 03 20:52:16.870349 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:16.869990 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" event={"ID":"5193a1d9-5efe-41c4-af76-333dda4c016a","Type":"ContainerDied","Data":"feab329a011379d2bb7302dd4fd955071a1aeb7d8b86f37170308dd43c08e4ad"} Jun 03 20:52:18.007310 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.007284 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:18.059185 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.059158 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-bundle\") pod \"5193a1d9-5efe-41c4-af76-333dda4c016a\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " Jun 03 20:52:18.059340 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.059197 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgnnt\" (UniqueName: \"kubernetes.io/projected/5193a1d9-5efe-41c4-af76-333dda4c016a-kube-api-access-bgnnt\") pod \"5193a1d9-5efe-41c4-af76-333dda4c016a\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " Jun 03 20:52:18.059340 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.059248 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-util\") pod \"5193a1d9-5efe-41c4-af76-333dda4c016a\" (UID: \"5193a1d9-5efe-41c4-af76-333dda4c016a\") " Jun 03 20:52:18.060287 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.060260 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-bundle" (OuterVolumeSpecName: "bundle") pod "5193a1d9-5efe-41c4-af76-333dda4c016a" (UID: "5193a1d9-5efe-41c4-af76-333dda4c016a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:52:18.061334 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.061303 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5193a1d9-5efe-41c4-af76-333dda4c016a-kube-api-access-bgnnt" (OuterVolumeSpecName: "kube-api-access-bgnnt") pod "5193a1d9-5efe-41c4-af76-333dda4c016a" (UID: "5193a1d9-5efe-41c4-af76-333dda4c016a"). InnerVolumeSpecName "kube-api-access-bgnnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:52:18.065096 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.065054 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-util" (OuterVolumeSpecName: "util") pod "5193a1d9-5efe-41c4-af76-333dda4c016a" (UID: "5193a1d9-5efe-41c4-af76-333dda4c016a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:52:18.159870 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.159796 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:52:18.159870 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.159823 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5193a1d9-5efe-41c4-af76-333dda4c016a-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:52:18.159870 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.159833 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgnnt\" (UniqueName: \"kubernetes.io/projected/5193a1d9-5efe-41c4-af76-333dda4c016a-kube-api-access-bgnnt\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:52:18.377492 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.377460 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z6pw7"] Jun 03 20:52:18.377836 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.377823 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5193a1d9-5efe-41c4-af76-333dda4c016a" containerName="util" Jun 03 20:52:18.377898 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.377840 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5193a1d9-5efe-41c4-af76-333dda4c016a" containerName="util" Jun 03 20:52:18.377898 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.377847 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5193a1d9-5efe-41c4-af76-333dda4c016a" containerName="extract" Jun 03 20:52:18.377898 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.377853 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5193a1d9-5efe-41c4-af76-333dda4c016a" containerName="extract" Jun 03 20:52:18.377898 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.377871 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5193a1d9-5efe-41c4-af76-333dda4c016a" containerName="pull" Jun 03 20:52:18.377898 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.377877 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5193a1d9-5efe-41c4-af76-333dda4c016a" containerName="pull" Jun 03 20:52:18.378121 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.377954 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5193a1d9-5efe-41c4-af76-333dda4c016a" containerName="extract" Jun 03 20:52:18.382408 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.382384 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" Jun 03 20:52:18.385373 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.385176 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 20:52:18.386882 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.386379 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hsphm\"" Jun 03 20:52:18.396767 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.396739 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z6pw7"] Jun 03 20:52:18.407235 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.407203 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4"] Jun 03 20:52:18.413066 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.413001 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" Jun 03 20:52:18.416119 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.416091 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 20:52:18.416818 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.416798 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-x8zc2\"" Jun 03 20:52:18.425184 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.425093 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4"] Jun 03 20:52:18.462329 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.462295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb82f21d-e603-4609-b76f-b9cb7b783bbc-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7lpn4\" (UID: \"bb82f21d-e603-4609-b76f-b9cb7b783bbc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" Jun 03 20:52:18.462329 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.462333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gd4x\" (UniqueName: \"kubernetes.io/projected/55f01fdb-e737-496b-925e-e494c1c0688a-kube-api-access-6gd4x\") pod \"kserve-controller-manager-69fc866d76-z6pw7\" (UID: \"55f01fdb-e737-496b-925e-e494c1c0688a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" Jun 03 20:52:18.462548 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.462362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctz5m\" (UniqueName: \"kubernetes.io/projected/bb82f21d-e603-4609-b76f-b9cb7b783bbc-kube-api-access-ctz5m\") pod \"llmisvc-controller-manager-864bfd7bc9-7lpn4\" (UID: \"bb82f21d-e603-4609-b76f-b9cb7b783bbc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" Jun 03 20:52:18.462548 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.462393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55f01fdb-e737-496b-925e-e494c1c0688a-cert\") pod \"kserve-controller-manager-69fc866d76-z6pw7\" (UID: \"55f01fdb-e737-496b-925e-e494c1c0688a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" Jun 03 20:52:18.563376 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.563339 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55f01fdb-e737-496b-925e-e494c1c0688a-cert\") pod \"kserve-controller-manager-69fc866d76-z6pw7\" (UID: \"55f01fdb-e737-496b-925e-e494c1c0688a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" Jun 03 20:52:18.563533 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.563412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb82f21d-e603-4609-b76f-b9cb7b783bbc-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7lpn4\" (UID: \"bb82f21d-e603-4609-b76f-b9cb7b783bbc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" Jun 03 20:52:18.563533 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.563433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gd4x\" (UniqueName: \"kubernetes.io/projected/55f01fdb-e737-496b-925e-e494c1c0688a-kube-api-access-6gd4x\") pod \"kserve-controller-manager-69fc866d76-z6pw7\" (UID: \"55f01fdb-e737-496b-925e-e494c1c0688a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" Jun 03 20:52:18.563533 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.563456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz5m\" (UniqueName: \"kubernetes.io/projected/bb82f21d-e603-4609-b76f-b9cb7b783bbc-kube-api-access-ctz5m\") pod \"llmisvc-controller-manager-864bfd7bc9-7lpn4\" (UID: \"bb82f21d-e603-4609-b76f-b9cb7b783bbc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" Jun 03 20:52:18.565952 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.565913 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb82f21d-e603-4609-b76f-b9cb7b783bbc-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7lpn4\" (UID: \"bb82f21d-e603-4609-b76f-b9cb7b783bbc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" Jun 03 20:52:18.566057 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.565970 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55f01fdb-e737-496b-925e-e494c1c0688a-cert\") pod \"kserve-controller-manager-69fc866d76-z6pw7\" (UID: \"55f01fdb-e737-496b-925e-e494c1c0688a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" Jun 03 20:52:18.578489 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.578465 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctz5m\" (UniqueName: \"kubernetes.io/projected/bb82f21d-e603-4609-b76f-b9cb7b783bbc-kube-api-access-ctz5m\") pod \"llmisvc-controller-manager-864bfd7bc9-7lpn4\" (UID: \"bb82f21d-e603-4609-b76f-b9cb7b783bbc\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" Jun 03 20:52:18.582898 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.582871 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gd4x\" (UniqueName: \"kubernetes.io/projected/55f01fdb-e737-496b-925e-e494c1c0688a-kube-api-access-6gd4x\") pod \"kserve-controller-manager-69fc866d76-z6pw7\" (UID: \"55f01fdb-e737-496b-925e-e494c1c0688a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" Jun 03 20:52:18.695309 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.695229 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" Jun 03 20:52:18.726302 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.726264 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" Jun 03 20:52:18.850512 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.850482 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z6pw7"] Jun 03 20:52:18.853213 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:52:18.853174 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f01fdb_e737_496b_925e_e494c1c0688a.slice/crio-2dd40154f96471cbaa0f44d494895842e3455fdbae09fe9551efd1fadd4ebed1 WatchSource:0}: Error finding container 2dd40154f96471cbaa0f44d494895842e3455fdbae09fe9551efd1fadd4ebed1: Status 404 returned error can't find the container with id 2dd40154f96471cbaa0f44d494895842e3455fdbae09fe9551efd1fadd4ebed1 Jun 03 20:52:18.883783 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.883743 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" event={"ID":"55f01fdb-e737-496b-925e-e494c1c0688a","Type":"ContainerStarted","Data":"2dd40154f96471cbaa0f44d494895842e3455fdbae09fe9551efd1fadd4ebed1"} Jun 03 20:52:18.887078 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.887018 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" event={"ID":"5193a1d9-5efe-41c4-af76-333dda4c016a","Type":"ContainerDied","Data":"b99c488f6817da42480ef09a054684e91b6f36bdd51abc2da0d261079c00ad2a"} Jun 03 20:52:18.887078 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.887072 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b99c488f6817da42480ef09a054684e91b6f36bdd51abc2da0d261079c00ad2a" Jun 03 20:52:18.887189 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.887167 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06w2rgw" Jun 03 20:52:18.887313 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:18.887290 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4"] Jun 03 20:52:18.889466 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:52:18.889443 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbb82f21d_e603_4609_b76f_b9cb7b783bbc.slice/crio-a0d436be32ad408e8a459ab575e1b3d85bcbff75a40ccb349ff96cdfafd2e0e4 WatchSource:0}: Error finding container a0d436be32ad408e8a459ab575e1b3d85bcbff75a40ccb349ff96cdfafd2e0e4: Status 404 returned error can't find the container with id a0d436be32ad408e8a459ab575e1b3d85bcbff75a40ccb349ff96cdfafd2e0e4 Jun 03 20:52:19.895281 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:19.895242 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" event={"ID":"bb82f21d-e603-4609-b76f-b9cb7b783bbc","Type":"ContainerStarted","Data":"a0d436be32ad408e8a459ab575e1b3d85bcbff75a40ccb349ff96cdfafd2e0e4"} Jun 03 20:52:22.911640 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:22.911605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" event={"ID":"bb82f21d-e603-4609-b76f-b9cb7b783bbc","Type":"ContainerStarted","Data":"6434fc3d938525e5f9230baeb62fc2c224309ef0e5b0adbe684e6aefd9edeece"} Jun 03 20:52:22.912106 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:22.911669 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" Jun 03 20:52:22.913106 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:22.913081 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" event={"ID":"55f01fdb-e737-496b-925e-e494c1c0688a","Type":"ContainerStarted","Data":"b92ea0f6c8a3d75ad715d4d1e751a3687bc29053fc0148b38ec352f56ccd9878"} Jun 03 20:52:22.913220 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:22.913130 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" Jun 03 20:52:22.945838 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:22.945780 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" podStartSLOduration=1.627807995 podStartE2EDuration="4.94576471s" totalImagesPullingTime="3.317956715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:22.943309754 +0000 UTC m=+527.542188717" watchObservedRunningTime="2026-06-03 20:52:22.94576471 +0000 UTC m=+527.544643672" Jun 03 20:52:22.975893 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:22.975831 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" podStartSLOduration=1.619397272 podStartE2EDuration="4.97581023s" totalImagesPullingTime="3.356412958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:22.973521784 +0000 UTC m=+527.572400742" watchObservedRunningTime="2026-06-03 20:52:22.97581023 +0000 UTC m=+527.574689213" Jun 03 20:52:23.855404 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:23.855372 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-9j652" Jun 03 20:52:26.872707 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:26.872627 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-4ffk4" Jun 03 20:52:30.992583 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:30.992547 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp"] Jun 03 20:52:30.996250 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:30.996226 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:30.998841 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:30.998820 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:52:30.998982 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:30.998847 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:52:30.999069 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:30.998993 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9lnn\"" Jun 03 20:52:31.004471 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.004449 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp"] Jun 03 20:52:31.070737 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.070708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:31.070911 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.070775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:31.070911 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.070833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx8cs\" (UniqueName: \"kubernetes.io/projected/da33875f-b592-4a85-9fa2-75ea5a3a63ca-kube-api-access-jx8cs\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:31.171658 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.171620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:31.171860 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.171670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx8cs\" (UniqueName: \"kubernetes.io/projected/da33875f-b592-4a85-9fa2-75ea5a3a63ca-kube-api-access-jx8cs\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:31.171860 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.171704 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:31.172122 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.172101 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:31.172122 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.172115 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:31.180429 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.180404 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx8cs\" (UniqueName: \"kubernetes.io/projected/da33875f-b592-4a85-9fa2-75ea5a3a63ca-kube-api-access-jx8cs\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:31.306631 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.306593 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:31.444109 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.444081 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp"] Jun 03 20:52:31.445860 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:52:31.445835 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda33875f_b592_4a85_9fa2_75ea5a3a63ca.slice/crio-3e350234a6035c0731b5e485b4a9652d3200df7a9d6df3cbef671f6afa42be8e WatchSource:0}: Error finding container 3e350234a6035c0731b5e485b4a9652d3200df7a9d6df3cbef671f6afa42be8e: Status 404 returned error can't find the container with id 3e350234a6035c0731b5e485b4a9652d3200df7a9d6df3cbef671f6afa42be8e Jun 03 20:52:31.960164 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.960077 2563 generic.go:356] "Generic (PLEG): container finished" podID="da33875f-b592-4a85-9fa2-75ea5a3a63ca" containerID="3f4b822a379a8b4ae89c0935d43b49f4684fb154e34a7613eba8fadc1e016e22" exitCode=0 Jun 03 20:52:31.960311 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.960164 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" event={"ID":"da33875f-b592-4a85-9fa2-75ea5a3a63ca","Type":"ContainerDied","Data":"3f4b822a379a8b4ae89c0935d43b49f4684fb154e34a7613eba8fadc1e016e22"} Jun 03 20:52:31.960311 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:31.960200 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" event={"ID":"da33875f-b592-4a85-9fa2-75ea5a3a63ca","Type":"ContainerStarted","Data":"3e350234a6035c0731b5e485b4a9652d3200df7a9d6df3cbef671f6afa42be8e"} Jun 03 20:52:32.966596 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:32.966563 2563 generic.go:356] "Generic (PLEG): container finished" podID="da33875f-b592-4a85-9fa2-75ea5a3a63ca" containerID="90cf5ab6180131ca3c137af6bb5c8ae627a007b870f12de99fe8a886f43608ff" exitCode=0 Jun 03 20:52:32.967016 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:32.966651 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" event={"ID":"da33875f-b592-4a85-9fa2-75ea5a3a63ca","Type":"ContainerDied","Data":"90cf5ab6180131ca3c137af6bb5c8ae627a007b870f12de99fe8a886f43608ff"} Jun 03 20:52:33.160000 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.159961 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p"] Jun 03 20:52:33.163856 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.163831 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" Jun 03 20:52:33.166315 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.166276 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-ml8v4\"" Jun 03 20:52:33.166449 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.166297 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 20:52:33.166449 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.166355 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 20:52:33.184286 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.184264 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p"] Jun 03 20:52:33.289706 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.289649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9h82\" (UniqueName: \"kubernetes.io/projected/a2a71085-b77d-42b3-8c2c-8830bce92c1c-kube-api-access-k9h82\") pod \"servicemesh-operator3-57f65f65fb-fmk9p\" (UID: \"a2a71085-b77d-42b3-8c2c-8830bce92c1c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" Jun 03 20:52:33.289915 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.289777 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a2a71085-b77d-42b3-8c2c-8830bce92c1c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fmk9p\" (UID: \"a2a71085-b77d-42b3-8c2c-8830bce92c1c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" Jun 03 20:52:33.391186 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.391146 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9h82\" (UniqueName: \"kubernetes.io/projected/a2a71085-b77d-42b3-8c2c-8830bce92c1c-kube-api-access-k9h82\") pod \"servicemesh-operator3-57f65f65fb-fmk9p\" (UID: \"a2a71085-b77d-42b3-8c2c-8830bce92c1c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" Jun 03 20:52:33.391341 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.391248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a2a71085-b77d-42b3-8c2c-8830bce92c1c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fmk9p\" (UID: \"a2a71085-b77d-42b3-8c2c-8830bce92c1c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" Jun 03 20:52:33.393894 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.393859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a2a71085-b77d-42b3-8c2c-8830bce92c1c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fmk9p\" (UID: \"a2a71085-b77d-42b3-8c2c-8830bce92c1c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" Jun 03 20:52:33.403835 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.403808 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9h82\" (UniqueName: \"kubernetes.io/projected/a2a71085-b77d-42b3-8c2c-8830bce92c1c-kube-api-access-k9h82\") pod \"servicemesh-operator3-57f65f65fb-fmk9p\" (UID: \"a2a71085-b77d-42b3-8c2c-8830bce92c1c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" Jun 03 20:52:33.524669 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.524636 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" Jun 03 20:52:33.661309 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.661276 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p"] Jun 03 20:52:33.665070 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:52:33.665042 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a71085_b77d_42b3_8c2c_8830bce92c1c.slice/crio-1f29b3209571eed7bc9e81f0252b52593485bbf39fbd5fc3d70c4b87ebbc5726 WatchSource:0}: Error finding container 1f29b3209571eed7bc9e81f0252b52593485bbf39fbd5fc3d70c4b87ebbc5726: Status 404 returned error can't find the container with id 1f29b3209571eed7bc9e81f0252b52593485bbf39fbd5fc3d70c4b87ebbc5726 Jun 03 20:52:33.973537 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.973440 2563 generic.go:356] "Generic (PLEG): container finished" podID="da33875f-b592-4a85-9fa2-75ea5a3a63ca" containerID="b588c1a10ab29d549c5f11cc89b02e35515286df84cd90f16bcca390f1f3afcd" exitCode=0 Jun 03 20:52:33.973537 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.973519 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" event={"ID":"da33875f-b592-4a85-9fa2-75ea5a3a63ca","Type":"ContainerDied","Data":"b588c1a10ab29d549c5f11cc89b02e35515286df84cd90f16bcca390f1f3afcd"} Jun 03 20:52:33.975142 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:33.975117 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" event={"ID":"a2a71085-b77d-42b3-8c2c-8830bce92c1c","Type":"ContainerStarted","Data":"1f29b3209571eed7bc9e81f0252b52593485bbf39fbd5fc3d70c4b87ebbc5726"} Jun 03 20:52:35.120203 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.120174 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:35.206042 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.206012 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-bundle\") pod \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " Jun 03 20:52:35.206212 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.206084 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx8cs\" (UniqueName: \"kubernetes.io/projected/da33875f-b592-4a85-9fa2-75ea5a3a63ca-kube-api-access-jx8cs\") pod \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " Jun 03 20:52:35.206212 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.206120 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-util\") pod \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\" (UID: \"da33875f-b592-4a85-9fa2-75ea5a3a63ca\") " Jun 03 20:52:35.207017 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.206990 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-bundle" (OuterVolumeSpecName: "bundle") pod "da33875f-b592-4a85-9fa2-75ea5a3a63ca" (UID: "da33875f-b592-4a85-9fa2-75ea5a3a63ca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:52:35.208033 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.208010 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da33875f-b592-4a85-9fa2-75ea5a3a63ca-kube-api-access-jx8cs" (OuterVolumeSpecName: "kube-api-access-jx8cs") pod "da33875f-b592-4a85-9fa2-75ea5a3a63ca" (UID: "da33875f-b592-4a85-9fa2-75ea5a3a63ca"). InnerVolumeSpecName "kube-api-access-jx8cs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:52:35.212049 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.212024 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-util" (OuterVolumeSpecName: "util") pod "da33875f-b592-4a85-9fa2-75ea5a3a63ca" (UID: "da33875f-b592-4a85-9fa2-75ea5a3a63ca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:52:35.307595 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.307559 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:52:35.307595 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.307592 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da33875f-b592-4a85-9fa2-75ea5a3a63ca-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:52:35.307806 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.307606 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx8cs\" (UniqueName: \"kubernetes.io/projected/da33875f-b592-4a85-9fa2-75ea5a3a63ca-kube-api-access-jx8cs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:52:35.988687 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.988640 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" event={"ID":"da33875f-b592-4a85-9fa2-75ea5a3a63ca","Type":"ContainerDied","Data":"3e350234a6035c0731b5e485b4a9652d3200df7a9d6df3cbef671f6afa42be8e"} Jun 03 20:52:35.988863 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.988701 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e350234a6035c0731b5e485b4a9652d3200df7a9d6df3cbef671f6afa42be8e" Jun 03 20:52:35.988863 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:35.988711 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9t7wp" Jun 03 20:52:36.995485 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:36.995450 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" event={"ID":"a2a71085-b77d-42b3-8c2c-8830bce92c1c","Type":"ContainerStarted","Data":"80fb51290fefbbcbd458797d7d9107cf498333d6e85c4b42b4c2025d1424dd1b"} Jun 03 20:52:36.995878 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:36.995541 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" Jun 03 20:52:37.015642 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:37.015588 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" podStartSLOduration=1.298858648 podStartE2EDuration="4.0155728s" totalImagesPullingTime="2.716714152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:37.013931161 +0000 UTC m=+541.612810124" watchObservedRunningTime="2026-06-03 20:52:37.0155728 +0000 UTC m=+541.614451764" Jun 03 20:52:38.593343 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.593308 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56dd8b9685-c8rr8"] Jun 03 20:52:38.593804 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.593786 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da33875f-b592-4a85-9fa2-75ea5a3a63ca" containerName="extract" Jun 03 20:52:38.593852 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.593806 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da33875f-b592-4a85-9fa2-75ea5a3a63ca" containerName="extract" Jun 03 20:52:38.593852 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.593834 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da33875f-b592-4a85-9fa2-75ea5a3a63ca" containerName="util" Jun 03 20:52:38.593852 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.593843 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da33875f-b592-4a85-9fa2-75ea5a3a63ca" containerName="util" Jun 03 20:52:38.593852 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.593853 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da33875f-b592-4a85-9fa2-75ea5a3a63ca" containerName="pull" Jun 03 20:52:38.594024 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.593858 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da33875f-b592-4a85-9fa2-75ea5a3a63ca" containerName="pull" Jun 03 20:52:38.594024 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.593920 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="da33875f-b592-4a85-9fa2-75ea5a3a63ca" containerName="extract" Jun 03 20:52:38.597073 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.597056 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56dd8b9685-c8rr8" Jun 03 20:52:38.599782 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.599757 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hdhcr\"" Jun 03 20:52:38.599900 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.599765 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 20:52:38.609741 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.607398 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56dd8b9685-c8rr8"] Jun 03 20:52:38.741252 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.741218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/73a26330-3c83-4bc8-ae21-f6bb1cc26e16-redirect-config\") pod \"dashboard-redirect-56dd8b9685-c8rr8\" (UID: \"73a26330-3c83-4bc8-ae21-f6bb1cc26e16\") " pod="opendatahub/dashboard-redirect-56dd8b9685-c8rr8" Jun 03 20:52:38.741446 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.741272 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tt4j\" (UniqueName: \"kubernetes.io/projected/73a26330-3c83-4bc8-ae21-f6bb1cc26e16-kube-api-access-9tt4j\") pod \"dashboard-redirect-56dd8b9685-c8rr8\" (UID: \"73a26330-3c83-4bc8-ae21-f6bb1cc26e16\") " pod="opendatahub/dashboard-redirect-56dd8b9685-c8rr8" Jun 03 20:52:38.841809 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.841774 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/73a26330-3c83-4bc8-ae21-f6bb1cc26e16-redirect-config\") pod \"dashboard-redirect-56dd8b9685-c8rr8\" (UID: \"73a26330-3c83-4bc8-ae21-f6bb1cc26e16\") " pod="opendatahub/dashboard-redirect-56dd8b9685-c8rr8" Jun 03 20:52:38.842005 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.841833 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tt4j\" (UniqueName: \"kubernetes.io/projected/73a26330-3c83-4bc8-ae21-f6bb1cc26e16-kube-api-access-9tt4j\") pod \"dashboard-redirect-56dd8b9685-c8rr8\" (UID: \"73a26330-3c83-4bc8-ae21-f6bb1cc26e16\") " pod="opendatahub/dashboard-redirect-56dd8b9685-c8rr8" Jun 03 20:52:38.842536 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.842513 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/73a26330-3c83-4bc8-ae21-f6bb1cc26e16-redirect-config\") pod \"dashboard-redirect-56dd8b9685-c8rr8\" (UID: \"73a26330-3c83-4bc8-ae21-f6bb1cc26e16\") " pod="opendatahub/dashboard-redirect-56dd8b9685-c8rr8" Jun 03 20:52:38.850792 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.850734 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tt4j\" (UniqueName: \"kubernetes.io/projected/73a26330-3c83-4bc8-ae21-f6bb1cc26e16-kube-api-access-9tt4j\") pod \"dashboard-redirect-56dd8b9685-c8rr8\" (UID: \"73a26330-3c83-4bc8-ae21-f6bb1cc26e16\") " pod="opendatahub/dashboard-redirect-56dd8b9685-c8rr8" Jun 03 20:52:38.912897 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:38.912848 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56dd8b9685-c8rr8" Jun 03 20:52:39.045010 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:39.044981 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56dd8b9685-c8rr8"] Jun 03 20:52:39.046595 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:52:39.046572 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a26330_3c83_4bc8_ae21_f6bb1cc26e16.slice/crio-7c6eb49b411cf25ed4887da6afb3089bfede3c072cebbf222ec0378b4ba31782 WatchSource:0}: Error finding container 7c6eb49b411cf25ed4887da6afb3089bfede3c072cebbf222ec0378b4ba31782: Status 404 returned error can't find the container with id 7c6eb49b411cf25ed4887da6afb3089bfede3c072cebbf222ec0378b4ba31782 Jun 03 20:52:40.012971 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:40.012917 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56dd8b9685-c8rr8" event={"ID":"73a26330-3c83-4bc8-ae21-f6bb1cc26e16","Type":"ContainerStarted","Data":"7c6eb49b411cf25ed4887da6afb3089bfede3c072cebbf222ec0378b4ba31782"} Jun 03 20:52:44.036619 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:44.036580 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56dd8b9685-c8rr8" event={"ID":"73a26330-3c83-4bc8-ae21-f6bb1cc26e16","Type":"ContainerStarted","Data":"ffafa3d0415d86a38a4d8c9b829bfee8dcfd8df17f0a05da3994f9adf0580f3e"} Jun 03 20:52:44.054240 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:44.054187 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56dd8b9685-c8rr8" podStartSLOduration=1.3592593800000001 podStartE2EDuration="6.054172127s" totalImagesPullingTime="4.694912747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:44.053008111 +0000 UTC m=+548.651887073" watchObservedRunningTime="2026-06-03 20:52:44.054172127 +0000 UTC m=+548.653051133" Jun 03 20:52:48.003454 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:48.003423 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fmk9p" Jun 03 20:52:53.921002 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:53.920973 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7lpn4" Jun 03 20:52:53.924171 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:52:53.924150 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-z6pw7" Jun 03 20:53:00.336347 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.336316 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk"] Jun 03 20:53:00.339916 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.339895 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.342436 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.342411 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 20:53:00.342436 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.342430 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 20:53:00.342608 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.342418 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 20:53:00.342608 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.342449 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 20:53:00.342608 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.342529 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zrp2j\"" Jun 03 20:53:00.351521 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.351500 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk"] Jun 03 20:53:00.432396 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.432361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.432564 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.432415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.432564 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.432445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.432564 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.432474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8vhw\" (UniqueName: \"kubernetes.io/projected/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-kube-api-access-v8vhw\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.432564 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.432505 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.432564 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.432539 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.432744 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.432630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.534016 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.533982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.534206 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.534036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.534206 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.534084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.534206 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.534131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.534206 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.534177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.534424 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.534209 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.534424 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.534236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8vhw\" (UniqueName: \"kubernetes.io/projected/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-kube-api-access-v8vhw\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.534706 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.534676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.536583 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.536556 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.536776 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.536755 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.537060 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.537029 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.537173 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.537033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.543128 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.543101 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8vhw\" (UniqueName: \"kubernetes.io/projected/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-kube-api-access-v8vhw\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.543416 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.543397 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-l9xhk\" (UID: \"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.650370 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.650283 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:00.797701 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:00.797641 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk"] Jun 03 20:53:00.799884 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:53:00.799849 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e406d5_d7c4_4bfc_a1f2_7ffc37ee5383.slice/crio-45e5bf92b0193fe4a9b177b0e82399d3f771484463312799b9c88e66f4918e7a WatchSource:0}: Error finding container 45e5bf92b0193fe4a9b177b0e82399d3f771484463312799b9c88e66f4918e7a: Status 404 returned error can't find the container with id 45e5bf92b0193fe4a9b177b0e82399d3f771484463312799b9c88e66f4918e7a Jun 03 20:53:01.127107 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:01.127069 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" event={"ID":"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383","Type":"ContainerStarted","Data":"45e5bf92b0193fe4a9b177b0e82399d3f771484463312799b9c88e66f4918e7a"} Jun 03 20:53:02.862569 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:02.862530 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 20:53:02.862817 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:02.862604 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 20:53:03.140207 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:03.140104 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" event={"ID":"35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383","Type":"ContainerStarted","Data":"04222583bb7877c4b1fe4560326ae4ded3f9cb2f17f5c65cd66383c2e50c041a"} Jun 03 20:53:03.140373 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:03.140304 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:03.142116 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:03.142088 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-l9xhk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 03 20:53:03.142226 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:03.142145 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" podUID="35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:53:03.162754 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:03.162710 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" podStartSLOduration=1.102356206 podStartE2EDuration="3.162697141s" totalImagesPullingTime="2.060340935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:03.160072118 +0000 UTC m=+567.758951092" watchObservedRunningTime="2026-06-03 20:53:03.162697141 +0000 UTC m=+567.761576103" Jun 03 20:53:04.146192 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:04.146153 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-l9xhk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 03 20:53:04.146544 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:04.146204 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" podUID="35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:53:07.146158 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:07.146130 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l9xhk" Jun 03 20:53:24.274379 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.274342 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct"] Jun 03 20:53:24.304021 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.303994 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct"] Jun 03 20:53:24.304171 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.304091 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:24.307109 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.307085 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 20:53:24.307243 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.307213 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 20:53:24.308042 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.308024 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7zxcz\"" Jun 03 20:53:24.452834 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.452787 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:24.453030 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.452859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:24.453030 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.452894 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l58xl\" (UniqueName: \"kubernetes.io/projected/540236b5-137a-42f5-8e4a-06b26f1b120f-kube-api-access-l58xl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:24.553400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.553300 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:24.553400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.553365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l58xl\" (UniqueName: \"kubernetes.io/projected/540236b5-137a-42f5-8e4a-06b26f1b120f-kube-api-access-l58xl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:24.553592 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.553434 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:24.553780 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.553760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:24.553820 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.553775 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:24.564022 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.564000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l58xl\" (UniqueName: \"kubernetes.io/projected/540236b5-137a-42f5-8e4a-06b26f1b120f-kube-api-access-l58xl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:24.613542 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.613516 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:24.713615 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.713583 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc"] Jun 03 20:53:24.718535 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.718508 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:24.725472 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.725449 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc"] Jun 03 20:53:24.750430 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.750408 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct"] Jun 03 20:53:24.752489 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:53:24.752458 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540236b5_137a_42f5_8e4a_06b26f1b120f.slice/crio-94b3a02b94f93b7ee05223b1c9db8452730c548115220fae5d95203bdb00e9a3 WatchSource:0}: Error finding container 94b3a02b94f93b7ee05223b1c9db8452730c548115220fae5d95203bdb00e9a3: Status 404 returned error can't find the container with id 94b3a02b94f93b7ee05223b1c9db8452730c548115220fae5d95203bdb00e9a3 Jun 03 20:53:24.856014 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.855983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml7b5\" (UniqueName: \"kubernetes.io/projected/79536e91-690a-4cc6-86df-3bec085989c2-kube-api-access-ml7b5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:24.856132 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.856061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:24.856132 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.856099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:24.956955 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.956918 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:24.957149 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.956983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:24.957149 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.957062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml7b5\" (UniqueName: \"kubernetes.io/projected/79536e91-690a-4cc6-86df-3bec085989c2-kube-api-access-ml7b5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:24.957341 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.957317 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:24.957453 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.957430 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:24.965358 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:24.965338 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml7b5\" (UniqueName: \"kubernetes.io/projected/79536e91-690a-4cc6-86df-3bec085989c2-kube-api-access-ml7b5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:25.031523 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.031484 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:25.162775 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.162745 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc"] Jun 03 20:53:25.163918 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:53:25.163893 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79536e91_690a_4cc6_86df_3bec085989c2.slice/crio-b6ad88f357f9ae90db9b6a98de6979be124bde7b7ea690fd67cf536eefc6fcc0 WatchSource:0}: Error finding container b6ad88f357f9ae90db9b6a98de6979be124bde7b7ea690fd67cf536eefc6fcc0: Status 404 returned error can't find the container with id b6ad88f357f9ae90db9b6a98de6979be124bde7b7ea690fd67cf536eefc6fcc0 Jun 03 20:53:25.255431 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.255399 2563 generic.go:356] "Generic (PLEG): container finished" podID="540236b5-137a-42f5-8e4a-06b26f1b120f" containerID="d5af91f28d1e7585af1f33919d12bc90b0e839a456e227269afb3008db6623f8" exitCode=0 Jun 03 20:53:25.255583 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.255488 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" event={"ID":"540236b5-137a-42f5-8e4a-06b26f1b120f","Type":"ContainerDied","Data":"d5af91f28d1e7585af1f33919d12bc90b0e839a456e227269afb3008db6623f8"} Jun 03 20:53:25.255583 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.255540 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" event={"ID":"540236b5-137a-42f5-8e4a-06b26f1b120f","Type":"ContainerStarted","Data":"94b3a02b94f93b7ee05223b1c9db8452730c548115220fae5d95203bdb00e9a3"} Jun 03 20:53:25.257264 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.257237 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" event={"ID":"79536e91-690a-4cc6-86df-3bec085989c2","Type":"ContainerStarted","Data":"448be9e16b4f03527a016d815609036b14b04e0a650386709163f92841a02746"} Jun 03 20:53:25.257385 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.257279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" event={"ID":"79536e91-690a-4cc6-86df-3bec085989c2","Type":"ContainerStarted","Data":"b6ad88f357f9ae90db9b6a98de6979be124bde7b7ea690fd67cf536eefc6fcc0"} Jun 03 20:53:25.271003 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.270978 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6"] Jun 03 20:53:25.274639 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.274618 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:25.282345 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.282312 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6"] Jun 03 20:53:25.360174 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.360114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmnqj\" (UniqueName: \"kubernetes.io/projected/120e8ada-f094-4817-b982-cd7d3959561a-kube-api-access-jmnqj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:25.360174 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.360161 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:25.360371 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.360312 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:25.460764 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.460727 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:25.460974 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.460782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmnqj\" (UniqueName: \"kubernetes.io/projected/120e8ada-f094-4817-b982-cd7d3959561a-kube-api-access-jmnqj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:25.460974 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.460833 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:25.461124 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.461102 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:25.461222 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.461203 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:25.469677 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.469646 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmnqj\" (UniqueName: \"kubernetes.io/projected/120e8ada-f094-4817-b982-cd7d3959561a-kube-api-access-jmnqj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:25.632227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.632139 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:25.763967 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.763912 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6"] Jun 03 20:53:25.765429 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:53:25.765399 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120e8ada_f094_4817_b982_cd7d3959561a.slice/crio-81e9590680de0b42169afb4fde7e8e0f5bf8c5f87025b44be258ff770a0f0a02 WatchSource:0}: Error finding container 81e9590680de0b42169afb4fde7e8e0f5bf8c5f87025b44be258ff770a0f0a02: Status 404 returned error can't find the container with id 81e9590680de0b42169afb4fde7e8e0f5bf8c5f87025b44be258ff770a0f0a02 Jun 03 20:53:25.879142 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.879107 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c"] Jun 03 20:53:25.883601 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.883544 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:25.887983 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:25.887938 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c"] Jun 03 20:53:26.066018 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.065984 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpgwj\" (UniqueName: \"kubernetes.io/projected/987b958e-2afc-4184-ba16-69b560c1f9a5-kube-api-access-qpgwj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:26.066187 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.066160 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:26.066230 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.066209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:26.167288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.167190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpgwj\" (UniqueName: \"kubernetes.io/projected/987b958e-2afc-4184-ba16-69b560c1f9a5-kube-api-access-qpgwj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:26.167288 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.167267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:26.167513 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.167302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:26.167648 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.167631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:26.167688 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.167663 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:26.175995 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.175973 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpgwj\" (UniqueName: \"kubernetes.io/projected/987b958e-2afc-4184-ba16-69b560c1f9a5-kube-api-access-qpgwj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:26.253159 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.253124 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:26.264968 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.264812 2563 generic.go:356] "Generic (PLEG): container finished" podID="79536e91-690a-4cc6-86df-3bec085989c2" containerID="448be9e16b4f03527a016d815609036b14b04e0a650386709163f92841a02746" exitCode=0 Jun 03 20:53:26.264968 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.264897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" event={"ID":"79536e91-690a-4cc6-86df-3bec085989c2","Type":"ContainerDied","Data":"448be9e16b4f03527a016d815609036b14b04e0a650386709163f92841a02746"} Jun 03 20:53:26.267013 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.266985 2563 generic.go:356] "Generic (PLEG): container finished" podID="540236b5-137a-42f5-8e4a-06b26f1b120f" containerID="c5359a54ce6e15940b287aa982e91bf99eedc64f38d1842c8f7b944e9d5a3a4f" exitCode=0 Jun 03 20:53:26.267128 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.267064 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" event={"ID":"540236b5-137a-42f5-8e4a-06b26f1b120f","Type":"ContainerDied","Data":"c5359a54ce6e15940b287aa982e91bf99eedc64f38d1842c8f7b944e9d5a3a4f"} Jun 03 20:53:26.268686 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.268666 2563 generic.go:356] "Generic (PLEG): container finished" podID="120e8ada-f094-4817-b982-cd7d3959561a" containerID="7df24309c53ce49ecdcd7571b3733438f560f7cdff0571c78e425fec7eff2f60" exitCode=0 Jun 03 20:53:26.268768 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.268744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" event={"ID":"120e8ada-f094-4817-b982-cd7d3959561a","Type":"ContainerDied","Data":"7df24309c53ce49ecdcd7571b3733438f560f7cdff0571c78e425fec7eff2f60"} Jun 03 20:53:26.268827 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.268800 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" event={"ID":"120e8ada-f094-4817-b982-cd7d3959561a","Type":"ContainerStarted","Data":"81e9590680de0b42169afb4fde7e8e0f5bf8c5f87025b44be258ff770a0f0a02"} Jun 03 20:53:26.393031 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:26.392923 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c"] Jun 03 20:53:26.396346 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:53:26.396318 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987b958e_2afc_4184_ba16_69b560c1f9a5.slice/crio-78a4fd03308824e28582bc9a0a68c70d0119caf02d3adab017e50109208cdeca WatchSource:0}: Error finding container 78a4fd03308824e28582bc9a0a68c70d0119caf02d3adab017e50109208cdeca: Status 404 returned error can't find the container with id 78a4fd03308824e28582bc9a0a68c70d0119caf02d3adab017e50109208cdeca Jun 03 20:53:27.276449 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:27.276414 2563 generic.go:356] "Generic (PLEG): container finished" podID="79536e91-690a-4cc6-86df-3bec085989c2" containerID="4f9311375c55579a3543286c303105e86d464c831bb15cea2de5791879784ba4" exitCode=0 Jun 03 20:53:27.276618 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:27.276496 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" event={"ID":"79536e91-690a-4cc6-86df-3bec085989c2","Type":"ContainerDied","Data":"4f9311375c55579a3543286c303105e86d464c831bb15cea2de5791879784ba4"} Jun 03 20:53:27.278016 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:27.277991 2563 generic.go:356] "Generic (PLEG): container finished" podID="987b958e-2afc-4184-ba16-69b560c1f9a5" containerID="3d78f2e175703789b46d87a9e2af722c1c6a2abab1213bd66a1f8e4f3141afab" exitCode=0 Jun 03 20:53:27.278107 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:27.278069 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" event={"ID":"987b958e-2afc-4184-ba16-69b560c1f9a5","Type":"ContainerDied","Data":"3d78f2e175703789b46d87a9e2af722c1c6a2abab1213bd66a1f8e4f3141afab"} Jun 03 20:53:27.278228 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:27.278106 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" event={"ID":"987b958e-2afc-4184-ba16-69b560c1f9a5","Type":"ContainerStarted","Data":"78a4fd03308824e28582bc9a0a68c70d0119caf02d3adab017e50109208cdeca"} Jun 03 20:53:27.280380 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:27.280355 2563 generic.go:356] "Generic (PLEG): container finished" podID="540236b5-137a-42f5-8e4a-06b26f1b120f" containerID="9f34d7bd86ba5635e0fd4435bfea8b4e2360f3ddd6740f29279b92302a00e486" exitCode=0 Jun 03 20:53:27.280474 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:27.280431 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" event={"ID":"540236b5-137a-42f5-8e4a-06b26f1b120f","Type":"ContainerDied","Data":"9f34d7bd86ba5635e0fd4435bfea8b4e2360f3ddd6740f29279b92302a00e486"} Jun 03 20:53:27.282378 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:27.282360 2563 generic.go:356] "Generic (PLEG): container finished" podID="120e8ada-f094-4817-b982-cd7d3959561a" containerID="1fba6b77859f0aef49d68191ca3b9dc60041c47676995cd648334cd7b3724e69" exitCode=0 Jun 03 20:53:27.282468 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:27.282396 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" event={"ID":"120e8ada-f094-4817-b982-cd7d3959561a","Type":"ContainerDied","Data":"1fba6b77859f0aef49d68191ca3b9dc60041c47676995cd648334cd7b3724e69"} Jun 03 20:53:28.290236 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.290202 2563 generic.go:356] "Generic (PLEG): container finished" podID="79536e91-690a-4cc6-86df-3bec085989c2" containerID="2f33443f7814ed8662abbc7b4f325632d82ef903d45f2f4c72200c03f8f76156" exitCode=0 Jun 03 20:53:28.290627 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.290293 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" event={"ID":"79536e91-690a-4cc6-86df-3bec085989c2","Type":"ContainerDied","Data":"2f33443f7814ed8662abbc7b4f325632d82ef903d45f2f4c72200c03f8f76156"} Jun 03 20:53:28.291978 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.291957 2563 generic.go:356] "Generic (PLEG): container finished" podID="987b958e-2afc-4184-ba16-69b560c1f9a5" containerID="8bed91430ce7e4715eb992629cb7d411a441d54e9f2df74183642023e83658c4" exitCode=0 Jun 03 20:53:28.292087 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.291991 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" event={"ID":"987b958e-2afc-4184-ba16-69b560c1f9a5","Type":"ContainerDied","Data":"8bed91430ce7e4715eb992629cb7d411a441d54e9f2df74183642023e83658c4"} Jun 03 20:53:28.294075 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.294055 2563 generic.go:356] "Generic (PLEG): container finished" podID="120e8ada-f094-4817-b982-cd7d3959561a" containerID="354c9afe292f5ed448a278d634ea756ea6f07121435551f7d096fe8ba9e4e7c1" exitCode=0 Jun 03 20:53:28.294181 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.294115 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" event={"ID":"120e8ada-f094-4817-b982-cd7d3959561a","Type":"ContainerDied","Data":"354c9afe292f5ed448a278d634ea756ea6f07121435551f7d096fe8ba9e4e7c1"} Jun 03 20:53:28.431476 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.431452 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:28.590227 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.590195 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-bundle\") pod \"540236b5-137a-42f5-8e4a-06b26f1b120f\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " Jun 03 20:53:28.590346 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.590247 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l58xl\" (UniqueName: \"kubernetes.io/projected/540236b5-137a-42f5-8e4a-06b26f1b120f-kube-api-access-l58xl\") pod \"540236b5-137a-42f5-8e4a-06b26f1b120f\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " Jun 03 20:53:28.590346 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.590316 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-util\") pod \"540236b5-137a-42f5-8e4a-06b26f1b120f\" (UID: \"540236b5-137a-42f5-8e4a-06b26f1b120f\") " Jun 03 20:53:28.590744 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.590717 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-bundle" (OuterVolumeSpecName: "bundle") pod "540236b5-137a-42f5-8e4a-06b26f1b120f" (UID: "540236b5-137a-42f5-8e4a-06b26f1b120f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:28.592665 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.592640 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/540236b5-137a-42f5-8e4a-06b26f1b120f-kube-api-access-l58xl" (OuterVolumeSpecName: "kube-api-access-l58xl") pod "540236b5-137a-42f5-8e4a-06b26f1b120f" (UID: "540236b5-137a-42f5-8e4a-06b26f1b120f"). InnerVolumeSpecName "kube-api-access-l58xl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:53:28.596265 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.596240 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-util" (OuterVolumeSpecName: "util") pod "540236b5-137a-42f5-8e4a-06b26f1b120f" (UID: "540236b5-137a-42f5-8e4a-06b26f1b120f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:28.691445 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.691355 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:28.691445 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.691389 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/540236b5-137a-42f5-8e4a-06b26f1b120f-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:28.691445 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:28.691398 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l58xl\" (UniqueName: \"kubernetes.io/projected/540236b5-137a-42f5-8e4a-06b26f1b120f-kube-api-access-l58xl\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:29.302339 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.302308 2563 generic.go:356] "Generic (PLEG): container finished" podID="987b958e-2afc-4184-ba16-69b560c1f9a5" containerID="1aab890721c13bc35cae3900d4511e3574ad12acdd90972cde6586257d9ab3ae" exitCode=0 Jun 03 20:53:29.302742 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.302403 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" event={"ID":"987b958e-2afc-4184-ba16-69b560c1f9a5","Type":"ContainerDied","Data":"1aab890721c13bc35cae3900d4511e3574ad12acdd90972cde6586257d9ab3ae"} Jun 03 20:53:29.304242 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.304225 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" Jun 03 20:53:29.304303 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.304259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct" event={"ID":"540236b5-137a-42f5-8e4a-06b26f1b120f","Type":"ContainerDied","Data":"94b3a02b94f93b7ee05223b1c9db8452730c548115220fae5d95203bdb00e9a3"} Jun 03 20:53:29.304303 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.304294 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94b3a02b94f93b7ee05223b1c9db8452730c548115220fae5d95203bdb00e9a3" Jun 03 20:53:29.462856 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.462823 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:29.465110 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.465089 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:29.600927 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.600846 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmnqj\" (UniqueName: \"kubernetes.io/projected/120e8ada-f094-4817-b982-cd7d3959561a-kube-api-access-jmnqj\") pod \"120e8ada-f094-4817-b982-cd7d3959561a\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " Jun 03 20:53:29.600927 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.600891 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-util\") pod \"120e8ada-f094-4817-b982-cd7d3959561a\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " Jun 03 20:53:29.601172 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.601007 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml7b5\" (UniqueName: \"kubernetes.io/projected/79536e91-690a-4cc6-86df-3bec085989c2-kube-api-access-ml7b5\") pod \"79536e91-690a-4cc6-86df-3bec085989c2\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " Jun 03 20:53:29.601172 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.601032 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-bundle\") pod \"120e8ada-f094-4817-b982-cd7d3959561a\" (UID: \"120e8ada-f094-4817-b982-cd7d3959561a\") " Jun 03 20:53:29.601172 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.601072 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-util\") pod \"79536e91-690a-4cc6-86df-3bec085989c2\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " Jun 03 20:53:29.601172 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.601122 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-bundle\") pod \"79536e91-690a-4cc6-86df-3bec085989c2\" (UID: \"79536e91-690a-4cc6-86df-3bec085989c2\") " Jun 03 20:53:29.601753 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.601709 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-bundle" (OuterVolumeSpecName: "bundle") pod "120e8ada-f094-4817-b982-cd7d3959561a" (UID: "120e8ada-f094-4817-b982-cd7d3959561a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:29.601827 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.601774 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-bundle" (OuterVolumeSpecName: "bundle") pod "79536e91-690a-4cc6-86df-3bec085989c2" (UID: "79536e91-690a-4cc6-86df-3bec085989c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:29.603567 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.603543 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79536e91-690a-4cc6-86df-3bec085989c2-kube-api-access-ml7b5" (OuterVolumeSpecName: "kube-api-access-ml7b5") pod "79536e91-690a-4cc6-86df-3bec085989c2" (UID: "79536e91-690a-4cc6-86df-3bec085989c2"). InnerVolumeSpecName "kube-api-access-ml7b5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:53:29.603661 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.603542 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/120e8ada-f094-4817-b982-cd7d3959561a-kube-api-access-jmnqj" (OuterVolumeSpecName: "kube-api-access-jmnqj") pod "120e8ada-f094-4817-b982-cd7d3959561a" (UID: "120e8ada-f094-4817-b982-cd7d3959561a"). InnerVolumeSpecName "kube-api-access-jmnqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:53:29.606334 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.606299 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-util" (OuterVolumeSpecName: "util") pod "120e8ada-f094-4817-b982-cd7d3959561a" (UID: "120e8ada-f094-4817-b982-cd7d3959561a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:29.609200 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.609174 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-util" (OuterVolumeSpecName: "util") pod "79536e91-690a-4cc6-86df-3bec085989c2" (UID: "79536e91-690a-4cc6-86df-3bec085989c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:29.702072 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.702035 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmnqj\" (UniqueName: \"kubernetes.io/projected/120e8ada-f094-4817-b982-cd7d3959561a-kube-api-access-jmnqj\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:29.702072 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.702066 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:29.702072 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.702080 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml7b5\" (UniqueName: \"kubernetes.io/projected/79536e91-690a-4cc6-86df-3bec085989c2-kube-api-access-ml7b5\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:29.702296 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.702094 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/120e8ada-f094-4817-b982-cd7d3959561a-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:29.702296 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.702104 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:29.702296 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:29.702111 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79536e91-690a-4cc6-86df-3bec085989c2-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:30.310919 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.310894 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" Jun 03 20:53:30.310919 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.310910 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc" event={"ID":"79536e91-690a-4cc6-86df-3bec085989c2","Type":"ContainerDied","Data":"b6ad88f357f9ae90db9b6a98de6979be124bde7b7ea690fd67cf536eefc6fcc0"} Jun 03 20:53:30.311424 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.310975 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6ad88f357f9ae90db9b6a98de6979be124bde7b7ea690fd67cf536eefc6fcc0" Jun 03 20:53:30.312915 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.312836 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" Jun 03 20:53:30.312915 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.312867 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6" event={"ID":"120e8ada-f094-4817-b982-cd7d3959561a","Type":"ContainerDied","Data":"81e9590680de0b42169afb4fde7e8e0f5bf8c5f87025b44be258ff770a0f0a02"} Jun 03 20:53:30.312915 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.312912 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81e9590680de0b42169afb4fde7e8e0f5bf8c5f87025b44be258ff770a0f0a02" Jun 03 20:53:30.445978 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.445935 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:30.505906 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.505866 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-bundle\") pod \"987b958e-2afc-4184-ba16-69b560c1f9a5\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " Jun 03 20:53:30.506119 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.505916 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpgwj\" (UniqueName: \"kubernetes.io/projected/987b958e-2afc-4184-ba16-69b560c1f9a5-kube-api-access-qpgwj\") pod \"987b958e-2afc-4184-ba16-69b560c1f9a5\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " Jun 03 20:53:30.506119 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.505999 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-util\") pod \"987b958e-2afc-4184-ba16-69b560c1f9a5\" (UID: \"987b958e-2afc-4184-ba16-69b560c1f9a5\") " Jun 03 20:53:30.506483 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.506456 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-bundle" (OuterVolumeSpecName: "bundle") pod "987b958e-2afc-4184-ba16-69b560c1f9a5" (UID: "987b958e-2afc-4184-ba16-69b560c1f9a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:30.508022 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.507997 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/987b958e-2afc-4184-ba16-69b560c1f9a5-kube-api-access-qpgwj" (OuterVolumeSpecName: "kube-api-access-qpgwj") pod "987b958e-2afc-4184-ba16-69b560c1f9a5" (UID: "987b958e-2afc-4184-ba16-69b560c1f9a5"). InnerVolumeSpecName "kube-api-access-qpgwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:53:30.514032 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.514001 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-util" (OuterVolumeSpecName: "util") pod "987b958e-2afc-4184-ba16-69b560c1f9a5" (UID: "987b958e-2afc-4184-ba16-69b560c1f9a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:53:30.607416 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.607337 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:30.607416 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.607365 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/987b958e-2afc-4184-ba16-69b560c1f9a5-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:30.607416 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:30.607374 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpgwj\" (UniqueName: \"kubernetes.io/projected/987b958e-2afc-4184-ba16-69b560c1f9a5-kube-api-access-qpgwj\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:53:31.320328 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:31.320297 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" Jun 03 20:53:31.320748 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:31.320320 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c" event={"ID":"987b958e-2afc-4184-ba16-69b560c1f9a5","Type":"ContainerDied","Data":"78a4fd03308824e28582bc9a0a68c70d0119caf02d3adab017e50109208cdeca"} Jun 03 20:53:31.320748 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:31.320376 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78a4fd03308824e28582bc9a0a68c70d0119caf02d3adab017e50109208cdeca" Jun 03 20:53:35.892030 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:35.891995 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 20:53:35.892529 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:35.892503 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 20:53:45.640203 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640163 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9"] Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640616 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987b958e-2afc-4184-ba16-69b560c1f9a5" containerName="extract" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640636 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="987b958e-2afc-4184-ba16-69b560c1f9a5" containerName="extract" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640647 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540236b5-137a-42f5-8e4a-06b26f1b120f" containerName="util" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640652 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="540236b5-137a-42f5-8e4a-06b26f1b120f" containerName="util" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640659 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79536e91-690a-4cc6-86df-3bec085989c2" containerName="pull" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640668 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79536e91-690a-4cc6-86df-3bec085989c2" containerName="pull" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640680 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120e8ada-f094-4817-b982-cd7d3959561a" containerName="util" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640687 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="120e8ada-f094-4817-b982-cd7d3959561a" containerName="util" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640695 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987b958e-2afc-4184-ba16-69b560c1f9a5" containerName="util" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640703 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="987b958e-2afc-4184-ba16-69b560c1f9a5" containerName="util" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640710 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987b958e-2afc-4184-ba16-69b560c1f9a5" containerName="pull" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640718 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="987b958e-2afc-4184-ba16-69b560c1f9a5" containerName="pull" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640735 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120e8ada-f094-4817-b982-cd7d3959561a" containerName="pull" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640742 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="120e8ada-f094-4817-b982-cd7d3959561a" containerName="pull" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640760 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120e8ada-f094-4817-b982-cd7d3959561a" containerName="extract" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640768 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="120e8ada-f094-4817-b982-cd7d3959561a" containerName="extract" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640775 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540236b5-137a-42f5-8e4a-06b26f1b120f" containerName="pull" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640782 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="540236b5-137a-42f5-8e4a-06b26f1b120f" containerName="pull" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640788 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540236b5-137a-42f5-8e4a-06b26f1b120f" containerName="extract" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640792 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="540236b5-137a-42f5-8e4a-06b26f1b120f" containerName="extract" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640800 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79536e91-690a-4cc6-86df-3bec085989c2" containerName="util" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640806 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79536e91-690a-4cc6-86df-3bec085989c2" containerName="util" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640812 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79536e91-690a-4cc6-86df-3bec085989c2" containerName="extract" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640817 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="79536e91-690a-4cc6-86df-3bec085989c2" containerName="extract" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640881 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="79536e91-690a-4cc6-86df-3bec085989c2" containerName="extract" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640890 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="540236b5-137a-42f5-8e4a-06b26f1b120f" containerName="extract" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640895 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="987b958e-2afc-4184-ba16-69b560c1f9a5" containerName="extract" Jun 03 20:53:45.642726 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.640905 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="120e8ada-f094-4817-b982-cd7d3959561a" containerName="extract" Jun 03 20:53:45.643789 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.643774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:53:45.646297 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.646273 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-66zz9\"" Jun 03 20:53:45.646426 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.646279 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 20:53:45.646426 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.646284 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 20:53:45.654897 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.654877 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9"] Jun 03 20:53:45.736089 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.736051 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dv4s9\" (UID: \"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:53:45.736254 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.736117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rd7r\" (UniqueName: \"kubernetes.io/projected/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-kube-api-access-5rd7r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dv4s9\" (UID: \"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:53:45.837492 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.837455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dv4s9\" (UID: \"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:53:45.837647 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.837514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rd7r\" (UniqueName: \"kubernetes.io/projected/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-kube-api-access-5rd7r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dv4s9\" (UID: \"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:53:45.837901 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.837867 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dv4s9\" (UID: \"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:53:45.848296 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.848278 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rd7r\" (UniqueName: \"kubernetes.io/projected/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-kube-api-access-5rd7r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dv4s9\" (UID: \"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:53:45.954297 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:45.954217 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:53:46.106023 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:46.106000 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9"] Jun 03 20:53:46.107743 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:53:46.107721 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8dfbf3_ac50_4aaf_af01_1b950ae0b35d.slice/crio-41579a4722d271d8073d78bef61c9b0c87815cb49feb107839e64d973717eef1 WatchSource:0}: Error finding container 41579a4722d271d8073d78bef61c9b0c87815cb49feb107839e64d973717eef1: Status 404 returned error can't find the container with id 41579a4722d271d8073d78bef61c9b0c87815cb49feb107839e64d973717eef1 Jun 03 20:53:46.403212 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:46.403180 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" event={"ID":"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d","Type":"ContainerStarted","Data":"41579a4722d271d8073d78bef61c9b0c87815cb49feb107839e64d973717eef1"} Jun 03 20:53:50.427529 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:50.427486 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" event={"ID":"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d","Type":"ContainerStarted","Data":"0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7"} Jun 03 20:53:50.427929 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:50.427668 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:53:50.459359 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:53:50.459309 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" podStartSLOduration=2.122226262 podStartE2EDuration="5.45929522s" totalImagesPullingTime="3.337068958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:50.456648126 +0000 UTC m=+615.055527089" watchObservedRunningTime="2026-06-03 20:53:50.45929522 +0000 UTC m=+615.058174182" Jun 03 20:54:01.435932 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:01.435851 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:54:02.777182 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:02.777144 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b74d844d4-qhhmg"] Jun 03 20:54:03.435133 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.435103 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9"] Jun 03 20:54:03.435341 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.435311 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" podUID="aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d" containerName="manager" containerID="cri-o://0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7" gracePeriod=2 Jun 03 20:54:03.444596 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.444567 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9"] Jun 03 20:54:03.528151 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.528117 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks"] Jun 03 20:54:03.528480 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.528464 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d" containerName="manager" Jun 03 20:54:03.528480 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.528479 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d" containerName="manager" Jun 03 20:54:03.528606 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.528575 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d" containerName="manager" Jun 03 20:54:03.531822 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.531801 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:03.575896 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.575861 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks"] Jun 03 20:54:03.600672 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.600637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsd6k\" (UniqueName: \"kubernetes.io/projected/a10fe660-65f7-4771-8503-069507048712-kube-api-access-vsd6k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8fjks\" (UID: \"a10fe660-65f7-4771-8503-069507048712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:03.600834 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.600734 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a10fe660-65f7-4771-8503-069507048712-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8fjks\" (UID: \"a10fe660-65f7-4771-8503-069507048712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:03.617902 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:54:03.617004 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dv4s9\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:54:03.687457 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.687382 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:54:03.691043 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:54:03.691017 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dv4s9\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:54:03.701447 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.701423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a10fe660-65f7-4771-8503-069507048712-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8fjks\" (UID: \"a10fe660-65f7-4771-8503-069507048712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:03.701556 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.701482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsd6k\" (UniqueName: \"kubernetes.io/projected/a10fe660-65f7-4771-8503-069507048712-kube-api-access-vsd6k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8fjks\" (UID: \"a10fe660-65f7-4771-8503-069507048712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:03.701810 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.701786 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a10fe660-65f7-4771-8503-069507048712-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8fjks\" (UID: \"a10fe660-65f7-4771-8503-069507048712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:03.727247 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.727208 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsd6k\" (UniqueName: \"kubernetes.io/projected/a10fe660-65f7-4771-8503-069507048712-kube-api-access-vsd6k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8fjks\" (UID: \"a10fe660-65f7-4771-8503-069507048712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:03.802141 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.802102 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rd7r\" (UniqueName: \"kubernetes.io/projected/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-kube-api-access-5rd7r\") pod \"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d\" (UID: \"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d\") " Jun 03 20:54:03.802623 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.802171 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-extensions-socket-volume\") pod \"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d\" (UID: \"aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d\") " Jun 03 20:54:03.802751 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.802725 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d" (UID: "aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:54:03.804264 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.804239 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-kube-api-access-5rd7r" (OuterVolumeSpecName: "kube-api-access-5rd7r") pod "aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d" (UID: "aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d"). InnerVolumeSpecName "kube-api-access-5rd7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:54:03.843597 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.843559 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:03.903760 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.903723 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-extensions-socket-volume\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:54:03.903760 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.903759 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rd7r\" (UniqueName: \"kubernetes.io/projected/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d-kube-api-access-5rd7r\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:54:03.908629 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.908589 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d" path="/var/lib/kubelet/pods/aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d/volumes" Jun 03 20:54:03.994914 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:03.994888 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks"] Jun 03 20:54:03.996710 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:54:03.996683 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10fe660_65f7_4771_8503_069507048712.slice/crio-7569f22a518551ebb44cdf07386b60b6399048df14da7bd28bb10668da3ccc44 WatchSource:0}: Error finding container 7569f22a518551ebb44cdf07386b60b6399048df14da7bd28bb10668da3ccc44: Status 404 returned error can't find the container with id 7569f22a518551ebb44cdf07386b60b6399048df14da7bd28bb10668da3ccc44 Jun 03 20:54:04.507483 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:04.507446 2563 generic.go:356] "Generic (PLEG): container finished" podID="aa8dfbf3-ac50-4aaf-af01-1b950ae0b35d" containerID="0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7" exitCode=0 Jun 03 20:54:04.507677 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:04.507502 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dv4s9" Jun 03 20:54:04.507677 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:04.507566 2563 scope.go:117] "RemoveContainer" containerID="0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7" Jun 03 20:54:04.509652 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:04.509624 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" event={"ID":"a10fe660-65f7-4771-8503-069507048712","Type":"ContainerStarted","Data":"774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30"} Jun 03 20:54:04.509775 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:04.509680 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" event={"ID":"a10fe660-65f7-4771-8503-069507048712","Type":"ContainerStarted","Data":"7569f22a518551ebb44cdf07386b60b6399048df14da7bd28bb10668da3ccc44"} Jun 03 20:54:04.509846 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:04.509805 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:04.517437 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:04.517415 2563 scope.go:117] "RemoveContainer" containerID="0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7" Jun 03 20:54:04.517724 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:54:04.517696 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7\": container with ID starting with 0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7 not found: ID does not exist" containerID="0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7" Jun 03 20:54:04.517817 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:04.517734 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7"} err="failed to get container status \"0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7\": rpc error: code = NotFound desc = could not find container \"0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7\": container with ID starting with 0f7e7f7375f8e697387b3d5fe4499442392ed709a2ae2998c9f7f2c72899dcf7 not found: ID does not exist" Jun 03 20:54:04.574129 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:04.574077 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" podStartSLOduration=1.574061866 podStartE2EDuration="1.574061866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:04.57151723 +0000 UTC m=+629.170396191" watchObservedRunningTime="2026-06-03 20:54:04.574061866 +0000 UTC m=+629.172940827" Jun 03 20:54:15.518162 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:15.518132 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:27.797106 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:27.797064 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b74d844d4-qhhmg" podUID="44acf114-425f-4196-a892-36b21955a3d6" containerName="console" containerID="cri-o://3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396" gracePeriod=15 Jun 03 20:54:28.046213 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.046188 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:54:28.112987 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.112879 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-serving-cert\") pod \"44acf114-425f-4196-a892-36b21955a3d6\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " Jun 03 20:54:28.112987 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.112937 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-trusted-ca-bundle\") pod \"44acf114-425f-4196-a892-36b21955a3d6\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " Jun 03 20:54:28.112987 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.112976 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvfg7\" (UniqueName: \"kubernetes.io/projected/44acf114-425f-4196-a892-36b21955a3d6-kube-api-access-vvfg7\") pod \"44acf114-425f-4196-a892-36b21955a3d6\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " Jun 03 20:54:28.113265 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.113006 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-oauth-config\") pod \"44acf114-425f-4196-a892-36b21955a3d6\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " Jun 03 20:54:28.113265 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.113067 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-oauth-serving-cert\") pod \"44acf114-425f-4196-a892-36b21955a3d6\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " Jun 03 20:54:28.113265 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.113120 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-console-config\") pod \"44acf114-425f-4196-a892-36b21955a3d6\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " Jun 03 20:54:28.113265 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.113141 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-service-ca\") pod \"44acf114-425f-4196-a892-36b21955a3d6\" (UID: \"44acf114-425f-4196-a892-36b21955a3d6\") " Jun 03 20:54:28.113602 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.113576 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "44acf114-425f-4196-a892-36b21955a3d6" (UID: "44acf114-425f-4196-a892-36b21955a3d6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:54:28.113689 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.113596 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-console-config" (OuterVolumeSpecName: "console-config") pod "44acf114-425f-4196-a892-36b21955a3d6" (UID: "44acf114-425f-4196-a892-36b21955a3d6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:54:28.113689 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.113508 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "44acf114-425f-4196-a892-36b21955a3d6" (UID: "44acf114-425f-4196-a892-36b21955a3d6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:54:28.113793 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.113685 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-service-ca" (OuterVolumeSpecName: "service-ca") pod "44acf114-425f-4196-a892-36b21955a3d6" (UID: "44acf114-425f-4196-a892-36b21955a3d6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:54:28.115113 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.115092 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "44acf114-425f-4196-a892-36b21955a3d6" (UID: "44acf114-425f-4196-a892-36b21955a3d6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:54:28.115533 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.115516 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "44acf114-425f-4196-a892-36b21955a3d6" (UID: "44acf114-425f-4196-a892-36b21955a3d6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:54:28.115604 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.115552 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44acf114-425f-4196-a892-36b21955a3d6-kube-api-access-vvfg7" (OuterVolumeSpecName: "kube-api-access-vvfg7") pod "44acf114-425f-4196-a892-36b21955a3d6" (UID: "44acf114-425f-4196-a892-36b21955a3d6"). InnerVolumeSpecName "kube-api-access-vvfg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:54:28.214651 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.214619 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-oauth-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:54:28.214651 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.214645 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-console-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:54:28.214651 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.214657 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:54:28.214858 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.214669 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:54:28.214858 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.214680 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44acf114-425f-4196-a892-36b21955a3d6-trusted-ca-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:54:28.214858 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.214691 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvfg7\" (UniqueName: \"kubernetes.io/projected/44acf114-425f-4196-a892-36b21955a3d6-kube-api-access-vvfg7\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:54:28.214858 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.214702 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44acf114-425f-4196-a892-36b21955a3d6-console-oauth-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:54:28.642958 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.642912 2563 generic.go:356] "Generic (PLEG): container finished" podID="44acf114-425f-4196-a892-36b21955a3d6" containerID="3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396" exitCode=0 Jun 03 20:54:28.643159 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.642971 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b74d844d4-qhhmg" event={"ID":"44acf114-425f-4196-a892-36b21955a3d6","Type":"ContainerDied","Data":"3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396"} Jun 03 20:54:28.643159 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.642976 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b74d844d4-qhhmg" Jun 03 20:54:28.643159 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.643009 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b74d844d4-qhhmg" event={"ID":"44acf114-425f-4196-a892-36b21955a3d6","Type":"ContainerDied","Data":"4631ebd42b8f97bc5ddcb00762226316315c188171553ef79333675b4944a972"} Jun 03 20:54:28.643159 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.643029 2563 scope.go:117] "RemoveContainer" containerID="3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396" Jun 03 20:54:28.652800 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.652782 2563 scope.go:117] "RemoveContainer" containerID="3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396" Jun 03 20:54:28.653104 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:54:28.653082 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396\": container with ID starting with 3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396 not found: ID does not exist" containerID="3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396" Jun 03 20:54:28.653198 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.653111 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396"} err="failed to get container status \"3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396\": rpc error: code = NotFound desc = could not find container \"3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396\": container with ID starting with 3fdd8620f0bd18246de385f665e845798135d1ebbbfc92c034e4f7521713f396 not found: ID does not exist" Jun 03 20:54:28.714304 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.714270 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b74d844d4-qhhmg"] Jun 03 20:54:28.721112 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:28.721084 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b74d844d4-qhhmg"] Jun 03 20:54:29.906721 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:29.906692 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44acf114-425f-4196-a892-36b21955a3d6" path="/var/lib/kubelet/pods/44acf114-425f-4196-a892-36b21955a3d6/volumes" Jun 03 20:54:30.359931 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.359894 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks"] Jun 03 20:54:30.360131 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.360108 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" podUID="a10fe660-65f7-4771-8503-069507048712" containerName="manager" containerID="cri-o://774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30" gracePeriod=10 Jun 03 20:54:30.628668 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.628641 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:30.659390 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.659362 2563 generic.go:356] "Generic (PLEG): container finished" podID="a10fe660-65f7-4771-8503-069507048712" containerID="774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30" exitCode=0 Jun 03 20:54:30.659514 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.659413 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" Jun 03 20:54:30.659514 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.659429 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" event={"ID":"a10fe660-65f7-4771-8503-069507048712","Type":"ContainerDied","Data":"774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30"} Jun 03 20:54:30.659514 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.659493 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks" event={"ID":"a10fe660-65f7-4771-8503-069507048712","Type":"ContainerDied","Data":"7569f22a518551ebb44cdf07386b60b6399048df14da7bd28bb10668da3ccc44"} Jun 03 20:54:30.659642 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.659524 2563 scope.go:117] "RemoveContainer" containerID="774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30" Jun 03 20:54:30.670030 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.670008 2563 scope.go:117] "RemoveContainer" containerID="774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30" Jun 03 20:54:30.670311 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:54:30.670292 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30\": container with ID starting with 774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30 not found: ID does not exist" containerID="774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30" Jun 03 20:54:30.670407 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.670320 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30"} err="failed to get container status \"774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30\": rpc error: code = NotFound desc = could not find container \"774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30\": container with ID starting with 774a8587fd2128bccc4b8f1418a63ea2b2311172980bfdda84dd8765a53e8c30 not found: ID does not exist" Jun 03 20:54:30.735968 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.735912 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsd6k\" (UniqueName: \"kubernetes.io/projected/a10fe660-65f7-4771-8503-069507048712-kube-api-access-vsd6k\") pod \"a10fe660-65f7-4771-8503-069507048712\" (UID: \"a10fe660-65f7-4771-8503-069507048712\") " Jun 03 20:54:30.736158 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.735983 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a10fe660-65f7-4771-8503-069507048712-extensions-socket-volume\") pod \"a10fe660-65f7-4771-8503-069507048712\" (UID: \"a10fe660-65f7-4771-8503-069507048712\") " Jun 03 20:54:30.736344 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.736320 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a10fe660-65f7-4771-8503-069507048712-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a10fe660-65f7-4771-8503-069507048712" (UID: "a10fe660-65f7-4771-8503-069507048712"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:54:30.738056 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.738032 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a10fe660-65f7-4771-8503-069507048712-kube-api-access-vsd6k" (OuterVolumeSpecName: "kube-api-access-vsd6k") pod "a10fe660-65f7-4771-8503-069507048712" (UID: "a10fe660-65f7-4771-8503-069507048712"). InnerVolumeSpecName "kube-api-access-vsd6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:54:30.836658 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.836627 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsd6k\" (UniqueName: \"kubernetes.io/projected/a10fe660-65f7-4771-8503-069507048712-kube-api-access-vsd6k\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:54:30.836658 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.836656 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a10fe660-65f7-4771-8503-069507048712-extensions-socket-volume\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:54:30.990114 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.990083 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks"] Jun 03 20:54:30.998409 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:30.998385 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8fjks"] Jun 03 20:54:31.906260 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:31.906218 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a10fe660-65f7-4771-8503-069507048712" path="/var/lib/kubelet/pods/a10fe660-65f7-4771-8503-069507048712/volumes" Jun 03 20:54:51.295852 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.295807 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8lg5"] Jun 03 20:54:51.296388 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.296368 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44acf114-425f-4196-a892-36b21955a3d6" containerName="console" Jun 03 20:54:51.296462 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.296390 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="44acf114-425f-4196-a892-36b21955a3d6" containerName="console" Jun 03 20:54:51.296462 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.296403 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a10fe660-65f7-4771-8503-069507048712" containerName="manager" Jun 03 20:54:51.296462 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.296410 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a10fe660-65f7-4771-8503-069507048712" containerName="manager" Jun 03 20:54:51.296605 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.296512 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="44acf114-425f-4196-a892-36b21955a3d6" containerName="console" Jun 03 20:54:51.296605 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.296528 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a10fe660-65f7-4771-8503-069507048712" containerName="manager" Jun 03 20:54:51.301008 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.300987 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:54:51.304142 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.304119 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7zxcz\"" Jun 03 20:54:51.304355 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.304268 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 20:54:51.305286 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.305265 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 20:54:51.305393 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.305289 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 20:54:51.307886 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.307863 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8lg5"] Jun 03 20:54:51.401262 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.401229 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8lg5"] Jun 03 20:54:51.416017 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.415991 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/22795e4e-8397-4bb1-93b5-00284603e827-config-file\") pod \"limitador-limitador-64c94fd64f-g8lg5\" (UID: \"22795e4e-8397-4bb1-93b5-00284603e827\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:54:51.416141 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.416027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdqlh\" (UniqueName: \"kubernetes.io/projected/22795e4e-8397-4bb1-93b5-00284603e827-kube-api-access-pdqlh\") pod \"limitador-limitador-64c94fd64f-g8lg5\" (UID: \"22795e4e-8397-4bb1-93b5-00284603e827\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:54:51.517340 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.517292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/22795e4e-8397-4bb1-93b5-00284603e827-config-file\") pod \"limitador-limitador-64c94fd64f-g8lg5\" (UID: \"22795e4e-8397-4bb1-93b5-00284603e827\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:54:51.517340 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.517342 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdqlh\" (UniqueName: \"kubernetes.io/projected/22795e4e-8397-4bb1-93b5-00284603e827-kube-api-access-pdqlh\") pod \"limitador-limitador-64c94fd64f-g8lg5\" (UID: \"22795e4e-8397-4bb1-93b5-00284603e827\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:54:51.517938 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.517916 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/22795e4e-8397-4bb1-93b5-00284603e827-config-file\") pod \"limitador-limitador-64c94fd64f-g8lg5\" (UID: \"22795e4e-8397-4bb1-93b5-00284603e827\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:54:51.527062 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.527033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdqlh\" (UniqueName: \"kubernetes.io/projected/22795e4e-8397-4bb1-93b5-00284603e827-kube-api-access-pdqlh\") pod \"limitador-limitador-64c94fd64f-g8lg5\" (UID: \"22795e4e-8397-4bb1-93b5-00284603e827\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:54:51.612607 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.612514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:54:51.747309 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:54:51.747277 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22795e4e_8397_4bb1_93b5_00284603e827.slice/crio-7fc3a76433f5ef743b25a361d95a85a5083f6c7ef346069636257654ffcac24a WatchSource:0}: Error finding container 7fc3a76433f5ef743b25a361d95a85a5083f6c7ef346069636257654ffcac24a: Status 404 returned error can't find the container with id 7fc3a76433f5ef743b25a361d95a85a5083f6c7ef346069636257654ffcac24a Jun 03 20:54:51.747571 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.747554 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8lg5"] Jun 03 20:54:51.749084 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.749069 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:54:51.777576 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.777543 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" event={"ID":"22795e4e-8397-4bb1-93b5-00284603e827","Type":"ContainerStarted","Data":"7fc3a76433f5ef743b25a361d95a85a5083f6c7ef346069636257654ffcac24a"} Jun 03 20:54:51.829936 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.829901 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 20:54:51.834517 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.834496 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" Jun 03 20:54:51.845543 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.845518 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 20:54:51.887730 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.887659 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 20:54:51.921181 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.921153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1263626e-d016-463d-8f40-0f94468000a6-config-file\") pod \"limitador-limitador-54d6d988d5-4mz96\" (UID: \"1263626e-d016-463d-8f40-0f94468000a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" Jun 03 20:54:51.921333 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:51.921191 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf9sn\" (UniqueName: \"kubernetes.io/projected/1263626e-d016-463d-8f40-0f94468000a6-kube-api-access-nf9sn\") pod \"limitador-limitador-54d6d988d5-4mz96\" (UID: \"1263626e-d016-463d-8f40-0f94468000a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" Jun 03 20:54:52.022263 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:52.022226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1263626e-d016-463d-8f40-0f94468000a6-config-file\") pod \"limitador-limitador-54d6d988d5-4mz96\" (UID: \"1263626e-d016-463d-8f40-0f94468000a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" Jun 03 20:54:52.022429 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:52.022279 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf9sn\" (UniqueName: \"kubernetes.io/projected/1263626e-d016-463d-8f40-0f94468000a6-kube-api-access-nf9sn\") pod \"limitador-limitador-54d6d988d5-4mz96\" (UID: \"1263626e-d016-463d-8f40-0f94468000a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" Jun 03 20:54:52.022869 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:52.022845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1263626e-d016-463d-8f40-0f94468000a6-config-file\") pod \"limitador-limitador-54d6d988d5-4mz96\" (UID: \"1263626e-d016-463d-8f40-0f94468000a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" Jun 03 20:54:52.030431 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:52.030402 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf9sn\" (UniqueName: \"kubernetes.io/projected/1263626e-d016-463d-8f40-0f94468000a6-kube-api-access-nf9sn\") pod \"limitador-limitador-54d6d988d5-4mz96\" (UID: \"1263626e-d016-463d-8f40-0f94468000a6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" Jun 03 20:54:52.144627 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:52.144535 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" Jun 03 20:54:52.328114 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:52.328084 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 20:54:52.330508 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:54:52.330473 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1263626e_d016_463d_8f40_0f94468000a6.slice/crio-94e0b4e5a9b30b29dc0af87cf91c37a1afe1bab35277198fbd71e9dc5e680dd0 WatchSource:0}: Error finding container 94e0b4e5a9b30b29dc0af87cf91c37a1afe1bab35277198fbd71e9dc5e680dd0: Status 404 returned error can't find the container with id 94e0b4e5a9b30b29dc0af87cf91c37a1afe1bab35277198fbd71e9dc5e680dd0 Jun 03 20:54:52.789240 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:52.789154 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" event={"ID":"1263626e-d016-463d-8f40-0f94468000a6","Type":"ContainerStarted","Data":"94e0b4e5a9b30b29dc0af87cf91c37a1afe1bab35277198fbd71e9dc5e680dd0"} Jun 03 20:54:54.801605 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:54.801575 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" event={"ID":"22795e4e-8397-4bb1-93b5-00284603e827","Type":"ContainerStarted","Data":"dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965"} Jun 03 20:54:54.802090 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:54.801632 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:54:54.803147 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:54.803125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" event={"ID":"1263626e-d016-463d-8f40-0f94468000a6","Type":"ContainerStarted","Data":"6b890b5029838516899d7a872490734866e9ce35eaf8bfa43943629858adab26"} Jun 03 20:54:54.803269 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:54.803172 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" Jun 03 20:54:54.838916 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:54.838875 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" podStartSLOduration=1.148617888 podStartE2EDuration="3.838861438s" totalImagesPullingTime="2.69024355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:54.820624146 +0000 UTC m=+679.419503108" watchObservedRunningTime="2026-06-03 20:54:54.838861438 +0000 UTC m=+679.437740403" Jun 03 20:54:54.839496 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:54:54.839464 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" podStartSLOduration=1.728659883 podStartE2EDuration="3.839454143s" totalImagesPullingTime="2.11079426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:54.837963831 +0000 UTC m=+679.436842791" watchObservedRunningTime="2026-06-03 20:54:54.839454143 +0000 UTC m=+679.438333141" Jun 03 20:55:05.815188 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:05.815158 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:55:05.815710 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:05.815224 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4mz96" Jun 03 20:55:05.891824 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:05.891788 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8lg5"] Jun 03 20:55:05.892072 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:05.892022 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" podUID="22795e4e-8397-4bb1-93b5-00284603e827" containerName="limitador" containerID="cri-o://dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965" gracePeriod=30 Jun 03 20:55:06.445494 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.445470 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:55:06.554341 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.554308 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdqlh\" (UniqueName: \"kubernetes.io/projected/22795e4e-8397-4bb1-93b5-00284603e827-kube-api-access-pdqlh\") pod \"22795e4e-8397-4bb1-93b5-00284603e827\" (UID: \"22795e4e-8397-4bb1-93b5-00284603e827\") " Jun 03 20:55:06.554526 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.554379 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/22795e4e-8397-4bb1-93b5-00284603e827-config-file\") pod \"22795e4e-8397-4bb1-93b5-00284603e827\" (UID: \"22795e4e-8397-4bb1-93b5-00284603e827\") " Jun 03 20:55:06.554755 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.554733 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22795e4e-8397-4bb1-93b5-00284603e827-config-file" (OuterVolumeSpecName: "config-file") pod "22795e4e-8397-4bb1-93b5-00284603e827" (UID: "22795e4e-8397-4bb1-93b5-00284603e827"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:55:06.556391 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.556363 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22795e4e-8397-4bb1-93b5-00284603e827-kube-api-access-pdqlh" (OuterVolumeSpecName: "kube-api-access-pdqlh") pod "22795e4e-8397-4bb1-93b5-00284603e827" (UID: "22795e4e-8397-4bb1-93b5-00284603e827"). InnerVolumeSpecName "kube-api-access-pdqlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:55:06.655725 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.655694 2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/22795e4e-8397-4bb1-93b5-00284603e827-config-file\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:55:06.655725 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.655720 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdqlh\" (UniqueName: \"kubernetes.io/projected/22795e4e-8397-4bb1-93b5-00284603e827-kube-api-access-pdqlh\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:55:06.879318 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.879223 2563 generic.go:356] "Generic (PLEG): container finished" podID="22795e4e-8397-4bb1-93b5-00284603e827" containerID="dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965" exitCode=0 Jun 03 20:55:06.879318 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.879267 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" Jun 03 20:55:06.879318 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.879303 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" event={"ID":"22795e4e-8397-4bb1-93b5-00284603e827","Type":"ContainerDied","Data":"dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965"} Jun 03 20:55:06.879833 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.879360 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8lg5" event={"ID":"22795e4e-8397-4bb1-93b5-00284603e827","Type":"ContainerDied","Data":"7fc3a76433f5ef743b25a361d95a85a5083f6c7ef346069636257654ffcac24a"} Jun 03 20:55:06.879833 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.879390 2563 scope.go:117] "RemoveContainer" containerID="dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965" Jun 03 20:55:06.888828 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.888807 2563 scope.go:117] "RemoveContainer" containerID="dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965" Jun 03 20:55:06.889091 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:55:06.889070 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965\": container with ID starting with dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965 not found: ID does not exist" containerID="dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965" Jun 03 20:55:06.889172 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.889104 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965"} err="failed to get container status \"dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965\": rpc error: code = NotFound desc = could not find container \"dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965\": container with ID starting with dadf520084060c74abf7b4dab5f5b14df3701a6180273225e32ac44220c3a965 not found: ID does not exist" Jun 03 20:55:06.901716 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.901693 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8lg5"] Jun 03 20:55:06.906105 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:06.906082 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8lg5"] Jun 03 20:55:07.905578 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:07.905547 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22795e4e-8397-4bb1-93b5-00284603e827" path="/var/lib/kubelet/pods/22795e4e-8397-4bb1-93b5-00284603e827/volumes" Jun 03 20:55:25.785677 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.785602 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb"] Jun 03 20:55:25.786060 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.786021 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22795e4e-8397-4bb1-93b5-00284603e827" containerName="limitador" Jun 03 20:55:25.786060 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.786036 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="22795e4e-8397-4bb1-93b5-00284603e827" containerName="limitador" Jun 03 20:55:25.786137 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.786109 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="22795e4e-8397-4bb1-93b5-00284603e827" containerName="limitador" Jun 03 20:55:25.790739 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.790722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:25.793859 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.793836 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9lnn\"" Jun 03 20:55:25.793859 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.793855 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 20:55:25.794781 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.794762 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 20:55:25.799969 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.799918 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb"] Jun 03 20:55:25.906252 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.906223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:25.906433 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.906261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw7lp\" (UniqueName: \"kubernetes.io/projected/611a8868-56bc-4bd5-a2c2-08dfa3acef19-kube-api-access-zw7lp\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:25.906433 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:25.906307 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:26.007020 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:26.006991 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:26.007193 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:26.007061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:26.007193 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:26.007085 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw7lp\" (UniqueName: \"kubernetes.io/projected/611a8868-56bc-4bd5-a2c2-08dfa3acef19-kube-api-access-zw7lp\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:26.007432 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:26.007408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:26.007497 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:26.007430 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:26.017495 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:26.017462 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw7lp\" (UniqueName: \"kubernetes.io/projected/611a8868-56bc-4bd5-a2c2-08dfa3acef19-kube-api-access-zw7lp\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:26.102012 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:26.101906 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:26.291172 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:26.291145 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb"] Jun 03 20:55:26.292824 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:55:26.292799 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611a8868_56bc_4bd5_a2c2_08dfa3acef19.slice/crio-25b5cd567c00b027d600af64030923efa50476028805bb53f7a8b3fd1b21c551 WatchSource:0}: Error finding container 25b5cd567c00b027d600af64030923efa50476028805bb53f7a8b3fd1b21c551: Status 404 returned error can't find the container with id 25b5cd567c00b027d600af64030923efa50476028805bb53f7a8b3fd1b21c551 Jun 03 20:55:26.988284 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:26.988253 2563 generic.go:356] "Generic (PLEG): container finished" podID="611a8868-56bc-4bd5-a2c2-08dfa3acef19" containerID="ae8655811d64434935e3b6ecca2524ee1f3021daa9b722a9ea2bcb68ff681acb" exitCode=0 Jun 03 20:55:26.988673 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:26.988306 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" event={"ID":"611a8868-56bc-4bd5-a2c2-08dfa3acef19","Type":"ContainerDied","Data":"ae8655811d64434935e3b6ecca2524ee1f3021daa9b722a9ea2bcb68ff681acb"} Jun 03 20:55:26.988673 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:26.988345 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" event={"ID":"611a8868-56bc-4bd5-a2c2-08dfa3acef19","Type":"ContainerStarted","Data":"25b5cd567c00b027d600af64030923efa50476028805bb53f7a8b3fd1b21c551"} Jun 03 20:55:27.995559 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:27.995524 2563 generic.go:356] "Generic (PLEG): container finished" podID="611a8868-56bc-4bd5-a2c2-08dfa3acef19" containerID="1c90f75411205c582c53436320e54803ecee50709e4958b4a339cc87519afa53" exitCode=0 Jun 03 20:55:27.995975 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:27.995611 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" event={"ID":"611a8868-56bc-4bd5-a2c2-08dfa3acef19","Type":"ContainerDied","Data":"1c90f75411205c582c53436320e54803ecee50709e4958b4a339cc87519afa53"} Jun 03 20:55:29.003636 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:29.003603 2563 generic.go:356] "Generic (PLEG): container finished" podID="611a8868-56bc-4bd5-a2c2-08dfa3acef19" containerID="5ffa62e7fc60fd9355a08b7ffc98788ba425cdcbbe477bf623a3159c892c082c" exitCode=0 Jun 03 20:55:29.004057 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:29.003689 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" event={"ID":"611a8868-56bc-4bd5-a2c2-08dfa3acef19","Type":"ContainerDied","Data":"5ffa62e7fc60fd9355a08b7ffc98788ba425cdcbbe477bf623a3159c892c082c"} Jun 03 20:55:30.142545 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:30.142522 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:30.240560 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:30.240532 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw7lp\" (UniqueName: \"kubernetes.io/projected/611a8868-56bc-4bd5-a2c2-08dfa3acef19-kube-api-access-zw7lp\") pod \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " Jun 03 20:55:30.240723 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:30.240609 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-util\") pod \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " Jun 03 20:55:30.240796 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:30.240773 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-bundle\") pod \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\" (UID: \"611a8868-56bc-4bd5-a2c2-08dfa3acef19\") " Jun 03 20:55:30.241293 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:30.241267 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-bundle" (OuterVolumeSpecName: "bundle") pod "611a8868-56bc-4bd5-a2c2-08dfa3acef19" (UID: "611a8868-56bc-4bd5-a2c2-08dfa3acef19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:55:30.242638 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:30.242613 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/611a8868-56bc-4bd5-a2c2-08dfa3acef19-kube-api-access-zw7lp" (OuterVolumeSpecName: "kube-api-access-zw7lp") pod "611a8868-56bc-4bd5-a2c2-08dfa3acef19" (UID: "611a8868-56bc-4bd5-a2c2-08dfa3acef19"). InnerVolumeSpecName "kube-api-access-zw7lp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:55:30.246342 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:30.246301 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-util" (OuterVolumeSpecName: "util") pod "611a8868-56bc-4bd5-a2c2-08dfa3acef19" (UID: "611a8868-56bc-4bd5-a2c2-08dfa3acef19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:55:30.342389 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:30.342362 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw7lp\" (UniqueName: \"kubernetes.io/projected/611a8868-56bc-4bd5-a2c2-08dfa3acef19-kube-api-access-zw7lp\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:55:30.342389 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:30.342386 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:55:30.342558 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:30.342398 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/611a8868-56bc-4bd5-a2c2-08dfa3acef19-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:55:31.016869 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:31.016835 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" Jun 03 20:55:31.016869 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:31.016858 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a702hczb" event={"ID":"611a8868-56bc-4bd5-a2c2-08dfa3acef19","Type":"ContainerDied","Data":"25b5cd567c00b027d600af64030923efa50476028805bb53f7a8b3fd1b21c551"} Jun 03 20:55:31.017109 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:31.016906 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25b5cd567c00b027d600af64030923efa50476028805bb53f7a8b3fd1b21c551" Jun 03 20:55:48.677920 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.677881 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 20:55:48.678400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.678240 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611a8868-56bc-4bd5-a2c2-08dfa3acef19" containerName="util" Jun 03 20:55:48.678400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.678253 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="611a8868-56bc-4bd5-a2c2-08dfa3acef19" containerName="util" Jun 03 20:55:48.678400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.678264 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611a8868-56bc-4bd5-a2c2-08dfa3acef19" containerName="pull" Jun 03 20:55:48.678400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.678269 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="611a8868-56bc-4bd5-a2c2-08dfa3acef19" containerName="pull" Jun 03 20:55:48.678400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.678292 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611a8868-56bc-4bd5-a2c2-08dfa3acef19" containerName="extract" Jun 03 20:55:48.678400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.678298 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="611a8868-56bc-4bd5-a2c2-08dfa3acef19" containerName="extract" Jun 03 20:55:48.678400 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.678352 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="611a8868-56bc-4bd5-a2c2-08dfa3acef19" containerName="extract" Jun 03 20:55:48.682647 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.682629 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 20:55:48.685396 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.685378 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 20:55:48.686449 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.686430 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 20:55:48.686512 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.686431 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-4shbc\"" Jun 03 20:55:48.686512 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.686436 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 20:55:48.694195 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.694176 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 20:55:48.807020 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.806936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql54d\" (UniqueName: \"kubernetes.io/projected/756a15d6-1c07-4850-94a0-c13109a58256-kube-api-access-ql54d\") pod \"maas-keycloak-0\" (UID: \"756a15d6-1c07-4850-94a0-c13109a58256\") " pod="keycloak-system/maas-keycloak-0" Jun 03 20:55:48.907643 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.907606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql54d\" (UniqueName: \"kubernetes.io/projected/756a15d6-1c07-4850-94a0-c13109a58256-kube-api-access-ql54d\") pod \"maas-keycloak-0\" (UID: \"756a15d6-1c07-4850-94a0-c13109a58256\") " pod="keycloak-system/maas-keycloak-0" Jun 03 20:55:48.917085 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.917056 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql54d\" (UniqueName: \"kubernetes.io/projected/756a15d6-1c07-4850-94a0-c13109a58256-kube-api-access-ql54d\") pod \"maas-keycloak-0\" (UID: \"756a15d6-1c07-4850-94a0-c13109a58256\") " pod="keycloak-system/maas-keycloak-0" Jun 03 20:55:48.992493 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:48.992398 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 20:55:49.132320 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:49.132285 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 20:55:49.136977 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:55:49.133026 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756a15d6_1c07_4850_94a0_c13109a58256.slice/crio-0a178d854408842d7c19a7ddb5dc1813788a1f50a5a7b5326c51399033a7d6d4 WatchSource:0}: Error finding container 0a178d854408842d7c19a7ddb5dc1813788a1f50a5a7b5326c51399033a7d6d4: Status 404 returned error can't find the container with id 0a178d854408842d7c19a7ddb5dc1813788a1f50a5a7b5326c51399033a7d6d4 Jun 03 20:55:50.124443 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:50.124407 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"756a15d6-1c07-4850-94a0-c13109a58256","Type":"ContainerStarted","Data":"0a178d854408842d7c19a7ddb5dc1813788a1f50a5a7b5326c51399033a7d6d4"} Jun 03 20:55:54.152583 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:54.152539 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"756a15d6-1c07-4850-94a0-c13109a58256","Type":"ContainerStarted","Data":"96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c"} Jun 03 20:55:54.175218 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:54.175168 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.826198389 podStartE2EDuration="6.175152149s" totalImagesPullingTime="4.34895376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:55:54.172092183 +0000 UTC m=+738.770971174" watchObservedRunningTime="2026-06-03 20:55:54.175152149 +0000 UTC m=+738.774031131" Jun 03 20:55:54.993477 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:54.993433 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 20:55:54.995396 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:54.995352 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:55:55.993196 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:55.993145 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:55:56.993230 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:56.993175 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:55:57.993449 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:57.993400 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:55:58.992767 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:58.992727 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 20:55:58.992995 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:58.992916 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:55:59.993344 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:55:59.993298 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:56:00.993983 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:00.993904 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:56:01.993648 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:01.993598 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:56:02.993232 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:02.993179 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:56:03.993714 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:03.993669 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:56:04.993286 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:04.993235 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:56:05.993154 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:05.993111 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 03 20:56:07.121638 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:07.121599 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 20:56:07.137670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:07.137625 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:56:17.128099 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:17.128064 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 20:56:58.289452 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.289369 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-74d4c49c6f-bwq62"] Jun 03 20:56:58.293038 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.293012 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-74d4c49c6f-bwq62" Jun 03 20:56:58.296166 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.296139 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 20:56:58.296291 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.296159 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6tv84\"" Jun 03 20:56:58.307077 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.307055 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-74d4c49c6f-bwq62"] Jun 03 20:56:58.320177 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.320155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2z59\" (UniqueName: \"kubernetes.io/projected/371da26d-4d35-42f1-96c2-f93fa9cc6140-kube-api-access-f2z59\") pod \"maas-api-74d4c49c6f-bwq62\" (UID: \"371da26d-4d35-42f1-96c2-f93fa9cc6140\") " pod="opendatahub/maas-api-74d4c49c6f-bwq62" Jun 03 20:56:58.320320 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.320211 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371da26d-4d35-42f1-96c2-f93fa9cc6140-maas-api-tls\") pod \"maas-api-74d4c49c6f-bwq62\" (UID: \"371da26d-4d35-42f1-96c2-f93fa9cc6140\") " pod="opendatahub/maas-api-74d4c49c6f-bwq62" Jun 03 20:56:58.421236 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.421195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371da26d-4d35-42f1-96c2-f93fa9cc6140-maas-api-tls\") pod \"maas-api-74d4c49c6f-bwq62\" (UID: \"371da26d-4d35-42f1-96c2-f93fa9cc6140\") " pod="opendatahub/maas-api-74d4c49c6f-bwq62" Jun 03 20:56:58.421427 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.421278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2z59\" (UniqueName: \"kubernetes.io/projected/371da26d-4d35-42f1-96c2-f93fa9cc6140-kube-api-access-f2z59\") pod \"maas-api-74d4c49c6f-bwq62\" (UID: \"371da26d-4d35-42f1-96c2-f93fa9cc6140\") " pod="opendatahub/maas-api-74d4c49c6f-bwq62" Jun 03 20:56:58.421427 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:56:58.421344 2563 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 03 20:56:58.421427 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:56:58.421408 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371da26d-4d35-42f1-96c2-f93fa9cc6140-maas-api-tls podName:371da26d-4d35-42f1-96c2-f93fa9cc6140 nodeName:}" failed. No retries permitted until 2026-06-03 20:56:58.921391432 +0000 UTC m=+803.520270376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/371da26d-4d35-42f1-96c2-f93fa9cc6140-maas-api-tls") pod "maas-api-74d4c49c6f-bwq62" (UID: "371da26d-4d35-42f1-96c2-f93fa9cc6140") : secret "maas-api-serving-cert" not found Jun 03 20:56:58.431252 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.431229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2z59\" (UniqueName: \"kubernetes.io/projected/371da26d-4d35-42f1-96c2-f93fa9cc6140-kube-api-access-f2z59\") pod \"maas-api-74d4c49c6f-bwq62\" (UID: \"371da26d-4d35-42f1-96c2-f93fa9cc6140\") " pod="opendatahub/maas-api-74d4c49c6f-bwq62" Jun 03 20:56:58.836464 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.836429 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-djtbw"] Jun 03 20:56:58.840003 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.839984 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-djtbw" Jun 03 20:56:58.843183 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.843158 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 20:56:58.843432 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.843413 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mpxmh\"" Jun 03 20:56:58.855576 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.855554 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-fqswm"] Jun 03 20:56:58.858833 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.858818 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-fqswm" Jun 03 20:56:58.866965 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.866924 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-djtbw"] Jun 03 20:56:58.895580 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.895541 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-fqswm"] Jun 03 20:56:58.925505 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.925474 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 20:56:58.925664 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.925574 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s68nt\" (UniqueName: \"kubernetes.io/projected/00aded2f-4418-405b-bb6c-b92224fbe1c0-kube-api-access-s68nt\") pod \"payload-pre-processing-67d7689b65-djtbw\" (UID: \"00aded2f-4418-405b-bb6c-b92224fbe1c0\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-djtbw" Jun 03 20:56:58.925712 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.925691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371da26d-4d35-42f1-96c2-f93fa9cc6140-maas-api-tls\") pod \"maas-api-74d4c49c6f-bwq62\" (UID: \"371da26d-4d35-42f1-96c2-f93fa9cc6140\") " pod="opendatahub/maas-api-74d4c49c6f-bwq62" Jun 03 20:56:58.928067 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:58.928044 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371da26d-4d35-42f1-96c2-f93fa9cc6140-maas-api-tls\") pod \"maas-api-74d4c49c6f-bwq62\" (UID: \"371da26d-4d35-42f1-96c2-f93fa9cc6140\") " pod="opendatahub/maas-api-74d4c49c6f-bwq62" Jun 03 20:56:59.027205 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.027165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68nt\" (UniqueName: \"kubernetes.io/projected/00aded2f-4418-405b-bb6c-b92224fbe1c0-kube-api-access-s68nt\") pod \"payload-pre-processing-67d7689b65-djtbw\" (UID: \"00aded2f-4418-405b-bb6c-b92224fbe1c0\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-djtbw" Jun 03 20:56:59.027205 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.027210 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdj5g\" (UniqueName: \"kubernetes.io/projected/2769c67a-a4f4-4223-a55c-074459817a9e-kube-api-access-sdj5g\") pod \"payload-processing-7c6c859784-fqswm\" (UID: \"2769c67a-a4f4-4223-a55c-074459817a9e\") " pod="openshift-ingress/payload-processing-7c6c859784-fqswm" Jun 03 20:56:59.035684 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.035660 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s68nt\" (UniqueName: \"kubernetes.io/projected/00aded2f-4418-405b-bb6c-b92224fbe1c0-kube-api-access-s68nt\") pod \"payload-pre-processing-67d7689b65-djtbw\" (UID: \"00aded2f-4418-405b-bb6c-b92224fbe1c0\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-djtbw" Jun 03 20:56:59.127864 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.127772 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdj5g\" (UniqueName: \"kubernetes.io/projected/2769c67a-a4f4-4223-a55c-074459817a9e-kube-api-access-sdj5g\") pod \"payload-processing-7c6c859784-fqswm\" (UID: \"2769c67a-a4f4-4223-a55c-074459817a9e\") " pod="openshift-ingress/payload-processing-7c6c859784-fqswm" Jun 03 20:56:59.136807 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.136777 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdj5g\" (UniqueName: \"kubernetes.io/projected/2769c67a-a4f4-4223-a55c-074459817a9e-kube-api-access-sdj5g\") pod \"payload-processing-7c6c859784-fqswm\" (UID: \"2769c67a-a4f4-4223-a55c-074459817a9e\") " pod="openshift-ingress/payload-processing-7c6c859784-fqswm" Jun 03 20:56:59.151613 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.151589 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-djtbw" Jun 03 20:56:59.168782 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.168758 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-fqswm" Jun 03 20:56:59.205189 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.205159 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-74d4c49c6f-bwq62" Jun 03 20:56:59.305535 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.305404 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-djtbw"] Jun 03 20:56:59.307193 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:56:59.307156 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00aded2f_4418_405b_bb6c_b92224fbe1c0.slice/crio-610a175d2a0e17ee1ecd536859247a877c4ca6eb87f55e622ef2781f5a45e689 WatchSource:0}: Error finding container 610a175d2a0e17ee1ecd536859247a877c4ca6eb87f55e622ef2781f5a45e689: Status 404 returned error can't find the container with id 610a175d2a0e17ee1ecd536859247a877c4ca6eb87f55e622ef2781f5a45e689 Jun 03 20:56:59.341601 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.340840 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-fqswm"] Jun 03 20:56:59.343530 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:56:59.343501 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2769c67a_a4f4_4223_a55c_074459817a9e.slice/crio-cbc5f7a9eba3cdab4beb46f3a54a4243d9cfad9203c8f19ba7684276a36ccd0e WatchSource:0}: Error finding container cbc5f7a9eba3cdab4beb46f3a54a4243d9cfad9203c8f19ba7684276a36ccd0e: Status 404 returned error can't find the container with id cbc5f7a9eba3cdab4beb46f3a54a4243d9cfad9203c8f19ba7684276a36ccd0e Jun 03 20:56:59.368322 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.368297 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-74d4c49c6f-bwq62"] Jun 03 20:56:59.369833 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:56:59.369806 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371da26d_4d35_42f1_96c2_f93fa9cc6140.slice/crio-f0bb23f5b5ad83af8edc3671234629a0fa60afe675fb771848e232787bba378b WatchSource:0}: Error finding container f0bb23f5b5ad83af8edc3671234629a0fa60afe675fb771848e232787bba378b: Status 404 returned error can't find the container with id f0bb23f5b5ad83af8edc3671234629a0fa60afe675fb771848e232787bba378b Jun 03 20:56:59.553071 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.553033 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqswm" event={"ID":"2769c67a-a4f4-4223-a55c-074459817a9e","Type":"ContainerStarted","Data":"cbc5f7a9eba3cdab4beb46f3a54a4243d9cfad9203c8f19ba7684276a36ccd0e"} Jun 03 20:56:59.554258 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.554225 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-djtbw" event={"ID":"00aded2f-4418-405b-bb6c-b92224fbe1c0","Type":"ContainerStarted","Data":"610a175d2a0e17ee1ecd536859247a877c4ca6eb87f55e622ef2781f5a45e689"} Jun 03 20:56:59.555437 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:56:59.555411 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-74d4c49c6f-bwq62" event={"ID":"371da26d-4d35-42f1-96c2-f93fa9cc6140","Type":"ContainerStarted","Data":"f0bb23f5b5ad83af8edc3671234629a0fa60afe675fb771848e232787bba378b"} Jun 03 20:57:03.595811 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:03.595774 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-74d4c49c6f-bwq62" event={"ID":"371da26d-4d35-42f1-96c2-f93fa9cc6140","Type":"ContainerStarted","Data":"e6a2c8705a559201f42b43bf4d02ab58eae2b113e56235b204703f31b0304ca5"} Jun 03 20:57:03.596384 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:03.595842 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-74d4c49c6f-bwq62" Jun 03 20:57:03.597365 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:03.597333 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqswm" event={"ID":"2769c67a-a4f4-4223-a55c-074459817a9e","Type":"ContainerStarted","Data":"4a482799abec92ccceac82773c073d79ed06d0063c51624d90ded250d0b3334f"} Jun 03 20:57:03.597514 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:03.597396 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fqswm" Jun 03 20:57:03.598756 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:03.598735 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-djtbw" event={"ID":"00aded2f-4418-405b-bb6c-b92224fbe1c0","Type":"ContainerStarted","Data":"46dd87104f77c94bcad30420c4a251cbb22aa8f4b4bb46a08d11ebbe4021c84b"} Jun 03 20:57:03.598863 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:03.598850 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-djtbw" Jun 03 20:57:03.616571 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:03.616525 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-74d4c49c6f-bwq62" podStartSLOduration=2.157598968 podStartE2EDuration="5.616509589s" totalImagesPullingTime="3.458910621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:57:03.614505745 +0000 UTC m=+808.213384722" watchObservedRunningTime="2026-06-03 20:57:03.616509589 +0000 UTC m=+808.215388551" Jun 03 20:57:03.630715 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:03.630661 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-djtbw" podStartSLOduration=2.159407597 podStartE2EDuration="5.630642021s" totalImagesPullingTime="3.471234424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:57:03.629127039 +0000 UTC m=+808.228006002" watchObservedRunningTime="2026-06-03 20:57:03.630642021 +0000 UTC m=+808.229520982" Jun 03 20:57:03.647641 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:03.647587 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-fqswm" podStartSLOduration=2.181114269 podStartE2EDuration="5.647570192s" totalImagesPullingTime="3.466455923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:57:03.645032954 +0000 UTC m=+808.243911916" watchObservedRunningTime="2026-06-03 20:57:03.647570192 +0000 UTC m=+808.246449155" Jun 03 20:57:09.610203 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:09.610175 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-74d4c49c6f-bwq62" Jun 03 20:57:11.351704 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:11.351668 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 20:57:11.352132 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:11.351864 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" containerID="cri-o://96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c" gracePeriod=30 Jun 03 20:57:13.403172 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.403149 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:13.454265 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.454219 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ql54d\" (UniqueName: \"kubernetes.io/projected/756a15d6-1c07-4850-94a0-c13109a58256-kube-api-access-ql54d\") pod \"756a15d6-1c07-4850-94a0-c13109a58256\" (UID: \"756a15d6-1c07-4850-94a0-c13109a58256\") " Jun 03 20:57:13.456272 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.456246 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756a15d6-1c07-4850-94a0-c13109a58256-kube-api-access-ql54d" (OuterVolumeSpecName: "kube-api-access-ql54d") pod "756a15d6-1c07-4850-94a0-c13109a58256" (UID: "756a15d6-1c07-4850-94a0-c13109a58256"). InnerVolumeSpecName "kube-api-access-ql54d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:57:13.555759 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.555724 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql54d\" (UniqueName: \"kubernetes.io/projected/756a15d6-1c07-4850-94a0-c13109a58256-kube-api-access-ql54d\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\"" Jun 03 20:57:13.658849 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.658816 2563 generic.go:356] "Generic (PLEG): container finished" podID="756a15d6-1c07-4850-94a0-c13109a58256" containerID="96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c" exitCode=143 Jun 03 20:57:13.659067 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.658860 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:13.659067 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.658901 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"756a15d6-1c07-4850-94a0-c13109a58256","Type":"ContainerDied","Data":"96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c"} Jun 03 20:57:13.659067 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.658996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"756a15d6-1c07-4850-94a0-c13109a58256","Type":"ContainerDied","Data":"0a178d854408842d7c19a7ddb5dc1813788a1f50a5a7b5326c51399033a7d6d4"} Jun 03 20:57:13.659067 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.659025 2563 scope.go:117] "RemoveContainer" containerID="96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c" Jun 03 20:57:13.669925 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.669904 2563 scope.go:117] "RemoveContainer" containerID="96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c" Jun 03 20:57:13.670195 ip-10-0-134-233 kubenswrapper[2563]: E0603 20:57:13.670171 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c\": container with ID starting with 96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c not found: ID does not exist" containerID="96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c" Jun 03 20:57:13.670255 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.670206 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c"} err="failed to get container status \"96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c\": rpc error: code = NotFound desc = could not find container \"96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c\": container with ID starting with 96592d4cff3cca63fa286adc606c561437b499305354bb96ddf58a355aac9b6c not found: ID does not exist" Jun 03 20:57:13.681186 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.681155 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 20:57:13.685729 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.685709 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 20:57:13.708091 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.708070 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 20:57:13.708468 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.708455 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" Jun 03 20:57:13.708511 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.708472 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" Jun 03 20:57:13.708546 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.708537 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="756a15d6-1c07-4850-94a0-c13109a58256" containerName="keycloak" Jun 03 20:57:13.712679 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.712664 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:13.715651 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.715624 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 20:57:13.715651 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.715640 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 20:57:13.715778 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.715706 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 20:57:13.715825 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.715780 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-4shbc\"" Jun 03 20:57:13.715879 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.715864 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 20:57:13.721703 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.721683 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 20:57:13.757437 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.757404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcs6v\" (UniqueName: \"kubernetes.io/projected/50784a5e-1fe1-473e-960d-350d3c21d3f7-kube-api-access-dcs6v\") pod \"maas-keycloak-0\" (UID: \"50784a5e-1fe1-473e-960d-350d3c21d3f7\") " pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:13.757593 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.757459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/50784a5e-1fe1-473e-960d-350d3c21d3f7-test-realms\") pod \"maas-keycloak-0\" (UID: \"50784a5e-1fe1-473e-960d-350d3c21d3f7\") " pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:13.858683 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.858596 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcs6v\" (UniqueName: \"kubernetes.io/projected/50784a5e-1fe1-473e-960d-350d3c21d3f7-kube-api-access-dcs6v\") pod \"maas-keycloak-0\" (UID: \"50784a5e-1fe1-473e-960d-350d3c21d3f7\") " pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:13.858683 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.858654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/50784a5e-1fe1-473e-960d-350d3c21d3f7-test-realms\") pod \"maas-keycloak-0\" (UID: \"50784a5e-1fe1-473e-960d-350d3c21d3f7\") " pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:13.859343 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.859325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/50784a5e-1fe1-473e-960d-350d3c21d3f7-test-realms\") pod \"maas-keycloak-0\" (UID: \"50784a5e-1fe1-473e-960d-350d3c21d3f7\") " pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:13.867252 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.867229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcs6v\" (UniqueName: \"kubernetes.io/projected/50784a5e-1fe1-473e-960d-350d3c21d3f7-kube-api-access-dcs6v\") pod \"maas-keycloak-0\" (UID: \"50784a5e-1fe1-473e-960d-350d3c21d3f7\") " pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:13.905774 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:13.905744 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="756a15d6-1c07-4850-94a0-c13109a58256" path="/var/lib/kubelet/pods/756a15d6-1c07-4850-94a0-c13109a58256/volumes" Jun 03 20:57:14.024051 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:14.024016 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:14.160027 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:14.160000 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 20:57:14.161619 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:57:14.161590 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50784a5e_1fe1_473e_960d_350d3c21d3f7.slice/crio-79c851c08828217ed99a9bd7ce10ea7b15c9529bdf214cbcc73918d37875a2a9 WatchSource:0}: Error finding container 79c851c08828217ed99a9bd7ce10ea7b15c9529bdf214cbcc73918d37875a2a9: Status 404 returned error can't find the container with id 79c851c08828217ed99a9bd7ce10ea7b15c9529bdf214cbcc73918d37875a2a9 Jun 03 20:57:14.606776 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:14.606753 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-fqswm" Jun 03 20:57:14.607171 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:14.607151 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-djtbw" Jun 03 20:57:14.668710 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:14.668676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"50784a5e-1fe1-473e-960d-350d3c21d3f7","Type":"ContainerStarted","Data":"12a3e161709157426af027de2891f1776ae17936a337101eae30f97be1d14b81"} Jun 03 20:57:14.668899 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:14.668728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"50784a5e-1fe1-473e-960d-350d3c21d3f7","Type":"ContainerStarted","Data":"79c851c08828217ed99a9bd7ce10ea7b15c9529bdf214cbcc73918d37875a2a9"} Jun 03 20:57:14.687451 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:14.687399 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.299443747 podStartE2EDuration="1.68738435s" totalImagesPullingTime="387.940603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:57:14.684937604 +0000 UTC m=+819.283816569" watchObservedRunningTime="2026-06-03 20:57:14.68738435 +0000 UTC m=+819.286263311" Jun 03 20:57:15.024412 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:15.024379 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:15.025978 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:15.025917 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:16.025375 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:16.025330 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:17.025272 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:17.025221 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:18.025329 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:18.025271 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:19.024645 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:19.024592 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:20.025377 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:20.025327 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:21.024758 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:21.024709 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:22.025209 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:22.025156 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:23.024764 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:23.024711 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:24.024499 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:24.024457 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:24.024912 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:24.024882 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:25.025458 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:25.025405 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:26.025200 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:26.025153 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:27.025275 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:27.025235 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 03 20:57:28.153805 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:28.153755 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 20:57:28.172514 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:28.172456 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="50784a5e-1fe1-473e-960d-350d3c21d3f7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:57:38.161266 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:57:38.161231 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 20:58:07.780424 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:07.780390 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 20:58:11.618301 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.618266 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj"] Jun 03 20:58:11.620907 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.620890 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.623271 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.623250 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 20:58:11.624231 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.624215 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 20:58:11.624327 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.624285 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 20:58:11.624380 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.624361 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s7xf5\"" Jun 03 20:58:11.633265 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.633237 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj"] Jun 03 20:58:11.709507 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.709473 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.709670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.709521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.709670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.709541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.709670 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.709647 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cbhh\" (UniqueName: \"kubernetes.io/projected/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-kube-api-access-2cbhh\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.709774 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.709685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.709774 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.709711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.811025 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.810976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.811214 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.811041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.811214 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.811070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.811214 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.811126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cbhh\" (UniqueName: \"kubernetes.io/projected/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-kube-api-access-2cbhh\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.811214 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.811162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.811214 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.811194 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.811485 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.811421 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.811547 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.811499 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.811547 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.811538 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.813256 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.813232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.813589 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.813563 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.820246 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.820222 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cbhh\" (UniqueName: \"kubernetes.io/projected/d3eca0fe-a948-4b1d-ad5c-54eb8a53e445-kube-api-access-2cbhh\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mxvnj\" (UID: \"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:11.932275 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:11.932193 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:12.069149 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:12.069121 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj"] Jun 03 20:58:12.070746 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:58:12.070721 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3eca0fe_a948_4b1d_ad5c_54eb8a53e445.slice/crio-82f0bf22d90fcd27a3c47814765f0a2796d1ac4515839f938ce2586d5efc4be7 WatchSource:0}: Error finding container 82f0bf22d90fcd27a3c47814765f0a2796d1ac4515839f938ce2586d5efc4be7: Status 404 returned error can't find the container with id 82f0bf22d90fcd27a3c47814765f0a2796d1ac4515839f938ce2586d5efc4be7 Jun 03 20:58:12.281069 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:12.281036 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 20:58:13.057644 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:13.057606 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" event={"ID":"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445","Type":"ContainerStarted","Data":"82f0bf22d90fcd27a3c47814765f0a2796d1ac4515839f938ce2586d5efc4be7"} Jun 03 20:58:16.078215 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:16.078171 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" event={"ID":"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445","Type":"ContainerStarted","Data":"8e24b4aecaa8ff4a06ac0494f4d7e3a1d14d6274cbb7056c7bb3c8dcbb8b7eed"} Jun 03 20:58:17.084660 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:17.084624 2563 generic.go:356] "Generic (PLEG): container finished" podID="d3eca0fe-a948-4b1d-ad5c-54eb8a53e445" containerID="8e24b4aecaa8ff4a06ac0494f4d7e3a1d14d6274cbb7056c7bb3c8dcbb8b7eed" exitCode=0 Jun 03 20:58:17.084660 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:17.084663 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" event={"ID":"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445","Type":"ContainerDied","Data":"8e24b4aecaa8ff4a06ac0494f4d7e3a1d14d6274cbb7056c7bb3c8dcbb8b7eed"} Jun 03 20:58:19.099163 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:19.099131 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" event={"ID":"d3eca0fe-a948-4b1d-ad5c-54eb8a53e445","Type":"ContainerStarted","Data":"429524670e9f47e6a0946e64f99153f83ac4eee9df8d018bb58b8a41ee8b2bfb"} Jun 03 20:58:19.119274 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:19.119219 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" podStartSLOduration=2.6922302719999998 podStartE2EDuration="8.119204314s" totalImagesPullingTime="4.143010855s" totalInitContainerRuntime="1.283963187s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:58:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:58:19.116935022 +0000 UTC m=+883.715813985" watchObservedRunningTime="2026-06-03 20:58:19.119204314 +0000 UTC m=+883.718083313" Jun 03 20:58:21.932644 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:21.932610 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:21.933044 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:21.932669 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:21.944882 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:21.944859 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:22.133290 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:22.133256 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mxvnj" Jun 03 20:58:24.881385 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:24.881349 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 20:58:30.578405 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:30.578363 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 20:58:35.935333 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:35.935288 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 20:58:35.937237 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:35.937213 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 20:58:40.289183 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:40.289142 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 20:58:53.898332 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:53.898295 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf"] Jun 03 20:58:53.902173 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:53.902144 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:53.904728 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:53.904708 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 20:58:53.916928 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:53.916907 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf"] Jun 03 20:58:53.989686 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:53.989654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:53.989686 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:53.989697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmhdk\" (UniqueName: \"kubernetes.io/projected/2995335f-c8d3-43db-ac11-01c0136b40c4-kube-api-access-nmhdk\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:53.989920 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:53.989721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2995335f-c8d3-43db-ac11-01c0136b40c4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:53.989920 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:53.989780 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:53.989920 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:53.989805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:53.990056 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:53.989909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.091113 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.091078 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.091304 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.091122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.091304 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.091159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmhdk\" (UniqueName: \"kubernetes.io/projected/2995335f-c8d3-43db-ac11-01c0136b40c4-kube-api-access-nmhdk\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.091304 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.091186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2995335f-c8d3-43db-ac11-01c0136b40c4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.091304 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.091244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.091304 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.091285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.091579 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.091551 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.091642 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.091573 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.091642 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.091599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.093532 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.093513 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2995335f-c8d3-43db-ac11-01c0136b40c4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.093695 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.093679 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2995335f-c8d3-43db-ac11-01c0136b40c4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.101234 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.101212 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmhdk\" (UniqueName: \"kubernetes.io/projected/2995335f-c8d3-43db-ac11-01c0136b40c4-kube-api-access-nmhdk\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-nmmbf\" (UID: \"2995335f-c8d3-43db-ac11-01c0136b40c4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.215216 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.215123 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:58:54.364074 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:54.364042 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf"] Jun 03 20:58:54.365791 ip-10-0-134-233 kubenswrapper[2563]: W0603 20:58:54.365763 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2995335f_c8d3_43db_ac11_01c0136b40c4.slice/crio-4804793922c304f95dc3805245d31ed9732c564c62f6fad28146d522e4378713 WatchSource:0}: Error finding container 4804793922c304f95dc3805245d31ed9732c564c62f6fad28146d522e4378713: Status 404 returned error can't find the container with id 4804793922c304f95dc3805245d31ed9732c564c62f6fad28146d522e4378713 Jun 03 20:58:55.315851 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:55.315813 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" event={"ID":"2995335f-c8d3-43db-ac11-01c0136b40c4","Type":"ContainerStarted","Data":"ba15fa47bf833b38f2d378a669392a862ca25c8dbbb3403a9e7d19fd7d24fedf"} Jun 03 20:58:55.316241 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:55.315866 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" event={"ID":"2995335f-c8d3-43db-ac11-01c0136b40c4","Type":"ContainerStarted","Data":"4804793922c304f95dc3805245d31ed9732c564c62f6fad28146d522e4378713"} Jun 03 20:58:56.184837 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:56.184798 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 20:58:56.322269 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:56.322235 2563 generic.go:356] "Generic (PLEG): container finished" podID="2995335f-c8d3-43db-ac11-01c0136b40c4" containerID="ba15fa47bf833b38f2d378a669392a862ca25c8dbbb3403a9e7d19fd7d24fedf" exitCode=0 Jun 03 20:58:56.322650 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:56.322318 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" event={"ID":"2995335f-c8d3-43db-ac11-01c0136b40c4","Type":"ContainerDied","Data":"ba15fa47bf833b38f2d378a669392a862ca25c8dbbb3403a9e7d19fd7d24fedf"} Jun 03 20:58:57.329639 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:57.329600 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" event={"ID":"2995335f-c8d3-43db-ac11-01c0136b40c4","Type":"ContainerStarted","Data":"1913899a2f0369894fdca819c6d687411295e2794ed5a87fb4a6f093fb0eaa10"} Jun 03 20:58:57.349298 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:58:57.349240 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" podStartSLOduration=2.908065414 podStartE2EDuration="4.349226414s" totalImagesPullingTime="235.711931ms" totalInitContainerRuntime="1.205449069s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:58:57.347860177 +0000 UTC m=+921.946739152" watchObservedRunningTime="2026-06-03 20:58:57.349226414 +0000 UTC m=+921.948105421" Jun 03 20:59:04.215340 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:59:04.215302 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:59:04.215802 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:59:04.215352 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:59:04.228232 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:59:04.228210 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 20:59:04.382234 ip-10-0-134-233 kubenswrapper[2563]: I0603 20:59:04.382208 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-nmmbf" Jun 03 21:00:30.683261 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:00:30.683225 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:00:41.379611 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:00:41.379575 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:00:49.995113 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:00:49.995065 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:01:00.695050 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:01:00.695013 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:01:09.782896 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:01:09.782857 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:01:20.573735 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:01:20.573694 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:02:32.194037 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:02:32.193998 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:02:48.388368 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:02:48.388332 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:03:26.982396 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:03:26.982351 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:03:35.985554 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:03:35.985522 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 21:03:35.992931 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:03:35.992904 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 21:03:43.784930 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:03:43.784895 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:03:57.888596 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:03:57.888556 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:04:14.282144 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:04:14.282111 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:04:41.884436 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:04:41.884336 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:04:49.784208 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:04:49.784170 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:05:10.689565 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:05:10.689526 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:05:19.878637 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:05:19.878595 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:05:36.881319 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:05:36.881283 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:05:43.981681 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:05:43.981641 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:05:51.485315 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:05:51.485275 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:05:58.578492 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:05:58.578404 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:06:04.382408 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:06:04.382375 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:06:10.189350 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:06:10.189310 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:06:42.989985 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:06:42.989923 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:06:50.790218 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:06:50.790183 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:06:58.986831 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:06:58.986797 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:07:06.878315 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:07:06.878273 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:07:16.377281 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:07:16.377245 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:07:32.886068 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:07:32.885981 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:07:46.278034 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:07:46.277994 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:08:33.787418 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:08:33.787380 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:08:36.030767 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:08:36.030739 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 21:08:36.036022 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:08:36.036004 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 21:08:41.985154 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:08:41.985114 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:08:47.580241 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:08:47.580203 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:08:56.090519 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:08:56.090436 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:09:05.088887 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:09:05.088848 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:09:13.887820 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:09:13.887783 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:09:22.788620 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:09:22.788581 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:09:31.788492 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:09:31.788455 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:09:40.102083 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:09:40.102044 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:09:47.481135 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:09:47.481099 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:09:57.685092 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:09:57.685055 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:10:04.482502 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:10:04.482468 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:10:14.887093 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:10:14.887051 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:10:21.775574 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:10:21.775533 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:10:31.582041 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:10:31.581959 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:10:40.187281 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:10:40.187238 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:10:48.990511 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:10:48.990468 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:10:58.184374 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:10:58.184329 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:13:15.378586 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:13:15.378550 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:13:22.587823 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:13:22.587789 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:13:36.076254 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:13:36.076229 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 21:13:36.083516 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:13:36.083496 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 21:13:46.784824 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:13:46.784786 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:13:57.189689 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:13:57.189652 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:14:06.286895 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:14:06.286860 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:14:16.890489 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:14:16.890447 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:14:25.582964 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:14:25.582895 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:14:36.389114 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:14:36.389074 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:14:45.385990 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:14:45.385955 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:14:54.482672 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:14:54.482618 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:15:04.779776 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:15:04.779684 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:15:13.781168 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:15:13.781126 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:15:22.680970 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:15:22.680904 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:15:56.684965 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:15:56.684905 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:16:38.585062 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:16:38.584966 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:16:47.787429 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:16:47.787394 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:16:56.691102 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:16:56.691063 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:17:06.290326 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:17:06.290293 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:17:12.895562 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:17:12.895524 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:17:25.680343 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:17:25.680310 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:17:36.282186 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:17:36.282148 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:17:43.887510 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:17:43.887467 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:17:54.088323 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:17:54.088287 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:18:01.490341 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:18:01.490251 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:18:11.683928 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:18:11.683881 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:18:23.605559 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:18:23.605519 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:18:36.116880 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:18:36.116851 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 21:18:36.134455 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:18:36.134427 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 21:18:40.695607 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:18:40.695567 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:18:49.791050 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:18:49.791014 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:18:59.086061 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:18:59.086025 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:19:05.293637 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:19:05.293605 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:19:23.884518 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:19:23.884479 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:19:30.698880 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:19:30.698799 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:19:39.491097 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:19:39.491055 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:19:47.983116 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:19:47.983075 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:19:56.683056 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:19:56.683017 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:20:05.286688 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:20:05.286648 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:20:16.089885 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:20:16.089852 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:20:29.780673 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:20:29.780627 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:20:39.701763 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:20:39.701727 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:20:53.191321 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:20:53.191275 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:21:02.090384 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:21:02.090280 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:21:10.680702 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:21:10.680669 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:21:21.088579 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:21:21.088542 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:21:29.186212 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:21:29.186175 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:21:47.483979 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:21:47.483928 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:21:56.490628 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:21:56.490593 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:22:05.490091 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:22:05.490050 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:22:12.811378 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:22:12.811344 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:22:37.592618 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:22:37.592537 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:22:50.286498 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:22:50.286462 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4mz96"] Jun 03 21:23:00.320747 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:00.320712 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56dd8b9685-c8rr8_73a26330-3c83-4bc8-ae21-f6bb1cc26e16/nginx/0.log" Jun 03 21:23:00.553957 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:00.553905 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-z6pw7_55f01fdb-e737-496b-925e-e494c1c0688a/manager/0.log" Jun 03 21:23:00.691831 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:00.691745 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7lpn4_bb82f21d-e603-4609-b76f-b9cb7b783bbc/manager/0.log" Jun 03 21:23:00.853441 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:00.853412 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-74d4c49c6f-bwq62_371da26d-4d35-42f1-96c2-f93fa9cc6140/maas-api/0.log" Jun 03 21:23:01.317847 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:01.317808 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9j652_09aa54a4-159d-4876-afb1-068172e4d966/server/0.log" Jun 03 21:23:01.442809 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:01.442777 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4ffk4_87075c79-e028-4d7b-bd88-b8449d405131/manager/0.log" Jun 03 21:23:01.724987 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:01.724888 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-lflx2_aacaad25-f33e-4b58-a137-0ff56921a11f/copy-manifests/0.log" Jun 03 21:23:01.739210 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:01.739168 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-lflx2_aacaad25-f33e-4b58-a137-0ff56921a11f/manager/0.log" Jun 03 21:23:02.740584 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:02.740553 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc_79536e91-690a-4cc6-86df-3bec085989c2/util/0.log" Jun 03 21:23:02.752290 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:02.752253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc_79536e91-690a-4cc6-86df-3bec085989c2/pull/0.log" Jun 03 21:23:02.761967 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:02.761927 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc_79536e91-690a-4cc6-86df-3bec085989c2/extract/0.log" Jun 03 21:23:02.875992 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:02.875934 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct_540236b5-137a-42f5-8e4a-06b26f1b120f/extract/0.log" Jun 03 21:23:02.889003 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:02.888980 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct_540236b5-137a-42f5-8e4a-06b26f1b120f/util/0.log" Jun 03 21:23:02.898326 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:02.898303 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct_540236b5-137a-42f5-8e4a-06b26f1b120f/pull/0.log" Jun 03 21:23:03.021357 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:03.021329 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6_120e8ada-f094-4817-b982-cd7d3959561a/util/0.log" Jun 03 21:23:03.028406 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:03.028379 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6_120e8ada-f094-4817-b982-cd7d3959561a/pull/0.log" Jun 03 21:23:03.035986 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:03.035962 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6_120e8ada-f094-4817-b982-cd7d3959561a/extract/0.log" Jun 03 21:23:03.179000 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:03.178970 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c_987b958e-2afc-4184-ba16-69b560c1f9a5/util/0.log" Jun 03 21:23:03.189661 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:03.189634 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c_987b958e-2afc-4184-ba16-69b560c1f9a5/pull/0.log" Jun 03 21:23:03.202489 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:03.202462 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c_987b958e-2afc-4184-ba16-69b560c1f9a5/extract/0.log" Jun 03 21:23:04.076811 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:04.076783 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4mz96_1263626e-d016-463d-8f40-0f94468000a6/limitador/0.log" Jun 03 21:23:04.678181 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:04.678149 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-l9xhk_35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383/discovery/0.log" Jun 03 21:23:04.904168 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:04.904138 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6d85b7bd-xnhll_3330a564-1ef7-4948-bb63-2a740296e4c3/kube-auth-proxy/0.log" Jun 03 21:23:05.151040 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:05.151010 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-djtbw_00aded2f-4418-405b-bb6c-b92224fbe1c0/payload-pre-processing/0.log" Jun 03 21:23:05.266773 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:05.266740 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqswm_2769c67a-a4f4-4223-a55c-074459817a9e/payload-processing/0.log" Jun 03 21:23:05.389697 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:05.389672 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85c74bff45-m9bnm_9a663e3f-2a94-475e-89de-3fa4de960eb2/router/0.log" Jun 03 21:23:05.863779 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:05.863733 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-mxvnj_d3eca0fe-a948-4b1d-ad5c-54eb8a53e445/storage-initializer/0.log" Jun 03 21:23:05.875844 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:05.875808 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-mxvnj_d3eca0fe-a948-4b1d-ad5c-54eb8a53e445/main/0.log" Jun 03 21:23:06.360803 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:06.360766 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-nmmbf_2995335f-c8d3-43db-ac11-01c0136b40c4/storage-initializer/0.log" Jun 03 21:23:06.369104 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:06.369078 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-nmmbf_2995335f-c8d3-43db-ac11-01c0136b40c4/main/0.log" Jun 03 21:23:13.293288 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:13.293261 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c4cnh_b3c760f9-ef51-42cc-b57a-a945396666df/global-pull-secret-syncer/0.log" Jun 03 21:23:13.512688 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:13.512654 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lf7rr_75da9761-a791-43a6-9b2a-5c4541f0b947/konnectivity-agent/0.log" Jun 03 21:23:13.638429 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:13.638340 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-233.ec2.internal_63aad158be7a52985bc7aa2bdf4ecbef/haproxy/0.log" Jun 03 21:23:17.346576 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:17.346536 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-fmk9p_a2a71085-b77d-42b3-8c2c-8830bce92c1c/sail-operator/0.log" Jun 03 21:23:18.626235 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.626178 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc_79536e91-690a-4cc6-86df-3bec085989c2/extract/0.log" Jun 03 21:23:18.651445 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.651399 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc_79536e91-690a-4cc6-86df-3bec085989c2/util/0.log" Jun 03 21:23:18.676609 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.676574 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968ghc_79536e91-690a-4cc6-86df-3bec085989c2/pull/0.log" Jun 03 21:23:18.710752 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.710725 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct_540236b5-137a-42f5-8e4a-06b26f1b120f/extract/0.log" Jun 03 21:23:18.732093 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.732069 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct_540236b5-137a-42f5-8e4a-06b26f1b120f/util/0.log" Jun 03 21:23:18.755179 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.755152 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j9zct_540236b5-137a-42f5-8e4a-06b26f1b120f/pull/0.log" Jun 03 21:23:18.791813 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.791789 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6_120e8ada-f094-4817-b982-cd7d3959561a/extract/0.log" Jun 03 21:23:18.817776 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.817758 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6_120e8ada-f094-4817-b982-cd7d3959561a/util/0.log" Jun 03 21:23:18.849204 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.849156 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnr6_120e8ada-f094-4817-b982-cd7d3959561a/pull/0.log" Jun 03 21:23:18.872867 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.872844 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c_987b958e-2afc-4184-ba16-69b560c1f9a5/extract/0.log" Jun 03 21:23:18.898887 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.898811 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c_987b958e-2afc-4184-ba16-69b560c1f9a5/util/0.log" Jun 03 21:23:18.923066 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:18.923042 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12zk5c_987b958e-2afc-4184-ba16-69b560c1f9a5/pull/0.log" Jun 03 21:23:19.647128 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:19.647099 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4mz96_1263626e-d016-463d-8f40-0f94468000a6/limitador/0.log" Jun 03 21:23:21.753382 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:21.753354 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-9b9fc658-7xv9p_4e3bc557-1fb6-41df-95a3-45303dd7bf78/monitoring-plugin/0.log" Jun 03 21:23:22.084317 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:22.084287 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frcph_9ee6199d-5238-4d67-9c0c-266651ad194b/node-exporter/0.log" Jun 03 21:23:22.106445 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:22.106424 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frcph_9ee6199d-5238-4d67-9c0c-266651ad194b/kube-rbac-proxy/0.log" Jun 03 21:23:22.132086 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:22.132060 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frcph_9ee6199d-5238-4d67-9c0c-266651ad194b/init-textfile/0.log" Jun 03 21:23:22.160505 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:22.160487 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vbd97_7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a/kube-rbac-proxy-main/0.log" Jun 03 21:23:22.182143 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:22.182116 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vbd97_7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a/kube-rbac-proxy-self/0.log" Jun 03 21:23:22.204435 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:22.204407 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vbd97_7e54c3ad-f616-4e27-9d23-9a2b5b7cf80a/openshift-state-metrics/0.log" Jun 03 21:23:22.488370 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:22.488267 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-qx9f5_5c4748f0-0956-4272-adc8-c3a174466aa0/prometheus-operator/0.log" Jun 03 21:23:22.511825 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:22.511800 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-qx9f5_5c4748f0-0956-4272-adc8-c3a174466aa0/kube-rbac-proxy/0.log" Jun 03 21:23:22.587316 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:22.587289 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64c66f54c4-hntz4_225fc59e-6d41-41fb-81fe-f17f5692db94/telemeter-client/0.log" Jun 03 21:23:22.612152 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:22.612121 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64c66f54c4-hntz4_225fc59e-6d41-41fb-81fe-f17f5692db94/reload/0.log" Jun 03 21:23:22.643891 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:22.643864 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64c66f54c4-hntz4_225fc59e-6d41-41fb-81fe-f17f5692db94/kube-rbac-proxy/0.log" Jun 03 21:23:24.856900 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:24.856869 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 21:23:24.866081 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:24.866054 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/2.log" Jun 03 21:23:25.559479 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.559446 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-w75kx_1f3337fa-5dcd-4432-88dc-fd9a7ed5f324/download-server/0.log" Jun 03 21:23:25.631859 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.631828 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8"] Jun 03 21:23:25.635820 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.635798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.640195 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.640177 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjqlg\"/\"kube-root-ca.crt\"" Jun 03 21:23:25.640294 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.640178 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pjqlg\"/\"default-dockercfg-jwvcn\"" Jun 03 21:23:25.641246 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.641217 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjqlg\"/\"openshift-service-ca.crt\"" Jun 03 21:23:25.649751 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.649732 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8"] Jun 03 21:23:25.733061 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.733025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-proc\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.733061 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.733063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72b5q\" (UniqueName: \"kubernetes.io/projected/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-kube-api-access-72b5q\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.733276 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.733119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-podres\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.733276 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.733164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-sys\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.733276 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.733194 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-lib-modules\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.833821 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.833735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-podres\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.833821 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.833781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-sys\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.834107 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.833856 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-sys\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.834107 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.833904 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-podres\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.834107 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.833903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-lib-modules\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.834107 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.834026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-proc\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.834107 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.834032 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-lib-modules\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.834107 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.834052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72b5q\" (UniqueName: \"kubernetes.io/projected/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-kube-api-access-72b5q\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.834107 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.834097 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-proc\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.843462 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.843442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72b5q\" (UniqueName: \"kubernetes.io/projected/d40ded74-a9e2-4457-910f-f5e6bca1eaa9-kube-api-access-72b5q\") pod \"perf-node-gather-daemonset-w2mx8\" (UID: \"d40ded74-a9e2-4457-910f-f5e6bca1eaa9\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:25.946074 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:25.946043 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:26.085154 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:26.085100 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8"] Jun 03 21:23:26.086834 ip-10-0-134-233 kubenswrapper[2563]: W0603 21:23:26.086808 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd40ded74_a9e2_4457_910f_f5e6bca1eaa9.slice/crio-2b1898ea8724af4a2d99379e9b2b02073fcf5c5e640aa93dcaf5e1ce3e5fd4ba WatchSource:0}: Error finding container 2b1898ea8724af4a2d99379e9b2b02073fcf5c5e640aa93dcaf5e1ce3e5fd4ba: Status 404 returned error can't find the container with id 2b1898ea8724af4a2d99379e9b2b02073fcf5c5e640aa93dcaf5e1ce3e5fd4ba Jun 03 21:23:26.876788 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:26.876757 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" event={"ID":"d40ded74-a9e2-4457-910f-f5e6bca1eaa9","Type":"ContainerStarted","Data":"67cec90fbe98d6b84f0f34081993d3499032ce21b5df235d253d59ef47ba9056"} Jun 03 21:23:26.876995 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:26.876809 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" event={"ID":"d40ded74-a9e2-4457-910f-f5e6bca1eaa9","Type":"ContainerStarted","Data":"2b1898ea8724af4a2d99379e9b2b02073fcf5c5e640aa93dcaf5e1ce3e5fd4ba"} Jun 03 21:23:26.876995 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:26.876864 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:26.897579 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:26.897528 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" podStartSLOduration=1.8975120269999999 podStartE2EDuration="1.897512027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:23:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:23:26.89609628 +0000 UTC m=+2391.494975254" watchObservedRunningTime="2026-06-03 21:23:26.897512027 +0000 UTC m=+2391.496390990" Jun 03 21:23:27.437808 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:27.437771 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w9jpb_644071d7-1aca-4adc-ae34-91ef0eb3ccad/dns/0.log" Jun 03 21:23:27.461038 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:27.461008 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w9jpb_644071d7-1aca-4adc-ae34-91ef0eb3ccad/kube-rbac-proxy/0.log" Jun 03 21:23:27.514585 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:27.514559 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hvb8z_4381bffc-e0ab-444d-a052-3972c1a0dbbd/dns-node-resolver/0.log" Jun 03 21:23:28.119357 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:28.119292 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g7wxk_f52cd91a-765c-4427-81c7-caa38584c1b6/node-ca/0.log" Jun 03 21:23:29.288774 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:29.288740 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-l9xhk_35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383/discovery/0.log" Jun 03 21:23:29.352997 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:29.352971 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6d85b7bd-xnhll_3330a564-1ef7-4948-bb63-2a740296e4c3/kube-auth-proxy/0.log" Jun 03 21:23:29.493619 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:29.493584 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-djtbw_00aded2f-4418-405b-bb6c-b92224fbe1c0/payload-pre-processing/0.log" Jun 03 21:23:29.590194 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:29.590110 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqswm_2769c67a-a4f4-4223-a55c-074459817a9e/payload-processing/0.log" Jun 03 21:23:29.619456 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:29.619428 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85c74bff45-m9bnm_9a663e3f-2a94-475e-89de-3fa4de960eb2/router/0.log" Jun 03 21:23:30.256892 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:30.256861 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7n84d_fef46e08-feb6-4bd1-b811-beb040c66ec2/serve-healthcheck-canary/0.log" Jun 03 21:23:31.046079 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:31.046047 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbhs4_0410bcc3-0e5b-45e6-975e-06204dbf5c09/kube-rbac-proxy/0.log" Jun 03 21:23:31.068683 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:31.068659 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbhs4_0410bcc3-0e5b-45e6-975e-06204dbf5c09/exporter/0.log" Jun 03 21:23:31.092000 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:31.091969 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vbhs4_0410bcc3-0e5b-45e6-975e-06204dbf5c09/extractor/0.log" Jun 03 21:23:32.892801 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:32.892777 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-w2mx8" Jun 03 21:23:33.330618 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:33.330582 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56dd8b9685-c8rr8_73a26330-3c83-4bc8-ae21-f6bb1cc26e16/nginx/0.log" Jun 03 21:23:33.390260 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:33.390222 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-z6pw7_55f01fdb-e737-496b-925e-e494c1c0688a/manager/0.log" Jun 03 21:23:33.523899 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:33.523862 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7lpn4_bb82f21d-e603-4609-b76f-b9cb7b783bbc/manager/0.log" Jun 03 21:23:33.577867 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:33.577824 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-74d4c49c6f-bwq62_371da26d-4d35-42f1-96c2-f93fa9cc6140/maas-api/0.log" Jun 03 21:23:33.733372 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:33.733261 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9j652_09aa54a4-159d-4876-afb1-068172e4d966/server/0.log" Jun 03 21:23:33.808409 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:33.808383 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4ffk4_87075c79-e028-4d7b-bd88-b8449d405131/manager/0.log" Jun 03 21:23:33.975316 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:33.975285 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-lflx2_aacaad25-f33e-4b58-a137-0ff56921a11f/manager/0.log" Jun 03 21:23:33.996134 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:33.996059 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-lflx2_aacaad25-f33e-4b58-a137-0ff56921a11f/copy-manifests/0.log" Jun 03 21:23:35.971103 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:35.971023 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zcjk8_e224fc53-37ff-4a85-af9a-96073e53553b/openshift-lws-operator/0.log" Jun 03 21:23:36.165913 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:36.165883 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 21:23:36.177368 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:36.177339 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-lfp8d_1c206b8a-2d18-41f4-83b5-67f49d8848c7/console-operator/1.log" Jun 03 21:23:39.202255 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:39.202228 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-l9xhk_35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383/discovery/0.log" Jun 03 21:23:39.235389 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:39.235362 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6d85b7bd-xnhll_3330a564-1ef7-4948-bb63-2a740296e4c3/kube-auth-proxy/0.log" Jun 03 21:23:39.353795 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:39.353740 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-djtbw_00aded2f-4418-405b-bb6c-b92224fbe1c0/payload-pre-processing/0.log" Jun 03 21:23:39.445384 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:39.445350 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqswm_2769c67a-a4f4-4223-a55c-074459817a9e/payload-processing/0.log" Jun 03 21:23:39.464518 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:39.464446 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85c74bff45-m9bnm_9a663e3f-2a94-475e-89de-3fa4de960eb2/router/0.log" Jun 03 21:23:40.676656 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:40.676619 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-l9xhk_35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383/discovery/0.log" Jun 03 21:23:40.703366 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:40.703326 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6d85b7bd-xnhll_3330a564-1ef7-4948-bb63-2a740296e4c3/kube-auth-proxy/0.log" Jun 03 21:23:40.826664 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:40.826632 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-djtbw_00aded2f-4418-405b-bb6c-b92224fbe1c0/payload-pre-processing/0.log" Jun 03 21:23:40.916922 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:40.916894 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqswm_2769c67a-a4f4-4223-a55c-074459817a9e/payload-processing/0.log" Jun 03 21:23:40.952648 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:40.952569 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85c74bff45-m9bnm_9a663e3f-2a94-475e-89de-3fa4de960eb2/router/0.log" Jun 03 21:23:41.863196 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:41.863169 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt_b8e065fe-a286-4947-839d-9d4526cbd0d4/kube-storage-version-migrator-operator/1.log" Jun 03 21:23:41.864730 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:41.864705 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-gw5nt_b8e065fe-a286-4947-839d-9d4526cbd0d4/kube-storage-version-migrator-operator/0.log" Jun 03 21:23:42.897853 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:42.897818 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-l9xhk_35e406d5-d7c4-4bfc-a1f2-7ffc37ee5383/discovery/0.log" Jun 03 21:23:42.927727 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:42.927699 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6d85b7bd-xnhll_3330a564-1ef7-4948-bb63-2a740296e4c3/kube-auth-proxy/0.log" Jun 03 21:23:43.037095 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:43.037065 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-djtbw_00aded2f-4418-405b-bb6c-b92224fbe1c0/payload-pre-processing/0.log" Jun 03 21:23:43.135910 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:43.135871 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqswm_2769c67a-a4f4-4223-a55c-074459817a9e/payload-processing/0.log" Jun 03 21:23:43.154143 ip-10-0-134-233 kubenswrapper[2563]: I0603 21:23:43.154068 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85c74bff45-m9bnm_9a663e3f-2a94-475e-89de-3fa4de960eb2/router/0.log"