Jun 10 11:55:36.981036 ip-10-0-128-88 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 11:55:36.981049 ip-10-0-128-88 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 11:55:36.981059 ip-10-0-128-88 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 11:55:36.981259 ip-10-0-128-88 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 11:55:47.021840 ip-10-0-128-88 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 11:55:47.021857 ip-10-0-128-88 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e6c8b727bc1145b98b3a7a1679f1c000 -- Jun 10 11:58:09.805980 ip-10-0-128-88 systemd[1]: Starting Kubernetes Kubelet... Jun 10 11:58:10.182222 ip-10-0-128-88 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:58:10.182222 ip-10-0-128-88 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 11:58:10.182222 ip-10-0-128-88 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:58:10.182222 ip-10-0-128-88 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 11:58:10.182222 ip-10-0-128-88 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:58:10.183057 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.182968 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 11:58:10.187974 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.187949 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:10.187974 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.187973 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:10.187974 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.187977 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.187981 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.187985 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.187988 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.187991 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.187994 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.187997 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188000 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188003 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188006 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188009 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188019 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188022 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188025 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188028 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188031 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188034 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188038 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188041 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188045 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:10.188082 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188050 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188053 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188056 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188058 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188062 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188064 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188067 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188070 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188072 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188076 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188078 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188081 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188084 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188087 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188090 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188094 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188097 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188099 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188102 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188105 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:10.188576 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188108 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188111 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188113 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188116 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188119 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188121 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188124 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188127 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188132 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188135 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188139 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188141 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188145 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188148 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188151 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188155 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188158 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188160 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188164 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:10.189086 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188166 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188170 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188173 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188175 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188179 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188183 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188187 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188190 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188193 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188195 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188198 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188201 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188204 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188206 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188210 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188213 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188215 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188218 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188221 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:10.189567 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188224 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188228 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188231 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188233 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188236 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188238 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188241 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188245 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188249 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188252 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188254 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188257 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188260 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188263 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188265 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188269 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188271 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188275 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.188277 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189035 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:10.190053 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189042 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189045 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189048 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189051 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189054 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189057 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189060 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189063 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189065 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189068 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189071 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189074 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189076 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189079 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189084 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189088 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189091 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189094 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189097 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:10.190553 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189102 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189106 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189109 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189112 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189114 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189118 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189121 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189125 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189128 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189132 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189135 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189138 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189141 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189144 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189147 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189150 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189153 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189156 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189159 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:10.191064 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189162 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189164 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189167 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189170 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189172 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189175 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189178 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189181 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189183 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189186 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189189 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189192 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189195 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189198 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189201 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189204 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189206 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189209 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189212 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189215 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:10.191536 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189218 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189220 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189224 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189227 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189230 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189233 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189236 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189238 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189241 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189244 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189247 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189249 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189253 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189255 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189258 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189261 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189263 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189266 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189269 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189272 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:10.192061 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189275 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189278 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189280 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189283 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189286 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189289 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189291 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189294 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189298 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189302 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189306 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189308 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189311 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189314 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189316 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189319 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189322 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189325 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189328 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189330 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:10.192665 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189752 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189759 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189761 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189765 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189767 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189770 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189773 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189778 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189783 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189790 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189794 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189797 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189800 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189802 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189805 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189808 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189811 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189814 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189817 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189819 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:10.193206 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189822 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189826 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189828 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189831 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189834 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189836 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189839 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189842 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189845 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189848 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189851 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189853 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189856 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189858 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189861 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189864 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189866 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189869 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189871 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:10.193738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189874 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189876 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189881 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189884 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189887 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189889 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189892 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189895 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189897 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189900 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189903 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189906 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189909 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189913 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189916 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189919 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189922 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189925 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189928 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:10.194208 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189930 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189933 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189936 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189939 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189942 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189945 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189948 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189951 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189953 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189956 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189959 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189961 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189964 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189966 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189969 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189973 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189976 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189978 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189981 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189983 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:10.194724 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189986 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189992 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189995 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.189997 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190000 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190003 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190007 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190009 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190012 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190015 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190018 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190020 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190023 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190025 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190028 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190031 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190034 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190037 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190039 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190042 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:10.195237 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190044 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190131 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190139 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190145 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190150 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190159 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190162 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190168 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190173 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190176 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190179 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190183 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190186 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190191 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190194 2576 flags.go:64] FLAG: --cgroup-root="" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190198 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190201 2576 flags.go:64] FLAG: --client-ca-file="" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190205 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190208 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190212 2576 flags.go:64] FLAG: --cluster-domain="" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190215 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190219 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190222 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190226 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 11:58:10.195811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190230 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190233 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190236 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190239 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190243 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190248 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190252 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190255 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190258 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190263 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190266 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190269 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190272 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190275 2576 flags.go:64] FLAG: --enable-server="true" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190278 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190284 2576 flags.go:64] FLAG: --event-burst="100" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190288 2576 flags.go:64] FLAG: --event-qps="50" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190291 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190294 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190298 2576 flags.go:64] FLAG: --eviction-hard="" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190302 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190307 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190310 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190313 2576 flags.go:64] FLAG: --eviction-soft="" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190317 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 11:58:10.196417 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190320 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190323 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190326 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190329 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190333 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190336 2576 flags.go:64] FLAG: --feature-gates="" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190339 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190343 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190346 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190349 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190353 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190356 2576 flags.go:64] FLAG: --help="false" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190359 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190364 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190367 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190370 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190373 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190376 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190379 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190382 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190385 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190388 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190392 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190396 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 11:58:10.197101 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190399 2576 flags.go:64] FLAG: --kube-reserved="" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190402 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190405 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190408 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190412 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190415 2576 flags.go:64] FLAG: --lock-file="" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190419 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190422 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190425 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190430 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190433 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190436 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190440 2576 flags.go:64] FLAG: --logging-format="text" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190443 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190446 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190449 2576 flags.go:64] FLAG: --manifest-url="" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190452 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190457 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190460 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190464 2576 flags.go:64] FLAG: --max-pods="110" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190467 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190470 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190475 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190478 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190482 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 11:58:10.197717 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190485 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190488 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190496 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190499 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190502 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190507 2576 flags.go:64] FLAG: --pod-cidr="" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190510 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190517 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190520 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190523 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190527 2576 flags.go:64] FLAG: --port="10250" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190530 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190534 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ba4aef913345a2c4" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190538 2576 flags.go:64] FLAG: --qos-reserved="" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190541 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190544 2576 flags.go:64] FLAG: --register-node="true" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190547 2576 flags.go:64] FLAG: --register-with-taints="" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190550 2576 flags.go:64] FLAG: --registry-burst="10" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190554 2576 flags.go:64] FLAG: --registry-qps="5" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190557 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190560 2576 flags.go:64] FLAG: --reserved-memory="" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190564 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190567 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190570 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190573 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 11:58:10.198408 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190576 2576 flags.go:64] FLAG: --runonce="false" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190579 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190582 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190585 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190588 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190592 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190595 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190599 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190602 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190605 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190608 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190610 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190615 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190618 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190621 2576 flags.go:64] FLAG: --system-cgroups="" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190624 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190630 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190633 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190654 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190660 2576 flags.go:64] FLAG: --tls-min-version="" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190662 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190665 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190669 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190672 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190675 2576 flags.go:64] FLAG: --v="2" Jun 10 11:58:10.199075 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190679 2576 flags.go:64] FLAG: --version="false" Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190684 2576 flags.go:64] FLAG: --vmodule="" Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190687 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.190691 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190812 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190817 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190820 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190823 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190826 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190829 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190832 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190835 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190838 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190841 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190844 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190847 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190849 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190852 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190855 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190859 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:10.199741 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190862 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190865 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190867 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190870 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190872 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190875 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190879 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190882 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190885 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190887 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190890 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190893 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190896 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190898 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190901 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190904 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190906 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190909 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190912 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190914 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:10.200427 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190917 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190920 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190922 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190925 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190928 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190930 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190937 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190939 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190942 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190944 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190947 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190951 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190955 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190957 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190960 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190963 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190967 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190971 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190975 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:10.201286 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190979 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190984 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190987 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190990 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190993 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190995 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.190998 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191001 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191005 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191008 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191011 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191014 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191017 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191020 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191023 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191027 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191030 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191033 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191035 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:10.201923 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191038 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191041 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191044 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191047 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191050 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191055 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191058 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191061 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191064 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191067 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191069 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191072 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191078 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191081 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191083 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191086 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191089 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191092 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191094 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191097 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:10.202412 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191100 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191102 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191105 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191108 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.191110 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.191116 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.202078 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.202099 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.202791 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.202800 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202870 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202876 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202879 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202883 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202886 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:10.202932 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202889 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202892 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202895 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202898 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202901 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202906 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202911 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202915 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202918 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202921 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202924 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202927 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202930 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202933 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202936 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202938 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202942 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202945 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202948 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:10.203319 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202950 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202953 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202956 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202960 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202963 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202966 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202969 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202972 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202975 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202977 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202980 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202983 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202985 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202988 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202992 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202995 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.202998 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203001 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203004 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203007 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:10.203984 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203010 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203012 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203015 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203018 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203021 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203024 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203027 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203030 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203033 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203036 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203040 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203043 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203047 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203051 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203054 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203057 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203060 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203063 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203065 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:10.204491 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203068 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203071 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203073 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203076 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203079 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203081 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203084 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203087 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203090 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203093 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203096 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203099 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203102 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203104 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203107 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203110 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203114 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203117 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203119 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:10.204979 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203122 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203125 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203129 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203131 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203134 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203137 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203139 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203143 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203146 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203149 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203152 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203154 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203157 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203160 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203162 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203165 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:10.205441 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203168 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.203174 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203326 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203334 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203337 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203341 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203345 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203348 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203352 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203356 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203360 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203363 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203366 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203369 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:58:10.205862 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203373 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203376 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203379 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203382 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203385 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203388 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203391 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203393 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203396 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203399 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203401 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203405 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203408 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203410 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203413 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203416 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203419 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203421 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203424 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203427 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203430 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:58:10.206224 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203432 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203435 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203438 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203441 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203444 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203446 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203449 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203452 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203455 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203458 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203460 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203463 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203466 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203469 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203472 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203474 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203477 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203480 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203482 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:58:10.206797 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203485 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203487 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203490 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203494 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203497 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203499 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203502 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203505 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203508 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203510 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203513 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203516 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203518 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203521 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203524 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203527 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203529 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203532 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203535 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203538 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:58:10.207263 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203541 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203543 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203546 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203549 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203552 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203555 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203558 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203561 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203565 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203569 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203572 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203575 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203577 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203580 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203583 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203585 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203588 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203591 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203593 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203596 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:58:10.207819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203599 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203602 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203605 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203607 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203610 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203613 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:10.203615 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.203620 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.203789 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.206012 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.207325 2576 server.go:1019] "Starting client certificate rotation" Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.207434 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 11:58:10.208333 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.207468 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 11:58:10.209832 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.209816 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 11:58:10.214823 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.214665 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 11:58:10.223490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.223470 2576 log.go:25] "Validated CRI v1 runtime API" Jun 10 11:58:10.226119 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.226101 2576 log.go:25] "Validated CRI v1 image API" Jun 10 11:58:10.227562 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.227544 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 11:58:10.231900 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.231874 2576 fs.go:135] Filesystem UUIDs: map[10ac7490-e33f-430c-9ab7-8e9d862c1e25:/dev/nvme0n1p3 24e84c59-9fd8-4bc9-b01c-e3f72392e7a8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 10 11:58:10.231990 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.231898 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 11:58:10.238276 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.238143 2576 manager.go:216] Machine: {Timestamp:2026-06-10 11:58:10.236950572 +0000 UTC m=+0.315686304 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095036 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2547f3ba6c565f3e12a5b5ce8d7a02 SystemUUID:ec2547f3-ba6c-565f-3e12-a5b5ce8d7a02 BootID:e6c8b727-bc11-45b9-8b3a-7a1679f1c000 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:e8:56:c3:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:e8:56:c3:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:6f:ec:43:6d:46 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 11:58:10.238276 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.238266 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 11:58:10.238422 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.238362 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 11:58:10.240299 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.240281 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 11:58:10.241024 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.240997 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 11:58:10.241207 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.241031 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-88.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 11:58:10.241785 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.241772 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 11:58:10.241841 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.241792 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 11:58:10.241841 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.241809 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 11:58:10.241841 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.241834 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 11:58:10.242570 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.242557 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 11:58:10.245155 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.245139 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 10 11:58:10.245304 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.245293 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 11:58:10.245373 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.245343 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 10 11:58:10.245373 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.245361 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 11:58:10.245463 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.245376 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 11:58:10.245463 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.245400 2576 kubelet.go:398] "Adding apiserver pod source" Jun 10 11:58:10.245463 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.245415 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 11:58:10.245989 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.245965 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 11:58:10.246105 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.246027 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 11:58:10.249445 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.249414 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 11:58:10.250799 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.250786 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 11:58:10.250855 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.250817 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 11:58:10.251901 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251889 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 11:58:10.251940 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251908 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 11:58:10.251940 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251915 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 11:58:10.251940 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251920 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 11:58:10.251940 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251931 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 11:58:10.251940 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251938 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 11:58:10.252108 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251950 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 11:58:10.252108 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251959 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 11:58:10.252108 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251969 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 11:58:10.252108 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251975 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 11:58:10.252108 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251983 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 11:58:10.252108 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.251988 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 11:58:10.252697 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.252686 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 11:58:10.252734 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.252699 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 11:58:10.255974 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.255959 2576 server.go:1268] "Started kubelet" Jun 10 11:58:10.256295 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.256268 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 11:58:10.256837 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.256786 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 11:58:10.256922 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.256862 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 11:58:10.256940 ip-10-0-128-88 systemd[1]: Started Kubernetes Kubelet. Jun 10 11:58:10.258333 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.258288 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-88.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 11:58:10.258430 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.258398 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-88.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 11:58:10.258430 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.258415 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 10 11:58:10.258430 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.258386 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 11:58:10.258584 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.258440 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 11:58:10.262904 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.262883 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 11:58:10.263024 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.262907 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 11:58:10.263024 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.263003 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-88.ec2.internal\" not found" Jun 10 11:58:10.263508 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.263490 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 11:58:10.263625 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.263580 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 11:58:10.263625 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.263628 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 11:58:10.263778 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.263768 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 10 11:58:10.263778 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.263776 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 10 11:58:10.263885 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.263871 2576 factory.go:55] Registering systemd factory Jun 10 11:58:10.263927 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.263889 2576 factory.go:223] Registration of the systemd container factory successfully Jun 10 11:58:10.264169 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.264153 2576 factory.go:153] Registering CRI-O factory Jun 10 11:58:10.264169 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.264171 2576 factory.go:223] Registration of the crio container factory successfully Jun 10 11:58:10.264311 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.264230 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 11:58:10.264311 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.264256 2576 factory.go:103] Registering Raw factory Jun 10 11:58:10.264311 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.264275 2576 manager.go:1196] Started watching for new ooms in manager Jun 10 11:58:10.264815 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.264793 2576 manager.go:349] Starting recovery of all containers Jun 10 11:58:10.265130 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.265105 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 11:58:10.267411 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.267383 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 11:58:10.267484 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.267463 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-88.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 11:58:10.268558 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.267569 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-88.ec2.internal.18b7b65d7ac003df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-88.ec2.internal,UID:ip-10-0-128-88.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-88.ec2.internal,},FirstTimestamp:2026-06-10 11:58:10.255938527 +0000 UTC m=+0.334674257,LastTimestamp:2026-06-10 11:58:10.255938527 +0000 UTC m=+0.334674257,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-88.ec2.internal,}" Jun 10 11:58:10.277294 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.277272 2576 manager.go:354] Recovery completed Jun 10 11:58:10.278528 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.278511 2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 10 11:58:10.281611 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.281597 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:10.284803 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.284775 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:10.284874 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.284820 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:10.284874 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.284831 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:10.285416 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.285392 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 11:58:10.285416 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.285413 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 11:58:10.285511 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.285429 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 10 11:58:10.285511 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.285400 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:10.286287 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.286273 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:10.286344 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.286299 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:10.286344 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.286321 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:10.286600 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.286587 2576 policy_none.go:49] "None policy: Start" Jun 10 11:58:10.286652 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.286604 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 11:58:10.286652 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.286614 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 11:58:10.287556 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.287538 2576 policy_none.go:47] "Start" Jun 10 11:58:10.288272 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.287372 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-88.ec2.internal.18b7b65d7c787ca9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-88.ec2.internal,UID:ip-10-0-128-88.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-88.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-88.ec2.internal,},FirstTimestamp:2026-06-10 11:58:10.284805289 +0000 UTC m=+0.363541022,LastTimestamp:2026-06-10 11:58:10.284805289 +0000 UTC m=+0.363541022,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-88.ec2.internal,}" Jun 10 11:58:10.297823 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.297756 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-88.ec2.internal.18b7b65d7c78ccf8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-88.ec2.internal,UID:ip-10-0-128-88.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-88.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-88.ec2.internal,},FirstTimestamp:2026-06-10 11:58:10.284825848 +0000 UTC m=+0.363561579,LastTimestamp:2026-06-10 11:58:10.284825848 +0000 UTC m=+0.363561579,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-88.ec2.internal,}" Jun 10 11:58:10.300105 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.300086 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q9vd7" Jun 10 11:58:10.308217 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.308197 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q9vd7" Jun 10 11:58:10.308621 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.308556 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-88.ec2.internal.18b7b65d7c78f2ab default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-88.ec2.internal,UID:ip-10-0-128-88.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-88.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-88.ec2.internal,},FirstTimestamp:2026-06-10 11:58:10.284835499 +0000 UTC m=+0.363571228,LastTimestamp:2026-06-10 11:58:10.284835499 +0000 UTC m=+0.363571228,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-88.ec2.internal,}" Jun 10 11:58:10.325441 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.325423 2576 manager.go:337] "Starting Device Plugin manager" Jun 10 11:58:10.325562 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.325505 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 11:58:10.325562 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.325518 2576 server.go:87] "Starting device plugin registration server" Jun 10 11:58:10.325854 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.325839 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 11:58:10.343282 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.325859 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 11:58:10.343282 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.326058 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 11:58:10.343282 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.326141 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 11:58:10.343282 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.326149 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 11:58:10.343282 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.326700 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 11:58:10.343282 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.326755 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-88.ec2.internal\" not found" Jun 10 11:58:10.343282 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.339972 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 11:58:10.343282 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.341221 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 11:58:10.343282 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.341265 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 11:58:10.343282 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.341292 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 11:58:10.343282 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.341333 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 11:58:10.343699 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.343449 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:58:10.426225 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.426174 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:10.427267 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.427242 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:10.427390 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.427279 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:10.427390 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.427292 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:10.427390 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.427320 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.437325 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.437304 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.437407 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.437330 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-88.ec2.internal\": node \"ip-10-0-128-88.ec2.internal\" not found" Jun 10 11:58:10.442053 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.442029 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-88.ec2.internal"] Jun 10 11:58:10.442191 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.442097 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:10.442918 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.442903 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:10.442981 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.442931 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:10.442981 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.442941 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:10.444118 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.444106 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:10.444262 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.444249 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.444301 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.444277 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:10.444808 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.444783 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:10.444863 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.444824 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:10.444863 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.444795 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:10.444863 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.444840 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:10.444863 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.444852 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:10.444863 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.444863 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:10.445897 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.445869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.446003 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.445904 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:58:10.446600 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.446585 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:58:10.446711 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.446612 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:58:10.446711 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.446625 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:58:10.461190 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.461171 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-88.ec2.internal\" not found" Jun 10 11:58:10.468382 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.468364 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-88.ec2.internal\" not found" node="ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.473239 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.473222 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-88.ec2.internal\" not found" node="ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.562267 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.562229 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-88.ec2.internal\" not found" Jun 10 11:58:10.564479 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.564459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed77ad89a0764fa68c1a6a6b089f75bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal\" (UID: \"ed77ad89a0764fa68c1a6a6b089f75bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.564583 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.564500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed77ad89a0764fa68c1a6a6b089f75bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal\" (UID: \"ed77ad89a0764fa68c1a6a6b089f75bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.564583 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.564538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00c515e36f41ac35aafa9632c3bd77c9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-88.ec2.internal\" (UID: \"00c515e36f41ac35aafa9632c3bd77c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.663319 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.663289 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-88.ec2.internal\" not found" Jun 10 11:58:10.665491 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.665475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed77ad89a0764fa68c1a6a6b089f75bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal\" (UID: \"ed77ad89a0764fa68c1a6a6b089f75bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.665554 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.665500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed77ad89a0764fa68c1a6a6b089f75bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal\" (UID: \"ed77ad89a0764fa68c1a6a6b089f75bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.665554 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.665519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00c515e36f41ac35aafa9632c3bd77c9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-88.ec2.internal\" (UID: \"00c515e36f41ac35aafa9632c3bd77c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.665655 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.665578 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00c515e36f41ac35aafa9632c3bd77c9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-88.ec2.internal\" (UID: \"00c515e36f41ac35aafa9632c3bd77c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.665655 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.665589 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed77ad89a0764fa68c1a6a6b089f75bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal\" (UID: \"ed77ad89a0764fa68c1a6a6b089f75bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.665655 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.665592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed77ad89a0764fa68c1a6a6b089f75bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal\" (UID: \"ed77ad89a0764fa68c1a6a6b089f75bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.764015 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.763940 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-88.ec2.internal\" not found" Jun 10 11:58:10.772282 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.772261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.777908 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:10.777889 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-88.ec2.internal" Jun 10 11:58:10.864700 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.864662 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-88.ec2.internal\" not found" Jun 10 11:58:10.965114 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:10.965087 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-88.ec2.internal\" not found" Jun 10 11:58:11.065665 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.065565 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-88.ec2.internal\" not found" Jun 10 11:58:11.166101 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.166068 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-88.ec2.internal\" not found" Jun 10 11:58:11.170910 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.170882 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:58:11.207139 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.207107 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 11:58:11.207883 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.207375 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 11:58:11.207883 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.207381 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 11:58:11.246438 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.246415 2576 apiserver.go:52] "Watching apiserver" Jun 10 11:58:11.254066 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:11.254023 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded77ad89a0764fa68c1a6a6b089f75bb.slice/crio-bf8c770337c30d56d25d436f2e78768844e5077c7e9f68f4ed1bfc9b4e6ce40c WatchSource:0}: Error finding container bf8c770337c30d56d25d436f2e78768844e5077c7e9f68f4ed1bfc9b4e6ce40c: Status 404 returned error can't find the container with id bf8c770337c30d56d25d436f2e78768844e5077c7e9f68f4ed1bfc9b4e6ce40c Jun 10 11:58:11.254272 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:11.254246 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c515e36f41ac35aafa9632c3bd77c9.slice/crio-47b8e6b56ef6d3ab333f24ac4cf63ce0de5151830d91ab0082cbc973742bf948 WatchSource:0}: Error finding container 47b8e6b56ef6d3ab333f24ac4cf63ce0de5151830d91ab0082cbc973742bf948: Status 404 returned error can't find the container with id 47b8e6b56ef6d3ab333f24ac4cf63ce0de5151830d91ab0082cbc973742bf948 Jun 10 11:58:11.262245 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.260841 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:58:11.263102 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.263080 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" Jun 10 11:58:11.263196 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.263143 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 11:58:11.270462 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.270436 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 11:58:11.270890 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.270867 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-dwd67","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84","openshift-cluster-node-tuning-operator/tuned-bklk9","openshift-image-registry/node-ca-22d66","openshift-network-diagnostics/network-check-target-h2prl","openshift-network-operator/iptables-alerter-btqm5","openshift-dns/node-resolver-fpjjk","openshift-multus/multus-additional-cni-plugins-l6jvl","openshift-multus/multus-h9c5l","openshift-multus/network-metrics-daemon-g8jrt","openshift-ovn-kubernetes/ovnkube-node-4hddh","kube-system/global-pull-secret-syncer-hmlxw"] Jun 10 11:58:11.273081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.273065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:11.274114 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.274095 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.275171 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.275151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.276337 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.276314 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 11:58:11.276337 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.276352 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 11:58:11.276337 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.276424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 11:58:11.276337 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.276315 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-22d66" Jun 10 11:58:11.276337 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.276449 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6jc8s\"" Jun 10 11:58:11.276337 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.276484 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 11:58:11.276337 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.276360 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dnx7v\"" Jun 10 11:58:11.277043 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.276685 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 11:58:11.277345 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.277327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:11.277451 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.277391 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:11.277519 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.277478 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 11:58:11.277519 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.277503 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:58:11.277616 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.277558 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fkcsk\"" Jun 10 11:58:11.278501 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.278487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btqm5" Jun 10 11:58:11.279473 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.279427 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 11:58:11.279473 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.279437 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7nt8v\"" Jun 10 11:58:11.279473 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.279453 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 11:58:11.279678 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.279478 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 11:58:11.279678 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.279505 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 11:58:11.279797 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.279784 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fpjjk" Jun 10 11:58:11.281023 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.281003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.281290 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.281268 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 11:58:11.281375 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.281344 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8lw6g\"" Jun 10 11:58:11.281440 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.281401 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 11:58:11.281987 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.281930 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:58:11.282099 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.282080 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 11:58:11.282154 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.282134 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bvxrv\"" Jun 10 11:58:11.282192 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.282158 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-88.ec2.internal" Jun 10 11:58:11.282381 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.282362 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.282454 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.282440 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 11:58:11.282533 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.282365 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 11:58:11.283427 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.283394 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 11:58:11.283570 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.283553 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 11:58:11.283616 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.283593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:11.283684 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.283665 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:11.284981 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.284959 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qzxqp\"" Jun 10 11:58:11.286840 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.285202 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 11:58:11.286840 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.285262 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 11:58:11.286840 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.285429 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 11:58:11.286840 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.285501 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 11:58:11.286840 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.285570 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f4htq\"" Jun 10 11:58:11.287626 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.287606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.288928 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.288912 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal"] Jun 10 11:58:11.289002 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.288973 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:11.289041 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.289015 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:11.290383 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.290360 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 11:58:11.290479 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.290423 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 11:58:11.290580 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.290562 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 11:58:11.290700 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.290599 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 11:58:11.290700 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.290610 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 11:58:11.290700 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.290630 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 11:58:11.290700 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.290564 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2w8rw\"" Jun 10 11:58:11.293060 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.293042 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-88.ec2.internal"] Jun 10 11:58:11.293679 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.293665 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 11:58:11.310556 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.310502 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 11:53:10 +0000 UTC" deadline="2028-01-14 07:05:51.319807538 +0000 UTC" Jun 10 11:58:11.310556 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.310552 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13987h7m40.009258144s" Jun 10 11:58:11.319113 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.319084 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdmt8" Jun 10 11:58:11.329757 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.329737 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdmt8" Jun 10 11:58:11.344579 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.344529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-88.ec2.internal" event={"ID":"00c515e36f41ac35aafa9632c3bd77c9","Type":"ContainerStarted","Data":"47b8e6b56ef6d3ab333f24ac4cf63ce0de5151830d91ab0082cbc973742bf948"} Jun 10 11:58:11.345598 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.345567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" event={"ID":"ed77ad89a0764fa68c1a6a6b089f75bb","Type":"ContainerStarted","Data":"bf8c770337c30d56d25d436f2e78768844e5077c7e9f68f4ed1bfc9b4e6ce40c"} Jun 10 11:58:11.364583 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.364538 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 11:58:11.368835 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.368812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-systemd-units\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.368994 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.368847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8c85949-6968-41c0-aefa-54552dab6ea0-host-slash\") pod \"iptables-alerter-btqm5\" (UID: \"b8c85949-6968-41c0-aefa-54552dab6ea0\") " pod="openshift-network-operator/iptables-alerter-btqm5" Jun 10 11:58:11.368994 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.368865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmdst\" (UniqueName: \"kubernetes.io/projected/b8c85949-6968-41c0-aefa-54552dab6ea0-kube-api-access-jmdst\") pod \"iptables-alerter-btqm5\" (UID: \"b8c85949-6968-41c0-aefa-54552dab6ea0\") " pod="openshift-network-operator/iptables-alerter-btqm5" Jun 10 11:58:11.368994 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.368892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-var-lib-cni-multus\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.368994 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.368929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-conf-dir\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.368994 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.368954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-system-cni-dir\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.368994 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.368974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.368994 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.368997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-cni-dir\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.369251 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369011 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-hostroot\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.369251 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-run-netns\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.369251 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-run-systemd\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.369251 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba8affe0-c639-4e72-98bd-32d072ae03fd-ovnkube-script-lib\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.369251 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-systemd\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.369251 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-tmp\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.369251 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-cnibin\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.369251 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-daemon-config\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.369251 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba8affe0-c639-4e72-98bd-32d072ae03fd-ovnkube-config\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.369251 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-var-lib-openvswitch\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-etc-openvswitch\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-run-openvswitch\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-sysconfig\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-sys-fs\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t867\" (UniqueName: \"kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867\") pod \"network-check-target-h2prl\" (UID: \"44c10170-771f-4baa-aa46-d2af83bd0c2d\") " pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3b64f01-ced8-439f-b2ce-5f9a8db234e9-hosts-file\") pod \"node-resolver-fpjjk\" (UID: \"a3b64f01-ced8-439f-b2ce-5f9a8db234e9\") " pod="openshift-dns/node-resolver-fpjjk" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-cnibin\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc6x8\" (UniqueName: \"kubernetes.io/projected/34610be6-a5b5-4a45-bbb5-4dde72fa7593-kube-api-access-fc6x8\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-var-lib-kubelet\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-tuned\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369521 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w82hm\" (UniqueName: \"kubernetes.io/projected/dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b-kube-api-access-w82hm\") pod \"node-ca-22d66\" (UID: \"dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b\") " pod="openshift-image-registry/node-ca-22d66" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-kubelet\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-run-ovn\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.369612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369599 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-log-socket\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba8affe0-c639-4e72-98bd-32d072ae03fd-env-overrides\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-modprobe-d\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3b64f01-ced8-439f-b2ce-5f9a8db234e9-tmp-dir\") pod \"node-resolver-fpjjk\" (UID: \"a3b64f01-ced8-439f-b2ce-5f9a8db234e9\") " pod="openshift-dns/node-resolver-fpjjk" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-system-cni-dir\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-run-k8s-cni-cncf-io\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-os-release\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a92bb44-258e-4638-8bb4-95ecf913bc43-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxgj\" (UniqueName: \"kubernetes.io/projected/0424946c-0d5f-470d-8a05-5552ee0fae82-kube-api-access-2cxgj\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-run-multus-certs\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-node-log\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba8affe0-c639-4e72-98bd-32d072ae03fd-ovn-node-metrics-cert\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369902 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a92bb44-258e-4638-8bb4-95ecf913bc43-cni-binary-copy\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d9ba8ee4-86e3-4522-918f-a8da5b8c474e-konnectivity-ca\") pod \"konnectivity-agent-dwd67\" (UID: \"d9ba8ee4-86e3-4522-918f-a8da5b8c474e\") " pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-socket-dir-parent\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-var-lib-kubelet\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.370061 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.369991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-host\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-socket-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpss2\" (UniqueName: \"kubernetes.io/projected/ba8affe0-c639-4e72-98bd-32d072ae03fd-kube-api-access-mpss2\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-sysctl-conf\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-etc-selinux\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34610be6-a5b5-4a45-bbb5-4dde72fa7593-cni-binary-copy\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-run-netns\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-slash\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnphq\" (UniqueName: \"kubernetes.io/projected/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-kube-api-access-pnphq\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370218 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnzgc\" (UniqueName: \"kubernetes.io/projected/c2534a91-4654-49b5-b113-cf4ce28eaac1-kube-api-access-vnzgc\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-cni-netd\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-dbus\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-run\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-registration-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.370552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-var-lib-cni-bin\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-cni-bin\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a92bb44-258e-4638-8bb4-95ecf913bc43-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94jdq\" (UniqueName: \"kubernetes.io/projected/3a92bb44-258e-4638-8bb4-95ecf913bc43-kube-api-access-94jdq\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-device-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8c85949-6968-41c0-aefa-54552dab6ea0-iptables-alerter-script\") pod \"iptables-alerter-btqm5\" (UID: \"b8c85949-6968-41c0-aefa-54552dab6ea0\") " pod="openshift-network-operator/iptables-alerter-btqm5" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-kubelet-config\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b-host\") pod \"node-ca-22d66\" (UID: \"dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b\") " pod="openshift-image-registry/node-ca-22d66" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b-serviceca\") pod \"node-ca-22d66\" (UID: \"dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b\") " pod="openshift-image-registry/node-ca-22d66" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-os-release\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-sysctl-d\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-lib-modules\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d9ba8ee4-86e3-4522-918f-a8da5b8c474e-agent-certs\") pod \"konnectivity-agent-dwd67\" (UID: \"d9ba8ee4-86e3-4522-918f-a8da5b8c474e\") " pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj54g\" (UniqueName: \"kubernetes.io/projected/a3b64f01-ced8-439f-b2ce-5f9a8db234e9-kube-api-access-cj54g\") pod \"node-resolver-fpjjk\" (UID: \"a3b64f01-ced8-439f-b2ce-5f9a8db234e9\") " pod="openshift-dns/node-resolver-fpjjk" Jun 10 11:58:11.371158 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-etc-kubernetes\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.371606 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-kubernetes\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.371606 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-sys\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.371606 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.370717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:11.442914 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.442882 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:58:11.471764 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3b64f01-ced8-439f-b2ce-5f9a8db234e9-tmp-dir\") pod \"node-resolver-fpjjk\" (UID: \"a3b64f01-ced8-439f-b2ce-5f9a8db234e9\") " pod="openshift-dns/node-resolver-fpjjk" Jun 10 11:58:11.471764 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-system-cni-dir\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.472029 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-run-k8s-cni-cncf-io\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.472029 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-os-release\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.472029 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a92bb44-258e-4638-8bb4-95ecf913bc43-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.472029 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxgj\" (UniqueName: \"kubernetes.io/projected/0424946c-0d5f-470d-8a05-5552ee0fae82-kube-api-access-2cxgj\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.472029 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-run-multus-certs\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.472029 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471876 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-system-cni-dir\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.472029 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-node-log\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.472029 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-os-release\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.472029 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471876 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-run-k8s-cni-cncf-io\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.472029 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba8affe0-c639-4e72-98bd-32d072ae03fd-ovn-node-metrics-cert\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.472029 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.471999 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-run-multus-certs\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a92bb44-258e-4638-8bb4-95ecf913bc43-cni-binary-copy\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d9ba8ee4-86e3-4522-918f-a8da5b8c474e-konnectivity-ca\") pod \"konnectivity-agent-dwd67\" (UID: \"d9ba8ee4-86e3-4522-918f-a8da5b8c474e\") " pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-node-log\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-socket-dir-parent\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3b64f01-ced8-439f-b2ce-5f9a8db234e9-tmp-dir\") pod \"node-resolver-fpjjk\" (UID: \"a3b64f01-ced8-439f-b2ce-5f9a8db234e9\") " pod="openshift-dns/node-resolver-fpjjk" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-socket-dir-parent\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-var-lib-kubelet\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-host\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-socket-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472448 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-var-lib-kubelet\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpss2\" (UniqueName: \"kubernetes.io/projected/ba8affe0-c639-4e72-98bd-32d072ae03fd-kube-api-access-mpss2\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472473 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-sysctl-conf\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-host\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.472526 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.472531 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472556 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a92bb44-258e-4638-8bb4-95ecf913bc43-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472567 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a92bb44-258e-4638-8bb4-95ecf913bc43-cni-binary-copy\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-socket-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.472628 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret podName:3b50d6a5-e5d6-42f2-84bf-bcf1783784cb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:11.972606769 +0000 UTC m=+2.051342509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret") pod "global-pull-secret-syncer-hmlxw" (UID: "3b50d6a5-e5d6-42f2-84bf-bcf1783784cb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-sysctl-conf\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-etc-selinux\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34610be6-a5b5-4a45-bbb5-4dde72fa7593-cni-binary-copy\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472759 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d9ba8ee4-86e3-4522-918f-a8da5b8c474e-konnectivity-ca\") pod \"konnectivity-agent-dwd67\" (UID: \"d9ba8ee4-86e3-4522-918f-a8da5b8c474e\") " pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-run-netns\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-slash\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472845 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-etc-selinux\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472856 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnphq\" (UniqueName: \"kubernetes.io/projected/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-kube-api-access-pnphq\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnzgc\" (UniqueName: \"kubernetes.io/projected/c2534a91-4654-49b5-b113-cf4ce28eaac1-kube-api-access-vnzgc\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472875 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-run-netns\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.473297 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-cni-netd\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472918 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-slash\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-dbus\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-run\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-registration-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.472995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-var-lib-cni-bin\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-cni-bin\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473032 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-dbus\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-cni-netd\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a92bb44-258e-4638-8bb4-95ecf913bc43-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94jdq\" (UniqueName: \"kubernetes.io/projected/3a92bb44-258e-4638-8bb4-95ecf913bc43-kube-api-access-94jdq\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473077 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-cni-bin\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473042 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-run\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473088 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-registration-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-device-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8c85949-6968-41c0-aefa-54552dab6ea0-iptables-alerter-script\") pod \"iptables-alerter-btqm5\" (UID: \"b8c85949-6968-41c0-aefa-54552dab6ea0\") " pod="openshift-network-operator/iptables-alerter-btqm5" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-kubelet-config\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:11.474081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b-host\") pod \"node-ca-22d66\" (UID: \"dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b\") " pod="openshift-image-registry/node-ca-22d66" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-var-lib-cni-bin\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b-serviceca\") pod \"node-ca-22d66\" (UID: \"dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b\") " pod="openshift-image-registry/node-ca-22d66" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473164 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-device-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-os-release\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473267 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34610be6-a5b5-4a45-bbb5-4dde72fa7593-cni-binary-copy\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-kubelet-config\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473285 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b-host\") pod \"node-ca-22d66\" (UID: \"dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b\") " pod="openshift-image-registry/node-ca-22d66" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-os-release\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-sysctl-d\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-lib-modules\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473394 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d9ba8ee4-86e3-4522-918f-a8da5b8c474e-agent-certs\") pod \"konnectivity-agent-dwd67\" (UID: \"d9ba8ee4-86e3-4522-918f-a8da5b8c474e\") " pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj54g\" (UniqueName: \"kubernetes.io/projected/a3b64f01-ced8-439f-b2ce-5f9a8db234e9-kube-api-access-cj54g\") pod \"node-resolver-fpjjk\" (UID: \"a3b64f01-ced8-439f-b2ce-5f9a8db234e9\") " pod="openshift-dns/node-resolver-fpjjk" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473471 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-lib-modules\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.474906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-etc-kubernetes\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473726 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8c85949-6968-41c0-aefa-54552dab6ea0-iptables-alerter-script\") pod \"iptables-alerter-btqm5\" (UID: \"b8c85949-6968-41c0-aefa-54552dab6ea0\") " pod="openshift-network-operator/iptables-alerter-btqm5" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b-serviceca\") pod \"node-ca-22d66\" (UID: \"dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b\") " pod="openshift-image-registry/node-ca-22d66" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473611 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a92bb44-258e-4638-8bb4-95ecf913bc43-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473488 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-sysctl-d\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473740 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-etc-kubernetes\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-kubernetes\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473774 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-kubernetes\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-sys\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-sys\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-systemd-units\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473856 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-systemd-units\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8c85949-6968-41c0-aefa-54552dab6ea0-host-slash\") pod \"iptables-alerter-btqm5\" (UID: \"b8c85949-6968-41c0-aefa-54552dab6ea0\") " pod="openshift-network-operator/iptables-alerter-btqm5" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmdst\" (UniqueName: \"kubernetes.io/projected/b8c85949-6968-41c0-aefa-54552dab6ea0-kube-api-access-jmdst\") pod \"iptables-alerter-btqm5\" (UID: \"b8c85949-6968-41c0-aefa-54552dab6ea0\") " pod="openshift-network-operator/iptables-alerter-btqm5" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.473919 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8c85949-6968-41c0-aefa-54552dab6ea0-host-slash\") pod \"iptables-alerter-btqm5\" (UID: \"b8c85949-6968-41c0-aefa-54552dab6ea0\") " pod="openshift-network-operator/iptables-alerter-btqm5" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-var-lib-cni-multus\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.475777 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-conf-dir\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-system-cni-dir\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.473991 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-host-var-lib-cni-multus\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.474010 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs podName:c2534a91-4654-49b5-b113-cf4ce28eaac1 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:11.973996754 +0000 UTC m=+2.052732471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs") pod "network-metrics-daemon-g8jrt" (UID: "c2534a91-4654-49b5-b113-cf4ce28eaac1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474022 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-conf-dir\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-cni-dir\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-system-cni-dir\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474098 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-cni-dir\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-hostroot\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474127 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-hostroot\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-run-netns\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-run-systemd\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba8affe0-c639-4e72-98bd-32d072ae03fd-ovnkube-script-lib\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474194 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-run-netns\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-systemd\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.476490 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-run-systemd\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-tmp\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-cnibin\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-systemd\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-daemon-config\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a92bb44-258e-4638-8bb4-95ecf913bc43-cnibin\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba8affe0-c639-4e72-98bd-32d072ae03fd-ovnkube-config\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-var-lib-openvswitch\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-etc-openvswitch\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-run-openvswitch\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474554 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-etc-openvswitch\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-var-lib-openvswitch\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-sysconfig\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-run-openvswitch\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-sys-fs\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-sysconfig\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t867\" (UniqueName: \"kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867\") pod \"network-check-target-h2prl\" (UID: \"44c10170-771f-4baa-aa46-d2af83bd0c2d\") " pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:11.477036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3b64f01-ced8-439f-b2ce-5f9a8db234e9-hosts-file\") pod \"node-resolver-fpjjk\" (UID: \"a3b64f01-ced8-439f-b2ce-5f9a8db234e9\") " pod="openshift-dns/node-resolver-fpjjk" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0424946c-0d5f-470d-8a05-5552ee0fae82-sys-fs\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-cnibin\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6x8\" (UniqueName: \"kubernetes.io/projected/34610be6-a5b5-4a45-bbb5-4dde72fa7593-kube-api-access-fc6x8\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-var-lib-kubelet\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-tuned\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w82hm\" (UniqueName: \"kubernetes.io/projected/dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b-kube-api-access-w82hm\") pod \"node-ca-22d66\" (UID: \"dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b\") " pod="openshift-image-registry/node-ca-22d66" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474890 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-kubelet\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-run-ovn\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-log-socket\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba8affe0-c639-4e72-98bd-32d072ae03fd-env-overrides\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.474992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-var-lib-kubelet\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.475009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-modprobe-d\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.475077 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3b64f01-ced8-439f-b2ce-5f9a8db234e9-hosts-file\") pod \"node-resolver-fpjjk\" (UID: \"a3b64f01-ced8-439f-b2ce-5f9a8db234e9\") " pod="openshift-dns/node-resolver-fpjjk" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.475150 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34610be6-a5b5-4a45-bbb5-4dde72fa7593-cnibin\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.475223 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-log-socket\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.475242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-run-ovn\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.475273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba8affe0-c639-4e72-98bd-32d072ae03fd-ovnkube-script-lib\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.477494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.475154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-modprobe-d\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.478007 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.475501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba8affe0-c639-4e72-98bd-32d072ae03fd-host-kubelet\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.478007 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.475717 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba8affe0-c639-4e72-98bd-32d072ae03fd-env-overrides\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.478007 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.475718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba8affe0-c639-4e72-98bd-32d072ae03fd-ovnkube-config\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.478007 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.475796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34610be6-a5b5-4a45-bbb5-4dde72fa7593-multus-daemon-config\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.478007 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.476549 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-tmp\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.478007 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.476631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba8affe0-c639-4e72-98bd-32d072ae03fd-ovn-node-metrics-cert\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.478007 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.476809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d9ba8ee4-86e3-4522-918f-a8da5b8c474e-agent-certs\") pod \"konnectivity-agent-dwd67\" (UID: \"d9ba8ee4-86e3-4522-918f-a8da5b8c474e\") " pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:11.478007 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.476956 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-etc-tuned\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.483486 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.483443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxgj\" (UniqueName: \"kubernetes.io/projected/0424946c-0d5f-470d-8a05-5552ee0fae82-kube-api-access-2cxgj\") pod \"aws-ebs-csi-driver-node-slb84\" (UID: \"0424946c-0d5f-470d-8a05-5552ee0fae82\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.483753 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.483734 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:11.483886 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.483760 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:11.483886 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.483774 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7t867 for pod openshift-network-diagnostics/network-check-target-h2prl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:11.483886 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.483851 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867 podName:44c10170-771f-4baa-aa46-d2af83bd0c2d nodeName:}" failed. No retries permitted until 2026-06-10 11:58:11.983819299 +0000 UTC m=+2.062555029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7t867" (UniqueName: "kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867") pod "network-check-target-h2prl" (UID: "44c10170-771f-4baa-aa46-d2af83bd0c2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:11.486189 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.486161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnzgc\" (UniqueName: \"kubernetes.io/projected/c2534a91-4654-49b5-b113-cf4ce28eaac1-kube-api-access-vnzgc\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:11.486299 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.486174 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc6x8\" (UniqueName: \"kubernetes.io/projected/34610be6-a5b5-4a45-bbb5-4dde72fa7593-kube-api-access-fc6x8\") pod \"multus-h9c5l\" (UID: \"34610be6-a5b5-4a45-bbb5-4dde72fa7593\") " pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.486663 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.486623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94jdq\" (UniqueName: \"kubernetes.io/projected/3a92bb44-258e-4638-8bb4-95ecf913bc43-kube-api-access-94jdq\") pod \"multus-additional-cni-plugins-l6jvl\" (UID: \"3a92bb44-258e-4638-8bb4-95ecf913bc43\") " pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.486972 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.486943 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpss2\" (UniqueName: \"kubernetes.io/projected/ba8affe0-c639-4e72-98bd-32d072ae03fd-kube-api-access-mpss2\") pod \"ovnkube-node-4hddh\" (UID: \"ba8affe0-c639-4e72-98bd-32d072ae03fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.487056 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.487009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj54g\" (UniqueName: \"kubernetes.io/projected/a3b64f01-ced8-439f-b2ce-5f9a8db234e9-kube-api-access-cj54g\") pod \"node-resolver-fpjjk\" (UID: \"a3b64f01-ced8-439f-b2ce-5f9a8db234e9\") " pod="openshift-dns/node-resolver-fpjjk" Jun 10 11:58:11.487106 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.487076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w82hm\" (UniqueName: \"kubernetes.io/projected/dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b-kube-api-access-w82hm\") pod \"node-ca-22d66\" (UID: \"dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b\") " pod="openshift-image-registry/node-ca-22d66" Jun 10 11:58:11.487251 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.487235 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnphq\" (UniqueName: \"kubernetes.io/projected/63d4ff0b-55f6-49de-91b0-5eda8db2dc29-kube-api-access-pnphq\") pod \"tuned-bklk9\" (UID: \"63d4ff0b-55f6-49de-91b0-5eda8db2dc29\") " pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.487350 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.487330 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmdst\" (UniqueName: \"kubernetes.io/projected/b8c85949-6968-41c0-aefa-54552dab6ea0-kube-api-access-jmdst\") pod \"iptables-alerter-btqm5\" (UID: \"b8c85949-6968-41c0-aefa-54552dab6ea0\") " pod="openshift-network-operator/iptables-alerter-btqm5" Jun 10 11:58:11.584708 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.584602 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:11.591258 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.591239 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" Jun 10 11:58:11.593307 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:11.593286 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ba8ee4_86e3_4522_918f_a8da5b8c474e.slice/crio-55fd06edc049e02915fcbdb23657ade587e57ff2845af5d7f96893aa144736d2 WatchSource:0}: Error finding container 55fd06edc049e02915fcbdb23657ade587e57ff2845af5d7f96893aa144736d2: Status 404 returned error can't find the container with id 55fd06edc049e02915fcbdb23657ade587e57ff2845af5d7f96893aa144736d2 Jun 10 11:58:11.598094 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.598069 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bklk9" Jun 10 11:58:11.600163 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.600142 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:58:11.600163 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:11.600160 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0424946c_0d5f_470d_8a05_5552ee0fae82.slice/crio-6ca9230008477454c35721075f9c399d5b0490b04c8f8ef2931174b99e33f376 WatchSource:0}: Error finding container 6ca9230008477454c35721075f9c399d5b0490b04c8f8ef2931174b99e33f376: Status 404 returned error can't find the container with id 6ca9230008477454c35721075f9c399d5b0490b04c8f8ef2931174b99e33f376 Jun 10 11:58:11.602279 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.602261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-22d66" Jun 10 11:58:11.605495 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:11.605474 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d4ff0b_55f6_49de_91b0_5eda8db2dc29.slice/crio-2262af3a48da58e899d3ee73be02ddd195f64b97901d267b23c610ba08d333ac WatchSource:0}: Error finding container 2262af3a48da58e899d3ee73be02ddd195f64b97901d267b23c610ba08d333ac: Status 404 returned error can't find the container with id 2262af3a48da58e899d3ee73be02ddd195f64b97901d267b23c610ba08d333ac Jun 10 11:58:11.608928 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.608907 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btqm5" Jun 10 11:58:11.610363 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:11.610338 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd70b2e4_b0b9_46bd_b9b1_3234e3502b0b.slice/crio-480ac23790c6dd05e9bdbb8994bb7a537f57ccf4726b0adc7aa7c7a9c3e4262d WatchSource:0}: Error finding container 480ac23790c6dd05e9bdbb8994bb7a537f57ccf4726b0adc7aa7c7a9c3e4262d: Status 404 returned error can't find the container with id 480ac23790c6dd05e9bdbb8994bb7a537f57ccf4726b0adc7aa7c7a9c3e4262d Jun 10 11:58:11.613122 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.613107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fpjjk" Jun 10 11:58:11.616193 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:11.616171 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c85949_6968_41c0_aefa_54552dab6ea0.slice/crio-ea5452cad1f6129c278351a45d6906fb03e300cee498e7a2baa083ef98cc7e02 WatchSource:0}: Error finding container ea5452cad1f6129c278351a45d6906fb03e300cee498e7a2baa083ef98cc7e02: Status 404 returned error can't find the container with id ea5452cad1f6129c278351a45d6906fb03e300cee498e7a2baa083ef98cc7e02 Jun 10 11:58:11.618522 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.618499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l6jvl" Jun 10 11:58:11.621254 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:11.621227 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b64f01_ced8_439f_b2ce_5f9a8db234e9.slice/crio-445c9776ddef3d743bfde18e5a1c5cd76775a645cca95e2a39235f7f74ff1c3f WatchSource:0}: Error finding container 445c9776ddef3d743bfde18e5a1c5cd76775a645cca95e2a39235f7f74ff1c3f: Status 404 returned error can't find the container with id 445c9776ddef3d743bfde18e5a1c5cd76775a645cca95e2a39235f7f74ff1c3f Jun 10 11:58:11.624774 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.624755 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h9c5l" Jun 10 11:58:11.626945 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:11.626923 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a92bb44_258e_4638_8bb4_95ecf913bc43.slice/crio-5983d200d05741ab2054157c8a56086bb2f092ef60d11c3abfe8a50c2371da0a WatchSource:0}: Error finding container 5983d200d05741ab2054157c8a56086bb2f092ef60d11c3abfe8a50c2371da0a: Status 404 returned error can't find the container with id 5983d200d05741ab2054157c8a56086bb2f092ef60d11c3abfe8a50c2371da0a Jun 10 11:58:11.628265 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.628206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:11.633204 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:11.633184 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34610be6_a5b5_4a45_bbb5_4dde72fa7593.slice/crio-408b70b46f241134883e83f5e39269ba86b4c29e8b354c6ff46f78537451cf7a WatchSource:0}: Error finding container 408b70b46f241134883e83f5e39269ba86b4c29e8b354c6ff46f78537451cf7a: Status 404 returned error can't find the container with id 408b70b46f241134883e83f5e39269ba86b4c29e8b354c6ff46f78537451cf7a Jun 10 11:58:11.979679 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.978838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:11.979679 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:11.978926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:11.979679 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.979046 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:11.979679 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.979110 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret podName:3b50d6a5-e5d6-42f2-84bf-bcf1783784cb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:12.979092421 +0000 UTC m=+3.057828144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret") pod "global-pull-secret-syncer-hmlxw" (UID: "3b50d6a5-e5d6-42f2-84bf-bcf1783784cb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:11.979679 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.979494 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:11.979679 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:11.979539 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs podName:c2534a91-4654-49b5-b113-cf4ce28eaac1 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:12.979525266 +0000 UTC m=+3.058260982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs") pod "network-metrics-daemon-g8jrt" (UID: "c2534a91-4654-49b5-b113-cf4ce28eaac1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:12.080081 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.080014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t867\" (UniqueName: \"kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867\") pod \"network-check-target-h2prl\" (UID: \"44c10170-771f-4baa-aa46-d2af83bd0c2d\") " pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:12.080255 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:12.080225 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:12.080255 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:12.080245 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:12.080370 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:12.080259 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7t867 for pod openshift-network-diagnostics/network-check-target-h2prl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:12.080370 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:12.080323 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867 podName:44c10170-771f-4baa-aa46-d2af83bd0c2d nodeName:}" failed. No retries permitted until 2026-06-10 11:58:13.080302318 +0000 UTC m=+3.159038040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7t867" (UniqueName: "kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867") pod "network-check-target-h2prl" (UID: "44c10170-771f-4baa-aa46-d2af83bd0c2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:12.331617 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.331504 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:53:11 +0000 UTC" deadline="2028-01-28 07:53:12.291472306 +0000 UTC" Jun 10 11:58:12.331617 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.331568 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14323h54m59.959908107s" Jun 10 11:58:12.371575 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.371538 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h9c5l" event={"ID":"34610be6-a5b5-4a45-bbb5-4dde72fa7593","Type":"ContainerStarted","Data":"408b70b46f241134883e83f5e39269ba86b4c29e8b354c6ff46f78537451cf7a"} Jun 10 11:58:12.390311 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.390194 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6jvl" event={"ID":"3a92bb44-258e-4638-8bb4-95ecf913bc43","Type":"ContainerStarted","Data":"5983d200d05741ab2054157c8a56086bb2f092ef60d11c3abfe8a50c2371da0a"} Jun 10 11:58:12.413552 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.413464 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fpjjk" event={"ID":"a3b64f01-ced8-439f-b2ce-5f9a8db234e9","Type":"ContainerStarted","Data":"445c9776ddef3d743bfde18e5a1c5cd76775a645cca95e2a39235f7f74ff1c3f"} Jun 10 11:58:12.431519 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.431373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btqm5" event={"ID":"b8c85949-6968-41c0-aefa-54552dab6ea0","Type":"ContainerStarted","Data":"ea5452cad1f6129c278351a45d6906fb03e300cee498e7a2baa083ef98cc7e02"} Jun 10 11:58:12.447549 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.447444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-22d66" event={"ID":"dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b","Type":"ContainerStarted","Data":"480ac23790c6dd05e9bdbb8994bb7a537f57ccf4726b0adc7aa7c7a9c3e4262d"} Jun 10 11:58:12.458441 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.458401 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bklk9" event={"ID":"63d4ff0b-55f6-49de-91b0-5eda8db2dc29","Type":"ContainerStarted","Data":"2262af3a48da58e899d3ee73be02ddd195f64b97901d267b23c610ba08d333ac"} Jun 10 11:58:12.471127 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.470919 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:58:12.480687 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.480632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" event={"ID":"0424946c-0d5f-470d-8a05-5552ee0fae82","Type":"ContainerStarted","Data":"6ca9230008477454c35721075f9c399d5b0490b04c8f8ef2931174b99e33f376"} Jun 10 11:58:12.508859 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.508819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dwd67" event={"ID":"d9ba8ee4-86e3-4522-918f-a8da5b8c474e","Type":"ContainerStarted","Data":"55fd06edc049e02915fcbdb23657ade587e57ff2845af5d7f96893aa144736d2"} Jun 10 11:58:12.527183 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.526841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" event={"ID":"ba8affe0-c639-4e72-98bd-32d072ae03fd","Type":"ContainerStarted","Data":"0a9f9ce0b17f3083cf4f585e87b367cac7536cd6dde74efcb212564f7f1f84ce"} Jun 10 11:58:12.987801 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.987746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:12.988003 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:12.987818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:12.988003 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:12.987989 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:12.988118 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:12.988051 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs podName:c2534a91-4654-49b5-b113-cf4ce28eaac1 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:14.988032627 +0000 UTC m=+5.066768350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs") pod "network-metrics-daemon-g8jrt" (UID: "c2534a91-4654-49b5-b113-cf4ce28eaac1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:12.988463 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:12.988440 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:12.988546 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:12.988512 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret podName:3b50d6a5-e5d6-42f2-84bf-bcf1783784cb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:14.988484857 +0000 UTC m=+5.067220577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret") pod "global-pull-secret-syncer-hmlxw" (UID: "3b50d6a5-e5d6-42f2-84bf-bcf1783784cb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:13.089967 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:13.089927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t867\" (UniqueName: \"kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867\") pod \"network-check-target-h2prl\" (UID: \"44c10170-771f-4baa-aa46-d2af83bd0c2d\") " pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:13.090144 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:13.090118 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:13.090144 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:13.090138 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:13.090244 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:13.090151 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7t867 for pod openshift-network-diagnostics/network-check-target-h2prl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:13.090244 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:13.090210 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867 podName:44c10170-771f-4baa-aa46-d2af83bd0c2d nodeName:}" failed. No retries permitted until 2026-06-10 11:58:15.090191532 +0000 UTC m=+5.168927272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7t867" (UniqueName: "kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867") pod "network-check-target-h2prl" (UID: "44c10170-771f-4baa-aa46-d2af83bd0c2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:13.332339 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:13.332241 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:53:11 +0000 UTC" deadline="2028-03-02 08:48:51.438638848 +0000 UTC" Jun 10 11:58:13.332339 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:13.332284 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15140h50m38.106359628s" Jun 10 11:58:13.341736 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:13.341705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:13.341908 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:13.341845 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:13.342258 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:13.342238 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:13.342363 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:13.342336 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:13.342426 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:13.342396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:13.342481 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:13.342469 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:14.119050 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:14.119013 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:58:15.008272 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:15.007922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:15.008272 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:15.007996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:15.008272 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:15.008065 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:15.008272 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:15.008138 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:15.008272 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:15.008157 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret podName:3b50d6a5-e5d6-42f2-84bf-bcf1783784cb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:19.008134506 +0000 UTC m=+9.086870245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret") pod "global-pull-secret-syncer-hmlxw" (UID: "3b50d6a5-e5d6-42f2-84bf-bcf1783784cb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:15.008272 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:15.008196 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs podName:c2534a91-4654-49b5-b113-cf4ce28eaac1 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:19.008180158 +0000 UTC m=+9.086915877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs") pod "network-metrics-daemon-g8jrt" (UID: "c2534a91-4654-49b5-b113-cf4ce28eaac1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:15.108431 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:15.108391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t867\" (UniqueName: \"kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867\") pod \"network-check-target-h2prl\" (UID: \"44c10170-771f-4baa-aa46-d2af83bd0c2d\") " pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:15.108619 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:15.108552 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:15.108619 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:15.108573 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:15.108619 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:15.108590 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7t867 for pod openshift-network-diagnostics/network-check-target-h2prl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:15.108846 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:15.108672 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867 podName:44c10170-771f-4baa-aa46-d2af83bd0c2d nodeName:}" failed. No retries permitted until 2026-06-10 11:58:19.108650726 +0000 UTC m=+9.187386474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7t867" (UniqueName: "kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867") pod "network-check-target-h2prl" (UID: "44c10170-771f-4baa-aa46-d2af83bd0c2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:15.342464 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:15.342385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:15.342464 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:15.342419 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:15.342733 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:15.342547 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:15.342733 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:15.342596 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:15.342733 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:15.342663 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:15.342900 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:15.342740 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:17.342291 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:17.342260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:17.342789 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:17.342296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:17.342789 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:17.342296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:17.342789 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:17.342394 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:17.342789 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:17.342539 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:17.342789 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:17.342621 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:19.043018 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:19.042982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:19.043536 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:19.043045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:19.043536 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:19.043167 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:19.043536 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:19.043197 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:19.043536 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:19.043254 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret podName:3b50d6a5-e5d6-42f2-84bf-bcf1783784cb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:27.043232894 +0000 UTC m=+17.121968619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret") pod "global-pull-secret-syncer-hmlxw" (UID: "3b50d6a5-e5d6-42f2-84bf-bcf1783784cb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:19.043536 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:19.043277 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs podName:c2534a91-4654-49b5-b113-cf4ce28eaac1 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:27.043265796 +0000 UTC m=+17.122001514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs") pod "network-metrics-daemon-g8jrt" (UID: "c2534a91-4654-49b5-b113-cf4ce28eaac1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:19.143835 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:19.143788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t867\" (UniqueName: \"kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867\") pod \"network-check-target-h2prl\" (UID: \"44c10170-771f-4baa-aa46-d2af83bd0c2d\") " pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:19.144037 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:19.143967 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:19.144037 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:19.143994 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:19.144037 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:19.144008 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7t867 for pod openshift-network-diagnostics/network-check-target-h2prl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:19.144266 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:19.144079 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867 podName:44c10170-771f-4baa-aa46-d2af83bd0c2d nodeName:}" failed. No retries permitted until 2026-06-10 11:58:27.144057229 +0000 UTC m=+17.222792947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7t867" (UniqueName: "kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867") pod "network-check-target-h2prl" (UID: "44c10170-771f-4baa-aa46-d2af83bd0c2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:19.342568 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:19.342483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:19.342568 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:19.342510 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:19.342568 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:19.342490 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:19.342868 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:19.342652 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:19.342868 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:19.342748 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:19.342868 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:19.342840 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:21.341968 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:21.341927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:21.341968 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:21.341955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:21.342477 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:21.341927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:21.342477 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:21.342079 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:21.342477 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:21.342154 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:21.342477 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:21.342245 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:23.342063 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:23.342022 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:23.342063 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:23.342048 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:23.342545 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:23.342135 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:23.342545 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:23.342191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:23.342545 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:23.342312 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:23.342545 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:23.342414 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:25.341654 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:25.341599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:25.342108 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:25.341612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:25.342108 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:25.341757 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:25.342108 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:25.341613 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:25.342108 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:25.341861 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:25.342108 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:25.341915 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:27.107098 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:27.107065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:27.107550 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:27.107128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:27.107550 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:27.107221 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:27.107550 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:27.107246 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:27.107550 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:27.107297 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs podName:c2534a91-4654-49b5-b113-cf4ce28eaac1 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:43.107281387 +0000 UTC m=+33.186017104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs") pod "network-metrics-daemon-g8jrt" (UID: "c2534a91-4654-49b5-b113-cf4ce28eaac1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:27.107550 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:27.107310 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret podName:3b50d6a5-e5d6-42f2-84bf-bcf1783784cb nodeName:}" failed. No retries permitted until 2026-06-10 11:58:43.107304788 +0000 UTC m=+33.186040504 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret") pod "global-pull-secret-syncer-hmlxw" (UID: "3b50d6a5-e5d6-42f2-84bf-bcf1783784cb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:27.208178 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:27.208145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t867\" (UniqueName: \"kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867\") pod \"network-check-target-h2prl\" (UID: \"44c10170-771f-4baa-aa46-d2af83bd0c2d\") " pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:27.208368 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:27.208274 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:27.208368 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:27.208296 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:27.208368 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:27.208310 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7t867 for pod openshift-network-diagnostics/network-check-target-h2prl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:27.208368 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:27.208360 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867 podName:44c10170-771f-4baa-aa46-d2af83bd0c2d nodeName:}" failed. No retries permitted until 2026-06-10 11:58:43.208347026 +0000 UTC m=+33.287082747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7t867" (UniqueName: "kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867") pod "network-check-target-h2prl" (UID: "44c10170-771f-4baa-aa46-d2af83bd0c2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:27.342097 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:27.342059 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:27.342097 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:27.342093 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:27.342347 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:27.342093 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:27.342347 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:27.342198 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:27.342347 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:27.342297 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:27.342455 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:27.342378 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:29.342381 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:29.342351 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:29.342888 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:29.342352 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:29.342888 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:29.342471 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:29.342888 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:29.342352 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:29.342888 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:29.342546 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:29.342888 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:29.342580 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:31.342143 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:31.342104 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:31.342497 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:31.342151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:31.342497 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:31.342151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:31.342497 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:31.342209 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:31.342497 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:31.342314 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:31.342497 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:31.342393 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:32.574502 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.574211 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed77ad89a0764fa68c1a6a6b089f75bb" containerID="6aebbb584325b7cba7988147830841f3b221814a85aeb341ffdcbdf9ea56bebb" exitCode=0 Jun 10 11:58:32.575333 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.574292 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" event={"ID":"ed77ad89a0764fa68c1a6a6b089f75bb","Type":"ContainerDied","Data":"6aebbb584325b7cba7988147830841f3b221814a85aeb341ffdcbdf9ea56bebb"} Jun 10 11:58:32.576133 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.576109 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-88.ec2.internal" event={"ID":"00c515e36f41ac35aafa9632c3bd77c9","Type":"ContainerStarted","Data":"3c072b5cd74983150b6ca51e55db1fcc11d8c5fbd0f77c1d8c04161abfc64289"} Jun 10 11:58:32.579069 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.579047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" event={"ID":"ba8affe0-c639-4e72-98bd-32d072ae03fd","Type":"ContainerStarted","Data":"45efb0def84ac05bd1ba1b030da0a41394e6c63cc6cbbbf3ca8200531b27d487"} Jun 10 11:58:32.579167 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.579105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" event={"ID":"ba8affe0-c639-4e72-98bd-32d072ae03fd","Type":"ContainerStarted","Data":"374982cddf152b1105497c2c7e84a5cbd25712b2b41786ce92bceb7ba1b09f94"} Jun 10 11:58:32.579167 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.579151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" event={"ID":"ba8affe0-c639-4e72-98bd-32d072ae03fd","Type":"ContainerStarted","Data":"ae5fad96b50621f1b407980e05389e7656eba27109131251574400ae2bda6010"} Jun 10 11:58:32.579260 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.579184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" event={"ID":"ba8affe0-c639-4e72-98bd-32d072ae03fd","Type":"ContainerStarted","Data":"bbcb0d5a94cfb4597c7f56c8a624ba6fd39cb3735a89abd1d76dc5dcdd622673"} Jun 10 11:58:32.579260 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.579221 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" event={"ID":"ba8affe0-c639-4e72-98bd-32d072ae03fd","Type":"ContainerStarted","Data":"15dedb1fc238443950b81055c41119b46c1b2617eae08080b354c0b8a841c3ca"} Jun 10 11:58:32.579260 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.579249 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" event={"ID":"ba8affe0-c639-4e72-98bd-32d072ae03fd","Type":"ContainerStarted","Data":"942397c14af87a2f37f2a45c93269bc1057ed174185042f2ff223c0265f6ffa8"} Jun 10 11:58:32.580489 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.580466 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h9c5l" event={"ID":"34610be6-a5b5-4a45-bbb5-4dde72fa7593","Type":"ContainerStarted","Data":"3c4e6878dfd2efb7856517ba85b3882dbf777d959121bb445f002c081379a60a"} Jun 10 11:58:32.581958 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.581938 2576 generic.go:356] "Generic (PLEG): container finished" podID="3a92bb44-258e-4638-8bb4-95ecf913bc43" containerID="f1326a59b2f252f4df11492c7641bc804c09438e8e9db2b5b75f37dc7b62ec96" exitCode=0 Jun 10 11:58:32.582049 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.581999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6jvl" event={"ID":"3a92bb44-258e-4638-8bb4-95ecf913bc43","Type":"ContainerDied","Data":"f1326a59b2f252f4df11492c7641bc804c09438e8e9db2b5b75f37dc7b62ec96"} Jun 10 11:58:32.583365 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.583342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fpjjk" event={"ID":"a3b64f01-ced8-439f-b2ce-5f9a8db234e9","Type":"ContainerStarted","Data":"71939b881c12ba104f660c1609f4fa178d06e48a99ec1d38ce719606ea360dd1"} Jun 10 11:58:32.584755 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.584736 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-22d66" event={"ID":"dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b","Type":"ContainerStarted","Data":"9d9b9360209af97b929e3dd07de32c15dc28cd76750bcf386374afb095cd5486"} Jun 10 11:58:32.586139 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.586117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bklk9" event={"ID":"63d4ff0b-55f6-49de-91b0-5eda8db2dc29","Type":"ContainerStarted","Data":"8e3634c2c0c03532e1dd4c078f9d1358494fb225af4ead5d2ea2283735efa560"} Jun 10 11:58:32.587445 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.587426 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" event={"ID":"0424946c-0d5f-470d-8a05-5552ee0fae82","Type":"ContainerStarted","Data":"8e47b8a98eb68d3737f6c8a5db9a1d57bed5c1b269d3d50127aa71f6ab3ee155"} Jun 10 11:58:32.588580 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.588563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dwd67" event={"ID":"d9ba8ee4-86e3-4522-918f-a8da5b8c474e","Type":"ContainerStarted","Data":"f0a51302d372463e9036314ab80839ead430b2692a7ffb8a5922aa9525ec8fd7"} Jun 10 11:58:32.609831 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.609783 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-88.ec2.internal" podStartSLOduration=21.609769306 podStartE2EDuration="21.609769306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:32.609523905 +0000 UTC m=+22.688259645" watchObservedRunningTime="2026-06-10 11:58:32.609769306 +0000 UTC m=+22.688505047" Jun 10 11:58:32.627405 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.627356 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dwd67" podStartSLOduration=2.600709845 podStartE2EDuration="22.627339366s" totalImagesPullingTime="20.026629521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:32.627021414 +0000 UTC m=+22.705757152" watchObservedRunningTime="2026-06-10 11:58:32.627339366 +0000 UTC m=+22.706075104" Jun 10 11:58:32.655144 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.655083 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fpjjk" podStartSLOduration=2.656467393 podStartE2EDuration="22.655061296s" totalImagesPullingTime="19.998593903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:32.648924793 +0000 UTC m=+22.727660533" watchObservedRunningTime="2026-06-10 11:58:32.655061296 +0000 UTC m=+22.733797036" Jun 10 11:58:32.668093 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.668024 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:32.668883 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.668861 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:32.704608 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.704561 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h9c5l" podStartSLOduration=2.535401525 podStartE2EDuration="22.704544401s" totalImagesPullingTime="20.169142876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:32.704165261 +0000 UTC m=+22.782900999" watchObservedRunningTime="2026-06-10 11:58:32.704544401 +0000 UTC m=+22.783280139" Jun 10 11:58:32.726012 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.725929 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bklk9" podStartSLOduration=2.680236663 podStartE2EDuration="22.725911652s" totalImagesPullingTime="20.045674989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:32.724697178 +0000 UTC m=+22.803432914" watchObservedRunningTime="2026-06-10 11:58:32.725911652 +0000 UTC m=+22.804647390" Jun 10 11:58:32.773327 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:32.773225 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-22d66" podStartSLOduration=2.763998896 podStartE2EDuration="22.773206618s" totalImagesPullingTime="20.009207722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:32.741712247 +0000 UTC m=+22.820447987" watchObservedRunningTime="2026-06-10 11:58:32.773206618 +0000 UTC m=+22.851942356" Jun 10 11:58:33.341942 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:33.341825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:33.341942 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:33.341861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:33.342188 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:33.341950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:33.342188 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:33.341955 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:33.342188 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:33.342046 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:33.342188 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:33.342114 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:33.593171 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:33.593085 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btqm5" event={"ID":"b8c85949-6968-41c0-aefa-54552dab6ea0","Type":"ContainerStarted","Data":"28264fed186bfd94dbf216097fa4d62fd2be81c01b8474237fd977eab8a51701"} Jun 10 11:58:33.595241 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:33.595185 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" event={"ID":"ed77ad89a0764fa68c1a6a6b089f75bb","Type":"ContainerStarted","Data":"ee7b2fc843a65765bc87743ba732b8fa6e0eb5bba6da567020a02a71c15f3d31"} Jun 10 11:58:33.596342 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:33.596316 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:33.596483 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:33.596462 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dwd67" Jun 10 11:58:33.613441 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:33.613393 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-btqm5" podStartSLOduration=3.609377094 podStartE2EDuration="23.613376037s" totalImagesPullingTime="20.003998943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:33.612769019 +0000 UTC m=+23.691504758" watchObservedRunningTime="2026-06-10 11:58:33.613376037 +0000 UTC m=+23.692111776" Jun 10 11:58:33.648082 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:33.648017 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-88.ec2.internal" podStartSLOduration=22.647994348 podStartE2EDuration="22.647994348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:33.647900723 +0000 UTC m=+23.726636462" watchObservedRunningTime="2026-06-10 11:58:33.647994348 +0000 UTC m=+23.726730089" Jun 10 11:58:33.665934 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:33.665895 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 11:58:34.339932 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:34.339773 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T11:58:33.665916791Z","UUID":"62beb763-5b7f-4729-9b01-706bcd5d3b56","Handler":null,"Name":"","Endpoint":""} Jun 10 11:58:34.341336 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:34.341312 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 11:58:34.341336 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:34.341345 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 11:58:34.601181 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:34.601029 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" event={"ID":"0424946c-0d5f-470d-8a05-5552ee0fae82","Type":"ContainerStarted","Data":"086bf78694dfe981bebd66c2bd4a61e2fd38c5ae3e10af34305c79ee596fe0e7"} Jun 10 11:58:35.342166 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:35.341928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:35.342430 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:35.341974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:35.342430 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:35.342218 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:35.342430 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:35.341974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:35.342430 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:35.342335 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:35.342430 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:35.342388 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:35.607872 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:35.607771 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" event={"ID":"ba8affe0-c639-4e72-98bd-32d072ae03fd","Type":"ContainerStarted","Data":"1e98d71c8c81b2506db730fe59977346c427835b2e24f261789b332ede087edc"} Jun 10 11:58:37.341740 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.341543 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:37.342418 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.341603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:37.342418 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:37.341811 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:37.342418 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:37.341895 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:37.342418 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.341606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:37.342418 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:37.342007 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:37.615483 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.615394 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" event={"ID":"ba8affe0-c639-4e72-98bd-32d072ae03fd","Type":"ContainerStarted","Data":"38941a995f3ac661ab27c8cc47931c0b11287e6a40e5f13067b19078ae17e69a"} Jun 10 11:58:37.615745 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.615726 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:37.615818 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.615788 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:37.615876 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.615828 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:37.620456 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.620424 2576 generic.go:356] "Generic (PLEG): container finished" podID="3a92bb44-258e-4638-8bb4-95ecf913bc43" containerID="ce84f70d88599a3e21f7b50657c2ab97509b27729c8ee173646cc07c38d36240" exitCode=0 Jun 10 11:58:37.620608 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.620484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6jvl" event={"ID":"3a92bb44-258e-4638-8bb4-95ecf913bc43","Type":"ContainerDied","Data":"ce84f70d88599a3e21f7b50657c2ab97509b27729c8ee173646cc07c38d36240"} Jun 10 11:58:37.623120 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.623098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" event={"ID":"0424946c-0d5f-470d-8a05-5552ee0fae82","Type":"ContainerStarted","Data":"d31cd47bc0fb06478df2aa99987529b741961fcb8dbacb5bbc0dcec8a922a951"} Jun 10 11:58:37.634110 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.634084 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:37.634612 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.634593 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:58:37.650245 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.650197 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" podStartSLOduration=7.596872438 podStartE2EDuration="27.650183113s" totalImagesPullingTime="20.053310675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:37.649829415 +0000 UTC m=+27.728565154" watchObservedRunningTime="2026-06-10 11:58:37.650183113 +0000 UTC m=+27.728918851" Jun 10 11:58:37.670032 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:37.669988 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slb84" podStartSLOduration=3.590110062 podStartE2EDuration="27.669972187s" totalImagesPullingTime="24.079862125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:37.669913886 +0000 UTC m=+27.748649624" watchObservedRunningTime="2026-06-10 11:58:37.669972187 +0000 UTC m=+27.748707926" Jun 10 11:58:38.987102 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:38.987012 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2prl"] Jun 10 11:58:38.987563 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:38.987201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:38.987563 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:38.987328 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:38.990216 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:38.990178 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hmlxw"] Jun 10 11:58:38.990354 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:38.990299 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:38.990416 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:38.990396 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:38.991003 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:38.990973 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8jrt"] Jun 10 11:58:38.991128 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:38.991097 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:38.991232 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:38.991212 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:39.629122 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:39.629089 2576 generic.go:356] "Generic (PLEG): container finished" podID="3a92bb44-258e-4638-8bb4-95ecf913bc43" containerID="a1c2722398b3be269f182f3734d61eeaca6528afb6d34791b24bb6597ddefdc3" exitCode=0 Jun 10 11:58:39.629291 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:39.629171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6jvl" event={"ID":"3a92bb44-258e-4638-8bb4-95ecf913bc43","Type":"ContainerDied","Data":"a1c2722398b3be269f182f3734d61eeaca6528afb6d34791b24bb6597ddefdc3"} Jun 10 11:58:40.342702 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:40.342670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:40.343163 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:40.342794 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:40.343163 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:40.343142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:40.343280 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:40.343209 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:40.343280 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:40.343250 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:40.343384 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:40.343310 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:41.636560 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:41.636325 2576 generic.go:356] "Generic (PLEG): container finished" podID="3a92bb44-258e-4638-8bb4-95ecf913bc43" containerID="0d1b704e0f41abdf3427ed35cf7078940d760ea4ec879f94bd52d6a60b3553d7" exitCode=0 Jun 10 11:58:41.636560 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:41.636406 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6jvl" event={"ID":"3a92bb44-258e-4638-8bb4-95ecf913bc43","Type":"ContainerDied","Data":"0d1b704e0f41abdf3427ed35cf7078940d760ea4ec879f94bd52d6a60b3553d7"} Jun 10 11:58:42.341922 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:42.341892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:42.342119 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:42.341936 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:42.342119 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:42.341901 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:42.342119 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:42.342022 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:42.342284 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:42.342116 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:42.342284 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:42.342209 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:43.124198 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:43.124123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:43.124594 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:43.124209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:43.124594 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:43.124272 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:43.124594 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:43.124316 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:43.124594 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:43.124341 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs podName:c2534a91-4654-49b5-b113-cf4ce28eaac1 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:15.124322695 +0000 UTC m=+65.203058421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs") pod "network-metrics-daemon-g8jrt" (UID: "c2534a91-4654-49b5-b113-cf4ce28eaac1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:58:43.124594 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:43.124380 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret podName:3b50d6a5-e5d6-42f2-84bf-bcf1783784cb nodeName:}" failed. No retries permitted until 2026-06-10 11:59:15.124369757 +0000 UTC m=+65.203105481 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret") pod "global-pull-secret-syncer-hmlxw" (UID: "3b50d6a5-e5d6-42f2-84bf-bcf1783784cb") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:58:43.224834 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:43.224800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t867\" (UniqueName: \"kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867\") pod \"network-check-target-h2prl\" (UID: \"44c10170-771f-4baa-aa46-d2af83bd0c2d\") " pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:43.224995 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:43.224962 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:58:43.224995 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:43.224979 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:58:43.224995 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:43.224989 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7t867 for pod openshift-network-diagnostics/network-check-target-h2prl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:43.225092 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:43.225044 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867 podName:44c10170-771f-4baa-aa46-d2af83bd0c2d nodeName:}" failed. No retries permitted until 2026-06-10 11:59:15.225028671 +0000 UTC m=+65.303764407 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7t867" (UniqueName: "kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867") pod "network-check-target-h2prl" (UID: "44c10170-771f-4baa-aa46-d2af83bd0c2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:58:44.342467 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.342429 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:44.343050 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.342429 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:44.343050 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.342571 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:44.343050 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:44.342573 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8jrt" podUID="c2534a91-4654-49b5-b113-cf4ce28eaac1" Jun 10 11:58:44.343050 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:44.342716 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hmlxw" podUID="3b50d6a5-e5d6-42f2-84bf-bcf1783784cb" Jun 10 11:58:44.343050 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:44.342829 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2prl" podUID="44c10170-771f-4baa-aa46-d2af83bd0c2d" Jun 10 11:58:44.797291 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.797255 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-88.ec2.internal" event="NodeReady" Jun 10 11:58:44.797468 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.797422 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 11:58:44.843471 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.843436 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d77bcc54-tncn8"] Jun 10 11:58:44.845867 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.845817 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6"] Jun 10 11:58:44.846037 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.845908 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:44.847534 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.847501 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7zx2q"] Jun 10 11:58:44.847758 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.847627 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:44.848901 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.848393 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 11:58:44.850084 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.850065 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74"] Jun 10 11:58:44.850303 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.850284 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7zx2q" Jun 10 11:58:44.852163 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.852139 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-hbng4"] Jun 10 11:58:44.852342 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.852317 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" Jun 10 11:58:44.853961 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.853940 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd"] Jun 10 11:58:44.854191 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.854110 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:44.854748 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.854729 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 11:58:44.856410 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.856001 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g"] Jun 10 11:58:44.856410 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.856122 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:58:44.857315 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.856803 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 11:58:44.857315 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.857137 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 11:58:44.857652 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.857619 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" Jun 10 11:58:44.858093 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.858073 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 11:58:44.859114 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.859094 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gpn9z\"" Jun 10 11:58:44.859531 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.859514 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 11:58:44.859942 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.859923 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xkth2\"" Jun 10 11:58:44.860281 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.860184 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 11:58:44.860281 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.860233 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:58:44.860516 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.860493 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 11:58:44.860602 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.860500 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 11:58:44.860673 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.860620 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:58:44.860734 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.860683 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 11:58:44.861375 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861045 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 11:58:44.861375 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861106 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 11:58:44.861375 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861221 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 11:58:44.861375 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861271 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 11:58:44.861775 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861425 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 11:58:44.861775 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861434 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:58:44.861775 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861520 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:58:44.861775 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861556 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 11:58:44.861775 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861562 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wr95g\"" Jun 10 11:58:44.862321 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861856 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 11:58:44.862321 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861891 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 11:58:44.862321 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.861990 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 11:58:44.862321 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.862036 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g9jzk\"" Jun 10 11:58:44.862321 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.862077 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9qfjb\"" Jun 10 11:58:44.862321 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.862080 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4s7c2\"" Jun 10 11:58:44.862710 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.862655 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 11:58:44.862912 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.862892 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jvnwg\"" Jun 10 11:58:44.872223 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.871316 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7zx2q"] Jun 10 11:58:44.872391 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.872307 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-lrr5x"] Jun 10 11:58:44.876706 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.876683 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:44.878761 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.878733 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 11:58:44.879617 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.879594 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:58:44.879741 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.879672 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 11:58:44.879968 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.879944 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wp22l"] Jun 10 11:58:44.880115 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.880094 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 11:58:44.880782 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.880759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-glcnk\"" Jun 10 11:58:44.880892 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.880840 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 11:58:44.885862 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.884331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:44.885862 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.884715 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 11:58:44.885862 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.885128 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wpkw4"] Jun 10 11:58:44.886776 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.886759 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 11:58:44.887269 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.887241 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64c7bf7d77-hmnqn"] Jun 10 11:58:44.887504 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.887438 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 11:58:44.887584 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.887510 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wpkw4" Jun 10 11:58:44.888084 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.888067 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d6l2n\"" Jun 10 11:58:44.889331 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.889308 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cm4bl"] Jun 10 11:58:44.889331 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.889531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:44.893132 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.893112 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74"] Jun 10 11:58:44.893230 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.893220 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-hbng4"] Jun 10 11:58:44.893290 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.893227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cm4bl" Jun 10 11:58:44.893290 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.893241 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd"] Jun 10 11:58:44.893290 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.893283 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wpkw4"] Jun 10 11:58:44.893677 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.893659 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 11:58:44.893891 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.893847 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 11:58:44.894051 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.893946 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gldns\"" Jun 10 11:58:44.894051 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.893967 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 11:58:44.894160 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.894132 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 11:58:44.894215 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.894157 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qzv7s\"" Jun 10 11:58:44.894215 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.894167 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 11:58:44.894311 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.894280 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 11:58:44.894477 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.894422 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 11:58:44.894598 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.894568 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 11:58:44.894774 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.894731 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 11:58:44.898849 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.898829 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 11:58:44.898978 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.898891 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w7drr\"" Jun 10 11:58:44.899272 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.899258 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 11:58:44.899467 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.899451 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 11:58:44.909509 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.909491 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wp22l"] Jun 10 11:58:44.910481 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.910457 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cm4bl"] Jun 10 11:58:44.912626 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.912606 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g"] Jun 10 11:58:44.917692 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.917670 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64c7bf7d77-hmnqn"] Jun 10 11:58:44.919239 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.919200 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-lrr5x"] Jun 10 11:58:44.936279 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5667979-e921-450c-b03c-20a7eb49c704-serving-cert\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:44.936397 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-certificates\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:44.936397 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-image-registry-private-configuration\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:44.936397 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dhwr\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-kube-api-access-8dhwr\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:44.936397 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvbh4\" (UniqueName: \"kubernetes.io/projected/a50e29d7-e2eb-432f-9575-80e76bcd434e-kube-api-access-cvbh4\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:58:44.936589 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-bound-sa-token\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:44.936589 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-tmp\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:44.936589 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-trusted-ca-bundle\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:44.936589 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f149e6da-2d3d-4296-9bee-9c0addca9a71-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tnk74\" (UID: \"f149e6da-2d3d-4296-9bee-9c0addca9a71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" Jun 10 11:58:44.936788 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjtg7\" (UniqueName: \"kubernetes.io/projected/68e452c4-b404-4c88-97fe-1926f9483930-kube-api-access-hjtg7\") pod \"volume-data-source-validator-78dd696465-7zx2q\" (UID: \"68e452c4-b404-4c88-97fe-1926f9483930\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7zx2q" Jun 10 11:58:44.936788 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:44.936788 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kkhv\" (UniqueName: \"kubernetes.io/projected/e0c7b2a5-981e-47b0-b8c8-68a3d10847cf-kube-api-access-5kkhv\") pod \"service-ca-operator-6bc5ff68f5-p6n4g\" (UID: \"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" Jun 10 11:58:44.936788 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8946\" (UniqueName: \"kubernetes.io/projected/c5667979-e921-450c-b03c-20a7eb49c704-kube-api-access-v8946\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:44.936788 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c7b2a5-981e-47b0-b8c8-68a3d10847cf-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-p6n4g\" (UID: \"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" Jun 10 11:58:44.936788 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s8f4\" (UniqueName: \"kubernetes.io/projected/f149e6da-2d3d-4296-9bee-9c0addca9a71-kube-api-access-9s8f4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tnk74\" (UID: \"f149e6da-2d3d-4296-9bee-9c0addca9a71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" Jun 10 11:58:44.937053 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:58:44.937053 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/79e94e31-a537-469c-8642-4c2a4e546fec-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:44.937053 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz66v\" (UniqueName: \"kubernetes.io/projected/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-kube-api-access-dz66v\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:44.937053 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-snapshots\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:44.937053 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-service-ca-bundle\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:44.937053 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.936987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5667979-e921-450c-b03c-20a7eb49c704-trusted-ca\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:44.937053 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.937009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f149e6da-2d3d-4296-9bee-9c0addca9a71-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tnk74\" (UID: \"f149e6da-2d3d-4296-9bee-9c0addca9a71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" Jun 10 11:58:44.937053 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.937035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5667979-e921-450c-b03c-20a7eb49c704-config\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:44.937457 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.937075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0c7b2a5-981e-47b0-b8c8-68a3d10847cf-config\") pod \"service-ca-operator-6bc5ff68f5-p6n4g\" (UID: \"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" Jun 10 11:58:44.937457 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.937104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:44.937457 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.937150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7102df8-0c0c-4741-9de4-dc0b7056a613-ca-trust-extracted\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:44.937457 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.937208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr2pf\" (UniqueName: \"kubernetes.io/projected/79e94e31-a537-469c-8642-4c2a4e546fec-kube-api-access-fr2pf\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:44.937457 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.937247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-trusted-ca\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:44.937457 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.937286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-installation-pull-secrets\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:44.937457 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.937327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-serving-cert\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:44.947662 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.947618 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d77bcc54-tncn8"] Jun 10 11:58:44.961294 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:44.961268 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6"] Jun 10 11:58:45.037765 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.037729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8f4\" (UniqueName: \"kubernetes.io/projected/f149e6da-2d3d-4296-9bee-9c0addca9a71-kube-api-access-9s8f4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tnk74\" (UID: \"f149e6da-2d3d-4296-9bee-9c0addca9a71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" Jun 10 11:58:45.037942 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.037778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:58:45.037942 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.037821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/79e94e31-a537-469c-8642-4c2a4e546fec-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:45.037942 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.037845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz66v\" (UniqueName: \"kubernetes.io/projected/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-kube-api-access-dz66v\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.037942 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.037889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5722\" (UniqueName: \"kubernetes.io/projected/7c21563e-02b7-4654-84e0-17338ce9b7a4-kube-api-access-j5722\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.037942 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.037917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-snapshots\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.038191 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.037945 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:58:45.038191 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.038031 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls podName:a50e29d7-e2eb-432f-9575-80e76bcd434e nodeName:}" failed. No retries permitted until 2026-06-10 11:58:45.538016049 +0000 UTC m=+35.616751781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-n62vd" (UID: "a50e29d7-e2eb-432f-9575-80e76bcd434e") : secret "samples-operator-tls" not found Jun 10 11:58:45.038191 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-service-ca-bundle\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.038191 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5667979-e921-450c-b03c-20a7eb49c704-trusted-ca\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:45.038386 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f149e6da-2d3d-4296-9bee-9c0addca9a71-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tnk74\" (UID: \"f149e6da-2d3d-4296-9bee-9c0addca9a71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" Jun 10 11:58:45.038386 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5667979-e921-450c-b03c-20a7eb49c704-config\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:45.038386 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s7m4\" (UniqueName: \"kubernetes.io/projected/d06f0125-340a-44ab-bed4-8d484e9c6362-kube-api-access-9s7m4\") pod \"network-check-source-dbd9cf844-wpkw4\" (UID: \"d06f0125-340a-44ab-bed4-8d484e9c6362\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wpkw4" Jun 10 11:58:45.038386 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0c7b2a5-981e-47b0-b8c8-68a3d10847cf-config\") pod \"service-ca-operator-6bc5ff68f5-p6n4g\" (UID: \"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" Jun 10 11:58:45.038386 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:45.038386 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmcbz\" (UniqueName: \"kubernetes.io/projected/25db935a-cbc3-4cb8-a8c4-d5c31417a345-kube-api-access-cmcbz\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.038663 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7102df8-0c0c-4741-9de4-dc0b7056a613-ca-trust-extracted\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.038663 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr2pf\" (UniqueName: \"kubernetes.io/projected/79e94e31-a537-469c-8642-4c2a4e546fec-kube-api-access-fr2pf\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:45.038663 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25db935a-cbc3-4cb8-a8c4-d5c31417a345-tmp-dir\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.038663 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-stats-auth\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.038663 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-trusted-ca\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.038663 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-installation-pull-secrets\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.038663 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038589 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-snapshots\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.038663 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-serving-cert\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038690 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/79e94e31-a537-469c-8642-4c2a4e546fec-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5667979-e921-450c-b03c-20a7eb49c704-serving-cert\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-default-certificate\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.038757 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-certificates\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25db935a-cbc3-4cb8-a8c4-d5c31417a345-config-volume\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038810 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-service-ca-bundle\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-image-registry-private-configuration\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dhwr\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-kube-api-access-8dhwr\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038925 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7102df8-0c0c-4741-9de4-dc0b7056a613-ca-trust-extracted\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f149e6da-2d3d-4296-9bee-9c0addca9a71-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tnk74\" (UID: \"f149e6da-2d3d-4296-9bee-9c0addca9a71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.038944 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls podName:79e94e31-a537-469c-8642-4c2a4e546fec nodeName:}" failed. No retries permitted until 2026-06-10 11:58:45.538927036 +0000 UTC m=+35.617662765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fnmj6" (UID: "79e94e31-a537-469c-8642-4c2a4e546fec") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.038983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.039027 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/827e1371-fb46-44f1-944d-6bbf824e350a-cert\") pod \"ingress-canary-cm4bl\" (UID: \"827e1371-fb46-44f1-944d-6bbf824e350a\") " pod="openshift-ingress-canary/ingress-canary-cm4bl" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvbh4\" (UniqueName: \"kubernetes.io/projected/a50e29d7-e2eb-432f-9575-80e76bcd434e-kube-api-access-cvbh4\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-bound-sa-token\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-tmp\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-trusted-ca-bundle\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f149e6da-2d3d-4296-9bee-9c0addca9a71-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tnk74\" (UID: \"f149e6da-2d3d-4296-9bee-9c0addca9a71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjtg7\" (UniqueName: \"kubernetes.io/projected/68e452c4-b404-4c88-97fe-1926f9483930-kube-api-access-hjtg7\") pod \"volume-data-source-validator-78dd696465-7zx2q\" (UID: \"68e452c4-b404-4c88-97fe-1926f9483930\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7zx2q" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kkhv\" (UniqueName: \"kubernetes.io/projected/e0c7b2a5-981e-47b0-b8c8-68a3d10847cf-kube-api-access-5kkhv\") pod \"service-ca-operator-6bc5ff68f5-p6n4g\" (UID: \"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8946\" (UniqueName: \"kubernetes.io/projected/c5667979-e921-450c-b03c-20a7eb49c704-kube-api-access-v8946\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrzgr\" (UniqueName: \"kubernetes.io/projected/827e1371-fb46-44f1-944d-6bbf824e350a-kube-api-access-hrzgr\") pod \"ingress-canary-cm4bl\" (UID: \"827e1371-fb46-44f1-944d-6bbf824e350a\") " pod="openshift-ingress-canary/ingress-canary-cm4bl" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c7b2a5-981e-47b0-b8c8-68a3d10847cf-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-p6n4g\" (UID: \"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039516 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-tmp\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.039760 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-trusted-ca\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.040765 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.040469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-trusted-ca-bundle\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.040765 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.040683 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:58:45.040765 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.040705 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d77bcc54-tncn8: secret "image-registry-tls" not found Jun 10 11:58:45.040765 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.039251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0c7b2a5-981e-47b0-b8c8-68a3d10847cf-config\") pod \"service-ca-operator-6bc5ff68f5-p6n4g\" (UID: \"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" Jun 10 11:58:45.041011 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.040857 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls podName:d7102df8-0c0c-4741-9de4-dc0b7056a613 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:45.540840744 +0000 UTC m=+35.619576473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls") pod "image-registry-6d77bcc54-tncn8" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613") : secret "image-registry-tls" not found Jun 10 11:58:45.041383 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.041357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-certificates\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.041467 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.041429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5667979-e921-450c-b03c-20a7eb49c704-config\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:45.041521 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.041499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5667979-e921-450c-b03c-20a7eb49c704-trusted-ca\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:45.043769 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.043724 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f149e6da-2d3d-4296-9bee-9c0addca9a71-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tnk74\" (UID: \"f149e6da-2d3d-4296-9bee-9c0addca9a71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" Jun 10 11:58:45.043891 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.043869 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5667979-e921-450c-b03c-20a7eb49c704-serving-cert\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:45.044037 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.044017 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-image-registry-private-configuration\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.044037 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.044026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-installation-pull-secrets\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.044273 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.044254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c7b2a5-981e-47b0-b8c8-68a3d10847cf-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-p6n4g\" (UID: \"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" Jun 10 11:58:45.044413 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.044370 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-serving-cert\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.050126 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.050036 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s8f4\" (UniqueName: \"kubernetes.io/projected/f149e6da-2d3d-4296-9bee-9c0addca9a71-kube-api-access-9s8f4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tnk74\" (UID: \"f149e6da-2d3d-4296-9bee-9c0addca9a71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" Jun 10 11:58:45.051494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.051476 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dhwr\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-kube-api-access-8dhwr\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.051589 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.051519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr2pf\" (UniqueName: \"kubernetes.io/projected/79e94e31-a537-469c-8642-4c2a4e546fec-kube-api-access-fr2pf\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:45.051629 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.051591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjtg7\" (UniqueName: \"kubernetes.io/projected/68e452c4-b404-4c88-97fe-1926f9483930-kube-api-access-hjtg7\") pod \"volume-data-source-validator-78dd696465-7zx2q\" (UID: \"68e452c4-b404-4c88-97fe-1926f9483930\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7zx2q" Jun 10 11:58:45.051773 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.051738 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz66v\" (UniqueName: \"kubernetes.io/projected/1e3989bc-4357-4c9e-b974-b2ccfe2ab358-kube-api-access-dz66v\") pod \"insights-operator-896549976-hbng4\" (UID: \"1e3989bc-4357-4c9e-b974-b2ccfe2ab358\") " pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.053248 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.053224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8946\" (UniqueName: \"kubernetes.io/projected/c5667979-e921-450c-b03c-20a7eb49c704-kube-api-access-v8946\") pod \"console-operator-668fdbf85c-lrr5x\" (UID: \"c5667979-e921-450c-b03c-20a7eb49c704\") " pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:45.053729 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.053700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-bound-sa-token\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.055269 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.055246 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kkhv\" (UniqueName: \"kubernetes.io/projected/e0c7b2a5-981e-47b0-b8c8-68a3d10847cf-kube-api-access-5kkhv\") pod \"service-ca-operator-6bc5ff68f5-p6n4g\" (UID: \"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" Jun 10 11:58:45.055751 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.055732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvbh4\" (UniqueName: \"kubernetes.io/projected/a50e29d7-e2eb-432f-9575-80e76bcd434e-kube-api-access-cvbh4\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:58:45.081091 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.081056 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwd67_d9ba8ee4-86e3-4522-918f-a8da5b8c474e/konnectivity-agent/0.log" limit=1024 Jun 10 11:58:45.140625 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.140585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrzgr\" (UniqueName: \"kubernetes.io/projected/827e1371-fb46-44f1-944d-6bbf824e350a-kube-api-access-hrzgr\") pod \"ingress-canary-cm4bl\" (UID: \"827e1371-fb46-44f1-944d-6bbf824e350a\") " pod="openshift-ingress-canary/ingress-canary-cm4bl" Jun 10 11:58:45.140625 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.140625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.140864 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.140764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5722\" (UniqueName: \"kubernetes.io/projected/7c21563e-02b7-4654-84e0-17338ce9b7a4-kube-api-access-j5722\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.140864 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.140813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s7m4\" (UniqueName: \"kubernetes.io/projected/d06f0125-340a-44ab-bed4-8d484e9c6362-kube-api-access-9s7m4\") pod \"network-check-source-dbd9cf844-wpkw4\" (UID: \"d06f0125-340a-44ab-bed4-8d484e9c6362\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wpkw4" Jun 10 11:58:45.140977 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.140916 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:58:45.141039 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.140998 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:45.640980616 +0000 UTC m=+35.719716333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : secret "router-metrics-certs-default" not found Jun 10 11:58:45.141105 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.141042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmcbz\" (UniqueName: \"kubernetes.io/projected/25db935a-cbc3-4cb8-a8c4-d5c31417a345-kube-api-access-cmcbz\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.141105 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.141079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25db935a-cbc3-4cb8-a8c4-d5c31417a345-tmp-dir\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.141218 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.141104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-stats-auth\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.141218 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.141144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-default-certificate\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.141218 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.141171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25db935a-cbc3-4cb8-a8c4-d5c31417a345-config-volume\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.141218 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.141193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.141218 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.141212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.141493 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.141229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/827e1371-fb46-44f1-944d-6bbf824e350a-cert\") pod \"ingress-canary-cm4bl\" (UID: \"827e1371-fb46-44f1-944d-6bbf824e350a\") " pod="openshift-ingress-canary/ingress-canary-cm4bl" Jun 10 11:58:45.141493 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.141451 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25db935a-cbc3-4cb8-a8c4-d5c31417a345-tmp-dir\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.141616 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.141543 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:45.641525232 +0000 UTC m=+35.720260974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : configmap references non-existent config key: service-ca.crt Jun 10 11:58:45.141616 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.141560 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:58:45.141764 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.141693 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls podName:25db935a-cbc3-4cb8-a8c4-d5c31417a345 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:45.641675726 +0000 UTC m=+35.720411459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls") pod "dns-default-wp22l" (UID: "25db935a-cbc3-4cb8-a8c4-d5c31417a345") : secret "dns-default-metrics-tls" not found Jun 10 11:58:45.141825 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.141808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25db935a-cbc3-4cb8-a8c4-d5c31417a345-config-volume\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.144011 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.143990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-default-certificate\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.144132 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.144014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/827e1371-fb46-44f1-944d-6bbf824e350a-cert\") pod \"ingress-canary-cm4bl\" (UID: \"827e1371-fb46-44f1-944d-6bbf824e350a\") " pod="openshift-ingress-canary/ingress-canary-cm4bl" Jun 10 11:58:45.144132 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.144020 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-stats-auth\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.153302 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.153273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmcbz\" (UniqueName: \"kubernetes.io/projected/25db935a-cbc3-4cb8-a8c4-d5c31417a345-kube-api-access-cmcbz\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.153435 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.153411 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5722\" (UniqueName: \"kubernetes.io/projected/7c21563e-02b7-4654-84e0-17338ce9b7a4-kube-api-access-j5722\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.153595 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.153570 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s7m4\" (UniqueName: \"kubernetes.io/projected/d06f0125-340a-44ab-bed4-8d484e9c6362-kube-api-access-9s7m4\") pod \"network-check-source-dbd9cf844-wpkw4\" (UID: \"d06f0125-340a-44ab-bed4-8d484e9c6362\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wpkw4" Jun 10 11:58:45.153794 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.153775 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrzgr\" (UniqueName: \"kubernetes.io/projected/827e1371-fb46-44f1-944d-6bbf824e350a-kube-api-access-hrzgr\") pod \"ingress-canary-cm4bl\" (UID: \"827e1371-fb46-44f1-944d-6bbf824e350a\") " pod="openshift-ingress-canary/ingress-canary-cm4bl" Jun 10 11:58:45.184675 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.184625 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7zx2q" Jun 10 11:58:45.197453 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.197428 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" Jun 10 11:58:45.198653 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.198606 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dwd67_d9ba8ee4-86e3-4522-918f-a8da5b8c474e/konnectivity-agent/0.log" limit=1024 Jun 10 11:58:45.205345 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.205321 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-hbng4" Jun 10 11:58:45.226322 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.226288 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" Jun 10 11:58:45.232115 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.232092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:45.247097 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.247068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wpkw4" Jun 10 11:58:45.259935 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.259912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cm4bl" Jun 10 11:58:45.544528 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.544489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:45.545074 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.544567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:58:45.545074 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.544663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:45.545074 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.544688 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:58:45.545074 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.544713 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d77bcc54-tncn8: secret "image-registry-tls" not found Jun 10 11:58:45.545074 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.544724 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:58:45.545074 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.544783 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls podName:d7102df8-0c0c-4741-9de4-dc0b7056a613 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:46.544758455 +0000 UTC m=+36.623494173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls") pod "image-registry-6d77bcc54-tncn8" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613") : secret "image-registry-tls" not found Jun 10 11:58:45.545074 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.544801 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:58:45.545074 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.544804 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls podName:a50e29d7-e2eb-432f-9575-80e76bcd434e nodeName:}" failed. No retries permitted until 2026-06-10 11:58:46.544793098 +0000 UTC m=+36.623528822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-n62vd" (UID: "a50e29d7-e2eb-432f-9575-80e76bcd434e") : secret "samples-operator-tls" not found Jun 10 11:58:45.545074 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.544902 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls podName:79e94e31-a537-469c-8642-4c2a4e546fec nodeName:}" failed. No retries permitted until 2026-06-10 11:58:46.5448624 +0000 UTC m=+36.623598129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fnmj6" (UID: "79e94e31-a537-469c-8642-4c2a4e546fec") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:58:45.645134 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.645099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.645134 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.645139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:45.645382 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:45.645219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:45.645382 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.645297 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:46.645272981 +0000 UTC m=+36.724008697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : configmap references non-existent config key: service-ca.crt Jun 10 11:58:45.645382 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.645327 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:58:45.645382 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.645327 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:58:45.645382 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.645383 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls podName:25db935a-cbc3-4cb8-a8c4-d5c31417a345 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:46.645365952 +0000 UTC m=+36.724101684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls") pod "dns-default-wp22l" (UID: "25db935a-cbc3-4cb8-a8c4-d5c31417a345") : secret "dns-default-metrics-tls" not found Jun 10 11:58:45.645626 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:45.645410 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:46.645401454 +0000 UTC m=+36.724137171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : secret "router-metrics-certs-default" not found Jun 10 11:58:46.195666 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.195415 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-lrr5x"] Jun 10 11:58:46.199921 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.199102 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74"] Jun 10 11:58:46.200596 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.200572 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-hbng4"] Jun 10 11:58:46.205785 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.205442 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cm4bl"] Jun 10 11:58:46.220873 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.220848 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7zx2q"] Jun 10 11:58:46.227571 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.227552 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g"] Jun 10 11:58:46.230302 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.230280 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wpkw4"] Jun 10 11:58:46.233855 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:46.233829 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06f0125_340a_44ab_bed4_8d484e9c6362.slice/crio-fb0873db65bca39464cb6a73af2ce002cdf10af67543f92e7727c9ab4693eb9c WatchSource:0}: Error finding container fb0873db65bca39464cb6a73af2ce002cdf10af67543f92e7727c9ab4693eb9c: Status 404 returned error can't find the container with id fb0873db65bca39464cb6a73af2ce002cdf10af67543f92e7727c9ab4693eb9c Jun 10 11:58:46.235349 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:46.235073 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c7b2a5_981e_47b0_b8c8_68a3d10847cf.slice/crio-f0659480d3013576b7c83b6097fafac7ba3d2dd25afa04c9ec21e41eac12971b WatchSource:0}: Error finding container f0659480d3013576b7c83b6097fafac7ba3d2dd25afa04c9ec21e41eac12971b: Status 404 returned error can't find the container with id f0659480d3013576b7c83b6097fafac7ba3d2dd25afa04c9ec21e41eac12971b Jun 10 11:58:46.236123 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:58:46.236038 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e452c4_b404_4c88_97fe_1926f9483930.slice/crio-e1fdb0a9779d59a846317a4a4fe2e372cbb193db20897e7f275f5748d7c93734 WatchSource:0}: Error finding container e1fdb0a9779d59a846317a4a4fe2e372cbb193db20897e7f275f5748d7c93734: Status 404 returned error can't find the container with id e1fdb0a9779d59a846317a4a4fe2e372cbb193db20897e7f275f5748d7c93734 Jun 10 11:58:46.341958 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.341927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:58:46.342122 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.341936 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:58:46.342122 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.342042 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:58:46.344719 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.344696 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 11:58:46.344719 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.344710 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 11:58:46.344936 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.344773 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zk9qr\"" Jun 10 11:58:46.344936 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.344819 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j6n9s\"" Jun 10 11:58:46.558255 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.558173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:46.558587 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.558250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:58:46.558587 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.558314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:46.558587 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.558338 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:58:46.558587 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.558353 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d77bcc54-tncn8: secret "image-registry-tls" not found Jun 10 11:58:46.558587 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.558389 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:58:46.558587 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.558408 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls podName:d7102df8-0c0c-4741-9de4-dc0b7056a613 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:48.558391978 +0000 UTC m=+38.637127719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls") pod "image-registry-6d77bcc54-tncn8" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613") : secret "image-registry-tls" not found Jun 10 11:58:46.558587 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.558423 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:58:46.558587 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.558433 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls podName:a50e29d7-e2eb-432f-9575-80e76bcd434e nodeName:}" failed. No retries permitted until 2026-06-10 11:58:48.558421457 +0000 UTC m=+38.637157173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-n62vd" (UID: "a50e29d7-e2eb-432f-9575-80e76bcd434e") : secret "samples-operator-tls" not found Jun 10 11:58:46.558587 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.558456 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls podName:79e94e31-a537-469c-8642-4c2a4e546fec nodeName:}" failed. No retries permitted until 2026-06-10 11:58:48.55844743 +0000 UTC m=+38.637183146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fnmj6" (UID: "79e94e31-a537-469c-8642-4c2a4e546fec") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:58:46.654098 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.654049 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" event={"ID":"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf","Type":"ContainerStarted","Data":"f0659480d3013576b7c83b6097fafac7ba3d2dd25afa04c9ec21e41eac12971b"} Jun 10 11:58:46.655341 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.655300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" event={"ID":"f149e6da-2d3d-4296-9bee-9c0addca9a71","Type":"ContainerStarted","Data":"fcbad7da96e0ff1bbccc08469a73bcc2d88b5b3985eb754aaf78cc99e5822535"} Jun 10 11:58:46.656680 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.656658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cm4bl" event={"ID":"827e1371-fb46-44f1-944d-6bbf824e350a","Type":"ContainerStarted","Data":"62a58b5caae6be6b92c7b58c0faa2267adec45a596e5246e3980c886cf7171e6"} Jun 10 11:58:46.658961 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.658931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:46.659068 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.658975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:46.659068 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.659043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:46.659192 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.659074 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:48.659052221 +0000 UTC m=+38.737787951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : configmap references non-existent config key: service-ca.crt Jun 10 11:58:46.659192 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.659106 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:58:46.659192 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.659143 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls podName:25db935a-cbc3-4cb8-a8c4-d5c31417a345 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:48.659131349 +0000 UTC m=+38.737867066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls") pod "dns-default-wp22l" (UID: "25db935a-cbc3-4cb8-a8c4-d5c31417a345") : secret "dns-default-metrics-tls" not found Jun 10 11:58:46.659192 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.659170 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:58:46.659462 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:46.659219 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:48.659204048 +0000 UTC m=+38.737939771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : secret "router-metrics-certs-default" not found Jun 10 11:58:46.660272 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.660192 2576 generic.go:356] "Generic (PLEG): container finished" podID="3a92bb44-258e-4638-8bb4-95ecf913bc43" containerID="b9a223a88f3c794afeced4e3ee90e9637a95b213c3e1998060ca976dcec6dc9e" exitCode=0 Jun 10 11:58:46.660272 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.660245 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6jvl" event={"ID":"3a92bb44-258e-4638-8bb4-95ecf913bc43","Type":"ContainerDied","Data":"b9a223a88f3c794afeced4e3ee90e9637a95b213c3e1998060ca976dcec6dc9e"} Jun 10 11:58:46.661559 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.661531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" event={"ID":"c5667979-e921-450c-b03c-20a7eb49c704","Type":"ContainerStarted","Data":"9202ec1b46bbad5fd46a7587e927b5f8d49fe79e1937e98ba4ddd0a5883fcd04"} Jun 10 11:58:46.662980 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.662955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wpkw4" event={"ID":"d06f0125-340a-44ab-bed4-8d484e9c6362","Type":"ContainerStarted","Data":"fb0873db65bca39464cb6a73af2ce002cdf10af67543f92e7727c9ab4693eb9c"} Jun 10 11:58:46.664529 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.664502 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hbng4" event={"ID":"1e3989bc-4357-4c9e-b974-b2ccfe2ab358","Type":"ContainerStarted","Data":"57208f4b7ce8c3f76452559f32aee277757eb2dd1463f3c75249dc6a0c5caad5"} Jun 10 11:58:46.665802 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:46.665781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7zx2q" event={"ID":"68e452c4-b404-4c88-97fe-1926f9483930","Type":"ContainerStarted","Data":"e1fdb0a9779d59a846317a4a4fe2e372cbb193db20897e7f275f5748d7c93734"} Jun 10 11:58:47.678511 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:47.678473 2576 generic.go:356] "Generic (PLEG): container finished" podID="3a92bb44-258e-4638-8bb4-95ecf913bc43" containerID="b45eb1196a6806c3be86ed7324bb6199d44dd6330c59b40528d408eaa8873f98" exitCode=0 Jun 10 11:58:47.679023 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:47.678553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6jvl" event={"ID":"3a92bb44-258e-4638-8bb4-95ecf913bc43","Type":"ContainerDied","Data":"b45eb1196a6806c3be86ed7324bb6199d44dd6330c59b40528d408eaa8873f98"} Jun 10 11:58:48.581057 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:48.580969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:58:48.581218 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:48.581174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:48.581282 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.581222 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:58:48.581330 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:48.581292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:48.581330 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.581309 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls podName:a50e29d7-e2eb-432f-9575-80e76bcd434e nodeName:}" failed. No retries permitted until 2026-06-10 11:58:52.581289948 +0000 UTC m=+42.660025667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-n62vd" (UID: "a50e29d7-e2eb-432f-9575-80e76bcd434e") : secret "samples-operator-tls" not found Jun 10 11:58:48.581442 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.581330 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:58:48.581442 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.581367 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:58:48.581442 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.581380 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d77bcc54-tncn8: secret "image-registry-tls" not found Jun 10 11:58:48.581442 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.581390 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls podName:79e94e31-a537-469c-8642-4c2a4e546fec nodeName:}" failed. No retries permitted until 2026-06-10 11:58:52.581371615 +0000 UTC m=+42.660107347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fnmj6" (UID: "79e94e31-a537-469c-8642-4c2a4e546fec") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:58:48.581442 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.581419 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls podName:d7102df8-0c0c-4741-9de4-dc0b7056a613 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:52.581406707 +0000 UTC m=+42.660142427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls") pod "image-registry-6d77bcc54-tncn8" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613") : secret "image-registry-tls" not found Jun 10 11:58:48.682138 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:48.682100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:48.682772 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:48.682254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:48.682772 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:48.682316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:48.682772 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.682321 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:58:48.682772 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.682394 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:52.682371388 +0000 UTC m=+42.761107126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : secret "router-metrics-certs-default" not found Jun 10 11:58:48.682772 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.682420 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:52.682401736 +0000 UTC m=+42.761137456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : configmap references non-existent config key: service-ca.crt Jun 10 11:58:48.682772 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.682462 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:58:48.682772 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:48.682504 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls podName:25db935a-cbc3-4cb8-a8c4-d5c31417a345 nodeName:}" failed. No retries permitted until 2026-06-10 11:58:52.682490684 +0000 UTC m=+42.761226410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls") pod "dns-default-wp22l" (UID: "25db935a-cbc3-4cb8-a8c4-d5c31417a345") : secret "dns-default-metrics-tls" not found Jun 10 11:58:48.686715 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:48.686681 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6jvl" event={"ID":"3a92bb44-258e-4638-8bb4-95ecf913bc43","Type":"ContainerStarted","Data":"1e11042c394012878cca4745b5e187a39ea36fb0a10d6a6a819e3d602f756e07"} Jun 10 11:58:48.721129 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:48.721058 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l6jvl" podStartSLOduration=8.141421797 podStartE2EDuration="38.721034666s" totalImagesPullingTime="30.579612869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:48.717445299 +0000 UTC m=+38.796181048" watchObservedRunningTime="2026-06-10 11:58:48.721034666 +0000 UTC m=+38.799770409" Jun 10 11:58:52.621134 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:52.621089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:58:52.621692 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:52.621183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:58:52.621692 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:52.621272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:58:52.621692 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.621278 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:58:52.621692 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.621305 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d77bcc54-tncn8: secret "image-registry-tls" not found Jun 10 11:58:52.621692 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.621340 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:58:52.621692 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.621372 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:58:52.621692 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.621384 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls podName:d7102df8-0c0c-4741-9de4-dc0b7056a613 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:00.621348956 +0000 UTC m=+50.700084677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls") pod "image-registry-6d77bcc54-tncn8" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613") : secret "image-registry-tls" not found Jun 10 11:58:52.621692 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.621406 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls podName:a50e29d7-e2eb-432f-9575-80e76bcd434e nodeName:}" failed. No retries permitted until 2026-06-10 11:59:00.621395521 +0000 UTC m=+50.700131238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-n62vd" (UID: "a50e29d7-e2eb-432f-9575-80e76bcd434e") : secret "samples-operator-tls" not found Jun 10 11:58:52.621692 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.621423 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls podName:79e94e31-a537-469c-8642-4c2a4e546fec nodeName:}" failed. No retries permitted until 2026-06-10 11:59:00.621413367 +0000 UTC m=+50.700149085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fnmj6" (UID: "79e94e31-a537-469c-8642-4c2a4e546fec") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:58:52.722702 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:52.722662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:52.722702 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:52.722708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:58:52.722940 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:52.722784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:58:52.722940 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.722839 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:00.722819725 +0000 UTC m=+50.801555461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : configmap references non-existent config key: service-ca.crt Jun 10 11:58:52.722940 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.722849 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:58:52.722940 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.722889 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:58:52.722940 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.722911 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls podName:25db935a-cbc3-4cb8-a8c4-d5c31417a345 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:00.722893707 +0000 UTC m=+50.801629428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls") pod "dns-default-wp22l" (UID: "25db935a-cbc3-4cb8-a8c4-d5c31417a345") : secret "dns-default-metrics-tls" not found Jun 10 11:58:52.723151 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:52.722944 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:00.722926356 +0000 UTC m=+50.801662073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : secret "router-metrics-certs-default" not found Jun 10 11:58:54.706028 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.705987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" event={"ID":"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf","Type":"ContainerStarted","Data":"462f4ae3c1ef8bf0394f3bb52022c3644b62998fb3937115bfb58acb789309d1"} Jun 10 11:58:54.708020 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.707992 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" event={"ID":"f149e6da-2d3d-4296-9bee-9c0addca9a71","Type":"ContainerStarted","Data":"1b5b143e64858f24afdcd4ff4914230a79c9d520f49e779ec55d01247c5c0cdd"} Jun 10 11:58:54.709798 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.709772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cm4bl" event={"ID":"827e1371-fb46-44f1-944d-6bbf824e350a","Type":"ContainerStarted","Data":"3b942be22092bc59cc50e30b04f54cb2a85afef2eb5b7bab30efb7b369404099"} Jun 10 11:58:54.711603 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.711584 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/0.log" Jun 10 11:58:54.711738 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.711623 2576 generic.go:356] "Generic (PLEG): container finished" podID="c5667979-e921-450c-b03c-20a7eb49c704" containerID="ac8fae151ad779c6f74bbd24e52a1bc66e24d3e670220e58ef0614aa94c5c2b7" exitCode=255 Jun 10 11:58:54.711738 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.711670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" event={"ID":"c5667979-e921-450c-b03c-20a7eb49c704","Type":"ContainerDied","Data":"ac8fae151ad779c6f74bbd24e52a1bc66e24d3e670220e58ef0614aa94c5c2b7"} Jun 10 11:58:54.711928 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.711908 2576 scope.go:117] "RemoveContainer" containerID="ac8fae151ad779c6f74bbd24e52a1bc66e24d3e670220e58ef0614aa94c5c2b7" Jun 10 11:58:54.713509 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.713489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wpkw4" event={"ID":"d06f0125-340a-44ab-bed4-8d484e9c6362","Type":"ContainerStarted","Data":"53358bceae729529960e25d5bf116214fddd43c97f46bb6f24b8c4389f2cb2c7"} Jun 10 11:58:54.715318 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.715297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hbng4" event={"ID":"1e3989bc-4357-4c9e-b974-b2ccfe2ab358","Type":"ContainerStarted","Data":"78c264c2080959a8d5871b4bc24960e1d5e6b803839185ffa24d762e464340e7"} Jun 10 11:58:54.717647 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.717596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7zx2q" event={"ID":"68e452c4-b404-4c88-97fe-1926f9483930","Type":"ContainerStarted","Data":"cb31e704be1e4905c0b777b40e1cd6665483a8dca76b83f933f525b195a95d5e"} Jun 10 11:58:54.732072 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.731991 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" podStartSLOduration=25.19436082 podStartE2EDuration="32.731970116s" totalImagesPullingTime="7.537609296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:54.731086126 +0000 UTC m=+44.809821866" watchObservedRunningTime="2026-06-10 11:58:54.731970116 +0000 UTC m=+44.810705853" Jun 10 11:58:54.759499 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.758951 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wpkw4" podStartSLOduration=25.210017122 podStartE2EDuration="32.75892977s" totalImagesPullingTime="7.548912648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:54.758015255 +0000 UTC m=+44.836750995" watchObservedRunningTime="2026-06-10 11:58:54.75892977 +0000 UTC m=+44.837665509" Jun 10 11:58:54.787316 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.787271 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cm4bl" podStartSLOduration=3.224185673 podStartE2EDuration="10.787257797s" totalImagesPullingTime="7.563072124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:54.787019369 +0000 UTC m=+44.865755108" watchObservedRunningTime="2026-06-10 11:58:54.787257797 +0000 UTC m=+44.865993529" Jun 10 11:58:54.820146 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.816628 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7zx2q" podStartSLOduration=25.421776828 podStartE2EDuration="32.816607969s" totalImagesPullingTime="7.394831141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:54.814295666 +0000 UTC m=+44.893031404" watchObservedRunningTime="2026-06-10 11:58:54.816607969 +0000 UTC m=+44.895343709" Jun 10 11:58:54.869257 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.869193 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" podStartSLOduration=25.305798524 podStartE2EDuration="32.869170974s" totalImagesPullingTime="7.56337245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:54.867997917 +0000 UTC m=+44.946733654" watchObservedRunningTime="2026-06-10 11:58:54.869170974 +0000 UTC m=+44.947906711" Jun 10 11:58:54.925886 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:54.925825 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-hbng4" podStartSLOduration=25.36075981 podStartE2EDuration="32.925803102s" totalImagesPullingTime="7.565043292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:58:54.899866462 +0000 UTC m=+44.978602202" watchObservedRunningTime="2026-06-10 11:58:54.925803102 +0000 UTC m=+45.004538842" Jun 10 11:58:55.232753 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:55.232712 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:55.232958 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:55.232821 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:58:55.722529 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:55.722499 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/1.log" Jun 10 11:58:55.722976 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:55.722922 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/0.log" Jun 10 11:58:55.722976 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:55.722953 2576 generic.go:356] "Generic (PLEG): container finished" podID="c5667979-e921-450c-b03c-20a7eb49c704" containerID="f041223bcc1fdf6327c7e4c92ae2cf74335e66ae34e5415c90326da178cabb13" exitCode=255 Jun 10 11:58:55.723089 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:55.722986 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" event={"ID":"c5667979-e921-450c-b03c-20a7eb49c704","Type":"ContainerDied","Data":"f041223bcc1fdf6327c7e4c92ae2cf74335e66ae34e5415c90326da178cabb13"} Jun 10 11:58:55.723089 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:55.723053 2576 scope.go:117] "RemoveContainer" containerID="ac8fae151ad779c6f74bbd24e52a1bc66e24d3e670220e58ef0614aa94c5c2b7" Jun 10 11:58:55.723335 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:55.723316 2576 scope.go:117] "RemoveContainer" containerID="f041223bcc1fdf6327c7e4c92ae2cf74335e66ae34e5415c90326da178cabb13" Jun 10 11:58:55.723557 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:55.723533 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-lrr5x_openshift-console-operator(c5667979-e921-450c-b03c-20a7eb49c704)\"" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" podUID="c5667979-e921-450c-b03c-20a7eb49c704" Jun 10 11:58:56.728495 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:56.728468 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/1.log" Jun 10 11:58:56.728906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:56.728836 2576 scope.go:117] "RemoveContainer" containerID="f041223bcc1fdf6327c7e4c92ae2cf74335e66ae34e5415c90326da178cabb13" Jun 10 11:58:56.729016 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:58:56.728997 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-lrr5x_openshift-console-operator(c5667979-e921-450c-b03c-20a7eb49c704)\"" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" podUID="c5667979-e921-450c-b03c-20a7eb49c704" Jun 10 11:58:58.925203 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:58.925174 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fpjjk_a3b64f01-ced8-439f-b2ce-5f9a8db234e9/dns-node-resolver/0.log" Jun 10 11:58:59.524200 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:58:59.524174 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-22d66_dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b/node-ca/0.log" Jun 10 11:59:00.324951 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:00.324919 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cm4bl_827e1371-fb46-44f1-944d-6bbf824e350a/serve-healthcheck-canary/0.log" Jun 10 11:59:00.697826 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:00.697797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:59:00.698041 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:00.697853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:59:00.698041 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:00.697906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:59:00.698041 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.697967 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:59:00.698041 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.697987 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d77bcc54-tncn8: secret "image-registry-tls" not found Jun 10 11:59:00.698041 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.698015 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 11:59:00.698041 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.698021 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 11:59:00.698041 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.698041 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls podName:d7102df8-0c0c-4741-9de4-dc0b7056a613 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:16.698025205 +0000 UTC m=+66.776760944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls") pod "image-registry-6d77bcc54-tncn8" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613") : secret "image-registry-tls" not found Jun 10 11:59:00.698304 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.698056 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls podName:79e94e31-a537-469c-8642-4c2a4e546fec nodeName:}" failed. No retries permitted until 2026-06-10 11:59:16.698049335 +0000 UTC m=+66.776785052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-fnmj6" (UID: "79e94e31-a537-469c-8642-4c2a4e546fec") : secret "cluster-monitoring-operator-tls" not found Jun 10 11:59:00.698304 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.698088 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls podName:a50e29d7-e2eb-432f-9575-80e76bcd434e nodeName:}" failed. No retries permitted until 2026-06-10 11:59:16.698071759 +0000 UTC m=+66.776807480 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-n62vd" (UID: "a50e29d7-e2eb-432f-9575-80e76bcd434e") : secret "samples-operator-tls" not found Jun 10 11:59:00.798987 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:00.798944 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:59:00.798987 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:00.798988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:59:00.799258 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:00.799054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:59:00.799258 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.799139 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:16.799120065 +0000 UTC m=+66.877855784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : configmap references non-existent config key: service-ca.crt Jun 10 11:59:00.799258 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.799159 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:59:00.799258 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.799209 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs podName:7c21563e-02b7-4654-84e0-17338ce9b7a4 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:16.799194226 +0000 UTC m=+66.877929945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs") pod "router-default-64c7bf7d77-hmnqn" (UID: "7c21563e-02b7-4654-84e0-17338ce9b7a4") : secret "router-metrics-certs-default" not found Jun 10 11:59:00.799258 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.799159 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:59:00.799258 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:00.799248 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls podName:25db935a-cbc3-4cb8-a8c4-d5c31417a345 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:16.799239518 +0000 UTC m=+66.877975235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls") pod "dns-default-wp22l" (UID: "25db935a-cbc3-4cb8-a8c4-d5c31417a345") : secret "dns-default-metrics-tls" not found Jun 10 11:59:01.127141 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:01.127061 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-tnk74_f149e6da-2d3d-4296-9bee-9c0addca9a71/kube-storage-version-migrator-operator/0.log" Jun 10 11:59:05.233093 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:05.233055 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:59:05.233482 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:05.233118 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:59:05.233482 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:05.233472 2576 scope.go:117] "RemoveContainer" containerID="f041223bcc1fdf6327c7e4c92ae2cf74335e66ae34e5415c90326da178cabb13" Jun 10 11:59:05.757969 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:05.757940 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 11:59:05.758356 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:05.758336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/1.log" Jun 10 11:59:05.758474 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:05.758375 2576 generic.go:356] "Generic (PLEG): container finished" podID="c5667979-e921-450c-b03c-20a7eb49c704" containerID="a762c88f61f7a714bebac321f1718ac45e9d8678164ae4ed27e2b810fe40be25" exitCode=255 Jun 10 11:59:05.758474 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:05.758435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" event={"ID":"c5667979-e921-450c-b03c-20a7eb49c704","Type":"ContainerDied","Data":"a762c88f61f7a714bebac321f1718ac45e9d8678164ae4ed27e2b810fe40be25"} Jun 10 11:59:05.758579 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:05.758494 2576 scope.go:117] "RemoveContainer" containerID="f041223bcc1fdf6327c7e4c92ae2cf74335e66ae34e5415c90326da178cabb13" Jun 10 11:59:05.758822 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:05.758801 2576 scope.go:117] "RemoveContainer" containerID="a762c88f61f7a714bebac321f1718ac45e9d8678164ae4ed27e2b810fe40be25" Jun 10 11:59:05.758992 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:05.758972 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-lrr5x_openshift-console-operator(c5667979-e921-450c-b03c-20a7eb49c704)\"" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" podUID="c5667979-e921-450c-b03c-20a7eb49c704" Jun 10 11:59:06.762679 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:06.762627 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 11:59:09.639652 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:09.639610 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4hddh" Jun 10 11:59:15.132241 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.132184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:59:15.132241 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.132248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:59:15.135190 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.135171 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 11:59:15.135260 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.135174 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 11:59:15.145927 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.145908 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2534a91-4654-49b5-b113-cf4ce28eaac1-metrics-certs\") pod \"network-metrics-daemon-g8jrt\" (UID: \"c2534a91-4654-49b5-b113-cf4ce28eaac1\") " pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:59:15.146007 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.145966 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b50d6a5-e5d6-42f2-84bf-bcf1783784cb-original-pull-secret\") pod \"global-pull-secret-syncer-hmlxw\" (UID: \"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb\") " pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:59:15.151912 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.151893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hmlxw" Jun 10 11:59:15.165014 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.164994 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j6n9s\"" Jun 10 11:59:15.173342 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.173318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8jrt" Jun 10 11:59:15.232549 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.232507 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:59:15.232723 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.232575 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:59:15.232901 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.232877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t867\" (UniqueName: \"kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867\") pod \"network-check-target-h2prl\" (UID: \"44c10170-771f-4baa-aa46-d2af83bd0c2d\") " pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:59:15.233003 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.232955 2576 scope.go:117] "RemoveContainer" containerID="a762c88f61f7a714bebac321f1718ac45e9d8678164ae4ed27e2b810fe40be25" Jun 10 11:59:15.233112 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:15.233094 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-lrr5x_openshift-console-operator(c5667979-e921-450c-b03c-20a7eb49c704)\"" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" podUID="c5667979-e921-450c-b03c-20a7eb49c704" Jun 10 11:59:15.235970 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.235945 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t867\" (UniqueName: \"kubernetes.io/projected/44c10170-771f-4baa-aa46-d2af83bd0c2d-kube-api-access-7t867\") pod \"network-check-target-h2prl\" (UID: \"44c10170-771f-4baa-aa46-d2af83bd0c2d\") " pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:59:15.291605 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.291524 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hmlxw"] Jun 10 11:59:15.295464 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:15.295436 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b50d6a5_e5d6_42f2_84bf_bcf1783784cb.slice/crio-6070a670d8e2bc4aaab58f5595a3e9fc4ce1fc163038389223f4302eedc16abf WatchSource:0}: Error finding container 6070a670d8e2bc4aaab58f5595a3e9fc4ce1fc163038389223f4302eedc16abf: Status 404 returned error can't find the container with id 6070a670d8e2bc4aaab58f5595a3e9fc4ce1fc163038389223f4302eedc16abf Jun 10 11:59:15.313340 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.313315 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8jrt"] Jun 10 11:59:15.316544 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:15.316518 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2534a91_4654_49b5_b113_cf4ce28eaac1.slice/crio-5acc29e47e9f99b7a6a24d3de261ff2bf8824bb86e521c43f8407da8c0de7d24 WatchSource:0}: Error finding container 5acc29e47e9f99b7a6a24d3de261ff2bf8824bb86e521c43f8407da8c0de7d24: Status 404 returned error can't find the container with id 5acc29e47e9f99b7a6a24d3de261ff2bf8824bb86e521c43f8407da8c0de7d24 Jun 10 11:59:15.461412 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.461382 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zk9qr\"" Jun 10 11:59:15.467590 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.467573 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:59:15.592893 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.592862 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2prl"] Jun 10 11:59:15.595851 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:15.595824 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c10170_771f_4baa_aa46_d2af83bd0c2d.slice/crio-089e5bf994ea652758ffa962033629e44963104909036f82c1502acddf26912a WatchSource:0}: Error finding container 089e5bf994ea652758ffa962033629e44963104909036f82c1502acddf26912a: Status 404 returned error can't find the container with id 089e5bf994ea652758ffa962033629e44963104909036f82c1502acddf26912a Jun 10 11:59:15.793908 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.793817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8jrt" event={"ID":"c2534a91-4654-49b5-b113-cf4ce28eaac1","Type":"ContainerStarted","Data":"5acc29e47e9f99b7a6a24d3de261ff2bf8824bb86e521c43f8407da8c0de7d24"} Jun 10 11:59:15.795757 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.795723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2prl" event={"ID":"44c10170-771f-4baa-aa46-d2af83bd0c2d","Type":"ContainerStarted","Data":"bb74ac2ab4b66243dfc638cfe153de4253793b9f91297f967c7b90b230b12df8"} Jun 10 11:59:15.795945 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.795780 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2prl" event={"ID":"44c10170-771f-4baa-aa46-d2af83bd0c2d","Type":"ContainerStarted","Data":"089e5bf994ea652758ffa962033629e44963104909036f82c1502acddf26912a"} Jun 10 11:59:15.796116 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.795946 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:59:15.797362 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.797326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hmlxw" event={"ID":"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb","Type":"ContainerStarted","Data":"6070a670d8e2bc4aaab58f5595a3e9fc4ce1fc163038389223f4302eedc16abf"} Jun 10 11:59:15.814909 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:15.814850 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h2prl" podStartSLOduration=65.814827562 podStartE2EDuration="1m5.814827562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:15.813519038 +0000 UTC m=+65.892254780" watchObservedRunningTime="2026-06-10 11:59:15.814827562 +0000 UTC m=+65.893563308" Jun 10 11:59:16.748722 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.748678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:59:16.749175 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.748761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:59:16.749175 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.748830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:59:16.751621 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.751596 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a50e29d7-e2eb-432f-9575-80e76bcd434e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n62vd\" (UID: \"a50e29d7-e2eb-432f-9575-80e76bcd434e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:59:16.751891 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.751820 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls\") pod \"image-registry-6d77bcc54-tncn8\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:59:16.751891 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.751820 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/79e94e31-a537-469c-8642-4c2a4e546fec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-fnmj6\" (UID: \"79e94e31-a537-469c-8642-4c2a4e546fec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:59:16.803486 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.803446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8jrt" event={"ID":"c2534a91-4654-49b5-b113-cf4ce28eaac1","Type":"ContainerStarted","Data":"f110ae570fc3cb057d141b39388b0176307daf9f6fbe1274302e604b733df1ef"} Jun 10 11:59:16.803706 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.803513 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8jrt" event={"ID":"c2534a91-4654-49b5-b113-cf4ce28eaac1","Type":"ContainerStarted","Data":"98f1aed0da69cf425df99b53cae84af6e07e8618260223e4bcc2ab31d4f33faf"} Jun 10 11:59:16.823801 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.823744 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g8jrt" podStartSLOduration=65.829842874 podStartE2EDuration="1m6.823727712s" totalImagesPullingTime="993.884838ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:16.82250949 +0000 UTC m=+66.901245224" watchObservedRunningTime="2026-06-10 11:59:16.823727712 +0000 UTC m=+66.902463451" Jun 10 11:59:16.849830 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.849798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:59:16.850017 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.849850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:59:16.850017 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.849928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:59:16.850648 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.850615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c21563e-02b7-4654-84e0-17338ce9b7a4-service-ca-bundle\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:59:16.852583 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.852561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25db935a-cbc3-4cb8-a8c4-d5c31417a345-metrics-tls\") pod \"dns-default-wp22l\" (UID: \"25db935a-cbc3-4cb8-a8c4-d5c31417a345\") " pod="openshift-dns/dns-default-wp22l" Jun 10 11:59:16.852836 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.852814 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c21563e-02b7-4654-84e0-17338ce9b7a4-metrics-certs\") pod \"router-default-64c7bf7d77-hmnqn\" (UID: \"7c21563e-02b7-4654-84e0-17338ce9b7a4\") " pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:59:16.964821 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.964789 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gpn9z\"" Jun 10 11:59:16.971979 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.971947 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:59:16.979380 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.979350 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xkth2\"" Jun 10 11:59:16.986803 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:16.986777 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" Jun 10 11:59:17.017241 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.017217 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wr95g\"" Jun 10 11:59:17.024713 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.024682 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" Jun 10 11:59:17.042609 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.042585 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d6l2n\"" Jun 10 11:59:17.050801 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.050740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wp22l" Jun 10 11:59:17.059462 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.059245 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qzv7s\"" Jun 10 11:59:17.065396 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.065284 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:59:17.198654 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.198550 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d77bcc54-tncn8"] Jun 10 11:59:17.211138 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:17.211093 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7102df8_0c0c_4741_9de4_dc0b7056a613.slice/crio-09296820a2a3ccd8750e45dc543e4abd9fc82e5c4c17719534a008a87ac4b5b2 WatchSource:0}: Error finding container 09296820a2a3ccd8750e45dc543e4abd9fc82e5c4c17719534a008a87ac4b5b2: Status 404 returned error can't find the container with id 09296820a2a3ccd8750e45dc543e4abd9fc82e5c4c17719534a008a87ac4b5b2 Jun 10 11:59:17.218241 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.217353 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6"] Jun 10 11:59:17.277407 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.277379 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd"] Jun 10 11:59:17.294898 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.294655 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wp22l"] Jun 10 11:59:17.300821 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:17.300783 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25db935a_cbc3_4cb8_a8c4_d5c31417a345.slice/crio-a4af274ae93f31fbd9dfe642155d0465b51cda04923d7d72411553a81c06bb75 WatchSource:0}: Error finding container a4af274ae93f31fbd9dfe642155d0465b51cda04923d7d72411553a81c06bb75: Status 404 returned error can't find the container with id a4af274ae93f31fbd9dfe642155d0465b51cda04923d7d72411553a81c06bb75 Jun 10 11:59:17.311771 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.311700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64c7bf7d77-hmnqn"] Jun 10 11:59:17.316779 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:17.316748 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c21563e_02b7_4654_84e0_17338ce9b7a4.slice/crio-dc310b14678e6fa7ef3a9d6d1dfd6c2fb90c767c3e4a08df02d7045b6417385e WatchSource:0}: Error finding container dc310b14678e6fa7ef3a9d6d1dfd6c2fb90c767c3e4a08df02d7045b6417385e: Status 404 returned error can't find the container with id dc310b14678e6fa7ef3a9d6d1dfd6c2fb90c767c3e4a08df02d7045b6417385e Jun 10 11:59:17.808958 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.808888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wp22l" event={"ID":"25db935a-cbc3-4cb8-a8c4-d5c31417a345","Type":"ContainerStarted","Data":"a4af274ae93f31fbd9dfe642155d0465b51cda04923d7d72411553a81c06bb75"} Jun 10 11:59:17.810609 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.810565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" event={"ID":"7c21563e-02b7-4654-84e0-17338ce9b7a4","Type":"ContainerStarted","Data":"c29f53061a32577ab325858dff30f8ab82a2f403d89f2ee47e6fa3dfea66fcaa"} Jun 10 11:59:17.810992 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.810617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" event={"ID":"7c21563e-02b7-4654-84e0-17338ce9b7a4","Type":"ContainerStarted","Data":"dc310b14678e6fa7ef3a9d6d1dfd6c2fb90c767c3e4a08df02d7045b6417385e"} Jun 10 11:59:17.812391 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.812363 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" event={"ID":"79e94e31-a537-469c-8642-4c2a4e546fec","Type":"ContainerStarted","Data":"f15f395c2f8ee857e8db716a2e863fe200905de2bec13dc7c97b17972ba97866"} Jun 10 11:59:17.814231 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.814202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" event={"ID":"d7102df8-0c0c-4741-9de4-dc0b7056a613","Type":"ContainerStarted","Data":"2dd105089bbef37b08202565625ff83f6696f3ec169afe02b634c9f1ce15f192"} Jun 10 11:59:17.814333 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.814251 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" event={"ID":"d7102df8-0c0c-4741-9de4-dc0b7056a613","Type":"ContainerStarted","Data":"09296820a2a3ccd8750e45dc543e4abd9fc82e5c4c17719534a008a87ac4b5b2"} Jun 10 11:59:17.814333 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.814278 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:59:17.815609 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.815587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" event={"ID":"a50e29d7-e2eb-432f-9575-80e76bcd434e","Type":"ContainerStarted","Data":"96e4ebaa555c98828fa6208d9836744917969cabff9837189697fc69210914b6"} Jun 10 11:59:17.833500 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.833442 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" podStartSLOduration=55.8334256 podStartE2EDuration="55.8334256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:17.832778409 +0000 UTC m=+67.911514149" watchObservedRunningTime="2026-06-10 11:59:17.8334256 +0000 UTC m=+67.912161340" Jun 10 11:59:17.856593 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:17.856531 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" podStartSLOduration=67.856507945 podStartE2EDuration="1m7.856507945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:17.855547221 +0000 UTC m=+67.934282954" watchObservedRunningTime="2026-06-10 11:59:17.856507945 +0000 UTC m=+67.935243686" Jun 10 11:59:18.066136 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:18.066037 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:59:18.069406 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:18.069183 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:59:18.820594 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:18.820560 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:59:18.821873 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:18.821851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64c7bf7d77-hmnqn" Jun 10 11:59:21.011912 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.011783 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4v4fn"] Jun 10 11:59:21.014883 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.014867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.018690 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.018452 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6mdsn\"" Jun 10 11:59:21.018690 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.018471 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 11:59:21.018690 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.018471 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 11:59:21.041022 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.040932 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4v4fn"] Jun 10 11:59:21.094819 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.094786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-crio-socket\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.094964 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.094861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.094964 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.094896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.094964 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.094931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-data-volume\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.095154 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.094978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wps7l\" (UniqueName: \"kubernetes.io/projected/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-kube-api-access-wps7l\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.195695 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.195608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.195824 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.195704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.195824 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.195744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-data-volume\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.195824 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.195787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wps7l\" (UniqueName: \"kubernetes.io/projected/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-kube-api-access-wps7l\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.196002 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.195843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-crio-socket\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.196002 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.195959 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-crio-socket\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.196725 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.196687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-data-volume\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.196909 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.196872 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.200154 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.199658 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.216009 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.213071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wps7l\" (UniqueName: \"kubernetes.io/projected/679bd396-1ce0-4416-bda2-d9aa6c8a8b0e-kube-api-access-wps7l\") pod \"insights-runtime-extractor-4v4fn\" (UID: \"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e\") " pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.380494 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.380457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4v4fn" Jun 10 11:59:21.533524 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.533438 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4v4fn"] Jun 10 11:59:21.536778 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:21.536747 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679bd396_1ce0_4416_bda2_d9aa6c8a8b0e.slice/crio-5648dd1074e98fa39a3372c21f696be04a5b5ea74797fb70a8f81b1936204959 WatchSource:0}: Error finding container 5648dd1074e98fa39a3372c21f696be04a5b5ea74797fb70a8f81b1936204959: Status 404 returned error can't find the container with id 5648dd1074e98fa39a3372c21f696be04a5b5ea74797fb70a8f81b1936204959 Jun 10 11:59:21.835886 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.835776 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" event={"ID":"a50e29d7-e2eb-432f-9575-80e76bcd434e","Type":"ContainerStarted","Data":"da1220396d0b21ae0b063eb912eb79dea5a2d6853c1dbd9c0b1031fc66d3d91c"} Jun 10 11:59:21.835886 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.835847 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" event={"ID":"a50e29d7-e2eb-432f-9575-80e76bcd434e","Type":"ContainerStarted","Data":"c572e7e76f9f0f69dcf229b47abd261b037cb4db7e8a8679a62a39a070ee0a40"} Jun 10 11:59:21.837347 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.837318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4v4fn" event={"ID":"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e","Type":"ContainerStarted","Data":"c4a109186a9bf5a2f0ef6711629d1ad66001d2ba643701ee92fff9b64db90d09"} Jun 10 11:59:21.837493 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.837379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4v4fn" event={"ID":"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e","Type":"ContainerStarted","Data":"5648dd1074e98fa39a3372c21f696be04a5b5ea74797fb70a8f81b1936204959"} Jun 10 11:59:21.839007 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.838985 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hmlxw" event={"ID":"3b50d6a5-e5d6-42f2-84bf-bcf1783784cb","Type":"ContainerStarted","Data":"88f07d5e18b58eef9df7449d01d1a16aac41dd2e0c2dc167c60525a29bd99403"} Jun 10 11:59:21.840869 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.840845 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wp22l" event={"ID":"25db935a-cbc3-4cb8-a8c4-d5c31417a345","Type":"ContainerStarted","Data":"ea086ea912d2e336a987fd6d7867ad8550909a36c2807141d0ca1d9285a98801"} Jun 10 11:59:21.840992 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.840892 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wp22l" event={"ID":"25db935a-cbc3-4cb8-a8c4-d5c31417a345","Type":"ContainerStarted","Data":"a9b03b1941ac086aa5a1a91754e69a7a9f8052edc1b63aa550b452a0e222cd31"} Jun 10 11:59:21.840992 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.840951 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wp22l" Jun 10 11:59:21.842405 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.842382 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" event={"ID":"79e94e31-a537-469c-8642-4c2a4e546fec","Type":"ContainerStarted","Data":"0a9556326d45418134fd8a777f40e6e4e0cefa61e44bfaf3c09b76ca120efdba"} Jun 10 11:59:21.857765 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.857714 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n62vd" podStartSLOduration=56.208504037 podStartE2EDuration="59.857698114s" totalImagesPullingTime="3.649194077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:21.857060669 +0000 UTC m=+71.935796408" watchObservedRunningTime="2026-06-10 11:59:21.857698114 +0000 UTC m=+71.936433854" Jun 10 11:59:21.880864 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.880800 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-fnmj6" podStartSLOduration=56.103929707 podStartE2EDuration="59.880780604s" totalImagesPullingTime="3.776850897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:21.880399919 +0000 UTC m=+71.959135658" watchObservedRunningTime="2026-06-10 11:59:21.880780604 +0000 UTC m=+71.959516344" Jun 10 11:59:21.902513 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.902454 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wp22l" podStartSLOduration=34.195311409 podStartE2EDuration="37.902434144s" totalImagesPullingTime="3.707122735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:21.901462437 +0000 UTC m=+71.980198175" watchObservedRunningTime="2026-06-10 11:59:21.902434144 +0000 UTC m=+71.981169885" Jun 10 11:59:21.919605 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:21.919552 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hmlxw" podStartSLOduration=66.211032666 podStartE2EDuration="1m11.919533328s" totalImagesPullingTime="5.708500662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:21.918622655 +0000 UTC m=+71.997358417" watchObservedRunningTime="2026-06-10 11:59:21.919533328 +0000 UTC m=+71.998269063" Jun 10 11:59:22.848731 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:22.848675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4v4fn" event={"ID":"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e","Type":"ContainerStarted","Data":"0de551110649ed7d2d08eabf22234d1bcb8f15e4b63c93094bba74963403a2f8"} Jun 10 11:59:24.857820 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:24.857782 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4v4fn" event={"ID":"679bd396-1ce0-4416-bda2-d9aa6c8a8b0e","Type":"ContainerStarted","Data":"fe5b3c1a25010b78bcbb8480a4597eacaa3f643317109d8c834a9e4353dcfe18"} Jun 10 11:59:24.879214 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:24.879156 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4v4fn" podStartSLOduration=2.534999607 podStartE2EDuration="4.879139346s" totalImagesPullingTime="2.344139739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:59:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:24.878171647 +0000 UTC m=+74.956907387" watchObservedRunningTime="2026-06-10 11:59:24.879139346 +0000 UTC m=+74.957875085" Jun 10 11:59:25.843392 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:25.843353 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-htn46"] Jun 10 11:59:25.851845 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:25.851819 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:25.856340 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:25.856313 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 11:59:25.856340 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:25.856312 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-s7h99\"" Jun 10 11:59:25.856548 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:25.856313 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 10 11:59:25.856548 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:25.856313 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 10 11:59:25.858236 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:25.858208 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-htn46"] Jun 10 11:59:25.934589 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:25.934549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43b41183-6a54-42f4-9570-3f51d940e222-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:25.934763 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:25.934701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktx9s\" (UniqueName: \"kubernetes.io/projected/43b41183-6a54-42f4-9570-3f51d940e222-kube-api-access-ktx9s\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:25.934845 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:25.934773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43b41183-6a54-42f4-9570-3f51d940e222-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:25.934845 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:25.934838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43b41183-6a54-42f4-9570-3f51d940e222-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:26.035925 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:26.035877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43b41183-6a54-42f4-9570-3f51d940e222-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:26.036105 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:26.035940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43b41183-6a54-42f4-9570-3f51d940e222-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:26.036105 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:26.035992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43b41183-6a54-42f4-9570-3f51d940e222-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:26.036105 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:26.036056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktx9s\" (UniqueName: \"kubernetes.io/projected/43b41183-6a54-42f4-9570-3f51d940e222-kube-api-access-ktx9s\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:26.036105 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:26.036097 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 10 11:59:26.036319 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:26.036163 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b41183-6a54-42f4-9570-3f51d940e222-prometheus-operator-tls podName:43b41183-6a54-42f4-9570-3f51d940e222 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:26.536146314 +0000 UTC m=+76.614882032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/43b41183-6a54-42f4-9570-3f51d940e222-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-htn46" (UID: "43b41183-6a54-42f4-9570-3f51d940e222") : secret "prometheus-operator-tls" not found Jun 10 11:59:26.036670 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:26.036622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43b41183-6a54-42f4-9570-3f51d940e222-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:26.038443 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:26.038419 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43b41183-6a54-42f4-9570-3f51d940e222-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:26.045705 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:26.045675 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktx9s\" (UniqueName: \"kubernetes.io/projected/43b41183-6a54-42f4-9570-3f51d940e222-kube-api-access-ktx9s\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:26.539504 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:26.539461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43b41183-6a54-42f4-9570-3f51d940e222-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:26.542022 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:26.541998 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43b41183-6a54-42f4-9570-3f51d940e222-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-htn46\" (UID: \"43b41183-6a54-42f4-9570-3f51d940e222\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:26.761747 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:26.761708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" Jun 10 11:59:26.919000 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:26.918926 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-htn46"] Jun 10 11:59:26.922819 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:26.922689 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b41183_6a54_42f4_9570_3f51d940e222.slice/crio-e2b32c66fc86b03ac607ee23c5b0e6fed714774d2f5aec7c69aca355e9c97d02 WatchSource:0}: Error finding container e2b32c66fc86b03ac607ee23c5b0e6fed714774d2f5aec7c69aca355e9c97d02: Status 404 returned error can't find the container with id e2b32c66fc86b03ac607ee23c5b0e6fed714774d2f5aec7c69aca355e9c97d02 Jun 10 11:59:27.872851 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:27.872813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" event={"ID":"43b41183-6a54-42f4-9570-3f51d940e222","Type":"ContainerStarted","Data":"e2b32c66fc86b03ac607ee23c5b0e6fed714774d2f5aec7c69aca355e9c97d02"} Jun 10 11:59:28.346499 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:28.346474 2576 scope.go:117] "RemoveContainer" containerID="a762c88f61f7a714bebac321f1718ac45e9d8678164ae4ed27e2b810fe40be25" Jun 10 11:59:28.879961 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:28.879853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" event={"ID":"43b41183-6a54-42f4-9570-3f51d940e222","Type":"ContainerStarted","Data":"1a8a4ce0a46574238ba1e00793dd9c32b85fae6a518c7b176ddb54ea800d29d3"} Jun 10 11:59:28.879961 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:28.879942 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" event={"ID":"43b41183-6a54-42f4-9570-3f51d940e222","Type":"ContainerStarted","Data":"5098cc3b8419612901089fce7f119eac13c6f988d8724cfdaba3127f90ee9468"} Jun 10 11:59:28.882608 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:28.882580 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 11:59:28.882804 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:28.882702 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" event={"ID":"c5667979-e921-450c-b03c-20a7eb49c704","Type":"ContainerStarted","Data":"672d019d92414b50692ba39714485436415b6a7fd9e70d3218193b40905511de"} Jun 10 11:59:28.883557 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:28.883534 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:59:28.901149 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:28.901085 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-htn46" podStartSLOduration=2.238836218 podStartE2EDuration="3.901062121s" totalImagesPullingTime="1.662225903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:28.899549952 +0000 UTC m=+78.978285695" watchObservedRunningTime="2026-06-10 11:59:28.901062121 +0000 UTC m=+78.979797861" Jun 10 11:59:28.925725 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:28.925674 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" podStartSLOduration=59.358697654 podStartE2EDuration="1m6.92565615s" totalImagesPullingTime="7.566958496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:28.925223394 +0000 UTC m=+79.003959133" watchObservedRunningTime="2026-06-10 11:59:28.92565615 +0000 UTC m=+79.004391888" Jun 10 11:59:29.113256 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:29.113214 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-lrr5x" Jun 10 11:59:31.242546 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.242495 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x8hgl"] Jun 10 11:59:31.245108 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.245089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.247672 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.247626 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 11:59:31.247672 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.247665 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2877w\"" Jun 10 11:59:31.247867 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.247677 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 11:59:31.247867 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.247812 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 11:59:31.380057 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.380017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.380057 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.380060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-wtmp\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.380377 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.380092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-tls\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.380377 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.380113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-textfile\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.380377 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.380143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.380377 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.380190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19e0570c-7c69-491c-adf7-6657afb60fe9-metrics-client-ca\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.380377 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.380236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19e0570c-7c69-491c-adf7-6657afb60fe9-root\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.380377 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.380285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk9c6\" (UniqueName: \"kubernetes.io/projected/19e0570c-7c69-491c-adf7-6657afb60fe9-kube-api-access-kk9c6\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.380377 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.380319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19e0570c-7c69-491c-adf7-6657afb60fe9-sys\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.481606 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19e0570c-7c69-491c-adf7-6657afb60fe9-root\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.481606 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk9c6\" (UniqueName: \"kubernetes.io/projected/19e0570c-7c69-491c-adf7-6657afb60fe9-kube-api-access-kk9c6\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.481851 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19e0570c-7c69-491c-adf7-6657afb60fe9-sys\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.481851 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.481851 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-wtmp\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.481851 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19e0570c-7c69-491c-adf7-6657afb60fe9-root\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.481851 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-tls\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.481851 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19e0570c-7c69-491c-adf7-6657afb60fe9-sys\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.481851 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-textfile\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.481851 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.482235 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481868 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-wtmp\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.482235 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.481871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19e0570c-7c69-491c-adf7-6657afb60fe9-metrics-client-ca\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.482235 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:31.481891 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 11:59:31.482235 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:31.481953 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-tls podName:19e0570c-7c69-491c-adf7-6657afb60fe9 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:31.981931896 +0000 UTC m=+82.060667625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-tls") pod "node-exporter-x8hgl" (UID: "19e0570c-7c69-491c-adf7-6657afb60fe9") : secret "node-exporter-tls" not found Jun 10 11:59:31.482235 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.482225 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-textfile\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.482526 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.482505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19e0570c-7c69-491c-adf7-6657afb60fe9-metrics-client-ca\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.482589 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.482531 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.484082 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.484064 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.491753 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.491726 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk9c6\" (UniqueName: \"kubernetes.io/projected/19e0570c-7c69-491c-adf7-6657afb60fe9-kube-api-access-kk9c6\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.851590 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.851561 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wp22l" Jun 10 11:59:31.986445 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.986410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-tls\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:31.988909 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:31.988888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19e0570c-7c69-491c-adf7-6657afb60fe9-node-exporter-tls\") pod \"node-exporter-x8hgl\" (UID: \"19e0570c-7c69-491c-adf7-6657afb60fe9\") " pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:32.154449 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.154415 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x8hgl" Jun 10 11:59:32.167313 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:32.167270 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e0570c_7c69_491c_adf7_6657afb60fe9.slice/crio-0a4ffb48b202782a0508f245d9b3831ea725d141dd82af9fbc77c863c135fb9a WatchSource:0}: Error finding container 0a4ffb48b202782a0508f245d9b3831ea725d141dd82af9fbc77c863c135fb9a: Status 404 returned error can't find the container with id 0a4ffb48b202782a0508f245d9b3831ea725d141dd82af9fbc77c863c135fb9a Jun 10 11:59:32.347307 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.347261 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:59:32.352595 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.352567 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.355300 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.355270 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 11:59:32.355448 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.355274 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 11:59:32.355448 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.355339 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 11:59:32.355448 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.355378 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 11:59:32.355448 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.355406 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 11:59:32.355448 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.355325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 11:59:32.355854 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.355522 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 11:59:32.355854 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.355760 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8lkmh\"" Jun 10 11:59:32.355854 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.355785 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 11:59:32.356100 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.356080 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 11:59:32.364243 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.364221 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:59:32.490915 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.490813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.490915 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.490869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.490915 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.490888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-out\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.490915 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.490910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.491203 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.490957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.491203 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.490983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-volume\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.491203 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.491009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-web-config\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.491203 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.491037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.491203 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.491123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.491203 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.491177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.491459 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.491219 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7lnj\" (UniqueName: \"kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-kube-api-access-p7lnj\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.491459 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.491259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.491459 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.491295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.592509 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.592706 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-out\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.592706 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.592706 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.592706 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592582 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-volume\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.592706 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-web-config\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.592706 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.593011 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.593011 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.593011 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7lnj\" (UniqueName: \"kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-kube-api-access-p7lnj\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.593011 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.593011 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.592972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.593253 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.593011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.593705 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.593363 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.593705 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.593399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.593705 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.593470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.597178 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.597152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-out\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.597871 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.597826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.598003 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.597975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-web-config\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.598118 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.598076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.598336 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.598314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.598414 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.598373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.598485 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.598467 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.598895 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.598873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-volume\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.600895 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.600872 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.604001 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.603976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7lnj\" (UniqueName: \"kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-kube-api-access-p7lnj\") pod \"alertmanager-main-0\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.664083 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.664042 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:59:32.866340 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.866275 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:59:32.904465 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:32.904426 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8hgl" event={"ID":"19e0570c-7c69-491c-adf7-6657afb60fe9","Type":"ContainerStarted","Data":"0a4ffb48b202782a0508f245d9b3831ea725d141dd82af9fbc77c863c135fb9a"} Jun 10 11:59:33.020489 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:33.020414 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd285c8_5d0b_4098_a06e_f9095b32db73.slice/crio-ae5b1092f907f68e672f2682e52e7663350203dd3289d33f0364c8bdd627dace WatchSource:0}: Error finding container ae5b1092f907f68e672f2682e52e7663350203dd3289d33f0364c8bdd627dace: Status 404 returned error can't find the container with id ae5b1092f907f68e672f2682e52e7663350203dd3289d33f0364c8bdd627dace Jun 10 11:59:33.911406 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:33.911366 2576 generic.go:356] "Generic (PLEG): container finished" podID="19e0570c-7c69-491c-adf7-6657afb60fe9" containerID="858aab5cfc5f08fc909300f4d25049f723038617015ea689a2db4669146e254b" exitCode=0 Jun 10 11:59:33.911913 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:33.911465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8hgl" event={"ID":"19e0570c-7c69-491c-adf7-6657afb60fe9","Type":"ContainerDied","Data":"858aab5cfc5f08fc909300f4d25049f723038617015ea689a2db4669146e254b"} Jun 10 11:59:33.913121 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:33.913085 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerStarted","Data":"ae5b1092f907f68e672f2682e52e7663350203dd3289d33f0364c8bdd627dace"} Jun 10 11:59:34.919275 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:34.919233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8hgl" event={"ID":"19e0570c-7c69-491c-adf7-6657afb60fe9","Type":"ContainerStarted","Data":"fee1bc75900cd4fc838f05355ac52c889f91b3a6d47e3075dc68ba93033b49b9"} Jun 10 11:59:34.919786 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:34.919289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8hgl" event={"ID":"19e0570c-7c69-491c-adf7-6657afb60fe9","Type":"ContainerStarted","Data":"6d3f6e893f494bdb9edc2afc0992c4b2f72413f208ed2ed2c17bfefbad8747ca"} Jun 10 11:59:34.920740 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:34.920712 2576 generic.go:356] "Generic (PLEG): container finished" podID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerID="95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346" exitCode=0 Jun 10 11:59:34.920847 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:34.920787 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerDied","Data":"95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346"} Jun 10 11:59:34.946852 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:34.946803 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x8hgl" podStartSLOduration=2.9809659010000003 podStartE2EDuration="3.946788804s" totalImagesPullingTime="897.959759ms" totalInitContainerRuntime="67.863144ms" isStatefulPod=true podCreationTimestamp="2026-06-10 11:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:34.945922218 +0000 UTC m=+85.024657957" watchObservedRunningTime="2026-06-10 11:59:34.946788804 +0000 UTC m=+85.025524542" Jun 10 11:59:35.645419 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.645384 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-657fc6c5f8-5zr9t"] Jun 10 11:59:35.648996 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.648969 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.652665 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.652606 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 11:59:35.652665 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.652606 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 11:59:35.652881 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.652676 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 11:59:35.652881 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.652609 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 11:59:35.652881 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.652609 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kjk79\"" Jun 10 11:59:35.652881 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.652724 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5qo9505l2d6i1\"" Jun 10 11:59:35.659765 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.659733 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-657fc6c5f8-5zr9t"] Jun 10 11:59:35.822811 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.822773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27bb85ad-43aa-467c-a16d-bde84dd2fecd-metrics-server-audit-profiles\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.822969 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.822831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27bb85ad-43aa-467c-a16d-bde84dd2fecd-secret-metrics-server-client-certs\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.822969 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.822918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27bb85ad-43aa-467c-a16d-bde84dd2fecd-secret-metrics-server-tls\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.822969 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.822953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27bb85ad-43aa-467c-a16d-bde84dd2fecd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.823067 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.823021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gnk5\" (UniqueName: \"kubernetes.io/projected/27bb85ad-43aa-467c-a16d-bde84dd2fecd-kube-api-access-7gnk5\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.823067 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.823055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27bb85ad-43aa-467c-a16d-bde84dd2fecd-audit-log\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.823128 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.823107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27bb85ad-43aa-467c-a16d-bde84dd2fecd-client-ca-bundle\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.923803 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.923716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27bb85ad-43aa-467c-a16d-bde84dd2fecd-audit-log\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.923803 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.923775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27bb85ad-43aa-467c-a16d-bde84dd2fecd-client-ca-bundle\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.924327 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.923819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27bb85ad-43aa-467c-a16d-bde84dd2fecd-metrics-server-audit-profiles\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.924327 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.923867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27bb85ad-43aa-467c-a16d-bde84dd2fecd-secret-metrics-server-client-certs\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.924327 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.923896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27bb85ad-43aa-467c-a16d-bde84dd2fecd-secret-metrics-server-tls\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.924327 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.923942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27bb85ad-43aa-467c-a16d-bde84dd2fecd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.924327 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.923984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnk5\" (UniqueName: \"kubernetes.io/projected/27bb85ad-43aa-467c-a16d-bde84dd2fecd-kube-api-access-7gnk5\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.924327 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.924209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27bb85ad-43aa-467c-a16d-bde84dd2fecd-audit-log\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.924927 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.924894 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27bb85ad-43aa-467c-a16d-bde84dd2fecd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.925092 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.925046 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27bb85ad-43aa-467c-a16d-bde84dd2fecd-metrics-server-audit-profiles\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.927036 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.927013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27bb85ad-43aa-467c-a16d-bde84dd2fecd-secret-metrics-server-client-certs\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.927463 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.927440 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27bb85ad-43aa-467c-a16d-bde84dd2fecd-secret-metrics-server-tls\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.927463 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.927464 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27bb85ad-43aa-467c-a16d-bde84dd2fecd-client-ca-bundle\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.937140 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.937112 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gnk5\" (UniqueName: \"kubernetes.io/projected/27bb85ad-43aa-467c-a16d-bde84dd2fecd-kube-api-access-7gnk5\") pod \"metrics-server-657fc6c5f8-5zr9t\" (UID: \"27bb85ad-43aa-467c-a16d-bde84dd2fecd\") " pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:35.962002 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:35.961938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:36.007998 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.007505 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v"] Jun 10 11:59:36.011186 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.011156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" Jun 10 11:59:36.013779 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.013744 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 11:59:36.013906 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.013811 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-q5vpt\"" Jun 10 11:59:36.027724 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.027613 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v"] Jun 10 11:59:36.125034 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.124996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e974c50f-2167-40f6-a270-b9bd1bc67630-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wbr7v\" (UID: \"e974c50f-2167-40f6-a270-b9bd1bc67630\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" Jun 10 11:59:36.125225 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.125179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqcqs\" (UniqueName: \"kubernetes.io/projected/e974c50f-2167-40f6-a270-b9bd1bc67630-kube-api-access-fqcqs\") pod \"monitoring-plugin-76b68cc874-wbr7v\" (UID: \"e974c50f-2167-40f6-a270-b9bd1bc67630\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" Jun 10 11:59:36.225862 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.225833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqcqs\" (UniqueName: \"kubernetes.io/projected/e974c50f-2167-40f6-a270-b9bd1bc67630-kube-api-access-fqcqs\") pod \"monitoring-plugin-76b68cc874-wbr7v\" (UID: \"e974c50f-2167-40f6-a270-b9bd1bc67630\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" Jun 10 11:59:36.225968 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.225867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e974c50f-2167-40f6-a270-b9bd1bc67630-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wbr7v\" (UID: \"e974c50f-2167-40f6-a270-b9bd1bc67630\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" Jun 10 11:59:36.226052 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:36.226017 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 10 11:59:36.226105 ip-10-0-128-88 kubenswrapper[2576]: E0610 11:59:36.226070 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e974c50f-2167-40f6-a270-b9bd1bc67630-monitoring-plugin-cert podName:e974c50f-2167-40f6-a270-b9bd1bc67630 nodeName:}" failed. No retries permitted until 2026-06-10 11:59:36.726052617 +0000 UTC m=+86.804788353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e974c50f-2167-40f6-a270-b9bd1bc67630-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-wbr7v" (UID: "e974c50f-2167-40f6-a270-b9bd1bc67630") : secret "monitoring-plugin-cert" not found Jun 10 11:59:36.236792 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.236760 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqcqs\" (UniqueName: \"kubernetes.io/projected/e974c50f-2167-40f6-a270-b9bd1bc67630-kube-api-access-fqcqs\") pod \"monitoring-plugin-76b68cc874-wbr7v\" (UID: \"e974c50f-2167-40f6-a270-b9bd1bc67630\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" Jun 10 11:59:36.306995 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.306929 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-657fc6c5f8-5zr9t"] Jun 10 11:59:36.316119 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:36.313446 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27bb85ad_43aa_467c_a16d_bde84dd2fecd.slice/crio-6844ead8027001c7d13331c1d84fe7e5870487c023e77018863c17ab0588fadd WatchSource:0}: Error finding container 6844ead8027001c7d13331c1d84fe7e5870487c023e77018863c17ab0588fadd: Status 404 returned error can't find the container with id 6844ead8027001c7d13331c1d84fe7e5870487c023e77018863c17ab0588fadd Jun 10 11:59:36.731542 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.731457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e974c50f-2167-40f6-a270-b9bd1bc67630-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wbr7v\" (UID: \"e974c50f-2167-40f6-a270-b9bd1bc67630\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" Jun 10 11:59:36.733961 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.733933 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e974c50f-2167-40f6-a270-b9bd1bc67630-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wbr7v\" (UID: \"e974c50f-2167-40f6-a270-b9bd1bc67630\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" Jun 10 11:59:36.925735 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.925699 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" Jun 10 11:59:36.939688 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.939495 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerStarted","Data":"b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94"} Jun 10 11:59:36.939688 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.939583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerStarted","Data":"470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914"} Jun 10 11:59:36.939688 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.939630 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerStarted","Data":"d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b"} Jun 10 11:59:36.939688 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.939693 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerStarted","Data":"30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1"} Jun 10 11:59:36.940066 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.939731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerStarted","Data":"2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6"} Jun 10 11:59:36.941626 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.941595 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" event={"ID":"27bb85ad-43aa-467c-a16d-bde84dd2fecd","Type":"ContainerStarted","Data":"6844ead8027001c7d13331c1d84fe7e5870487c023e77018863c17ab0588fadd"} Jun 10 11:59:36.979575 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.979529 2576 patch_prober.go:28] interesting pod/image-registry-6d77bcc54-tncn8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 11:59:36.979773 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:36.979602 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" podUID="d7102df8-0c0c-4741-9de4-dc0b7056a613" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 11:59:37.094452 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:37.094418 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v"] Jun 10 11:59:37.096738 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:37.096704 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode974c50f_2167_40f6_a270_b9bd1bc67630.slice/crio-c6a1e1180ca312dddf22b89434415588817ea697b4bc93841567c666208b750f WatchSource:0}: Error finding container c6a1e1180ca312dddf22b89434415588817ea697b4bc93841567c666208b750f: Status 404 returned error can't find the container with id c6a1e1180ca312dddf22b89434415588817ea697b4bc93841567c666208b750f Jun 10 11:59:37.950819 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:37.950781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerStarted","Data":"b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28"} Jun 10 11:59:37.952796 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:37.952758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" event={"ID":"27bb85ad-43aa-467c-a16d-bde84dd2fecd","Type":"ContainerStarted","Data":"d77e40b49389b36e469e80015724e2fe7e612e08380946219d633518888a2507"} Jun 10 11:59:37.954276 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:37.954249 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" event={"ID":"e974c50f-2167-40f6-a270-b9bd1bc67630","Type":"ContainerStarted","Data":"c6a1e1180ca312dddf22b89434415588817ea697b4bc93841567c666208b750f"} Jun 10 11:59:37.985041 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:37.984979 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.836683365 podStartE2EDuration="5.984956195s" totalImagesPullingTime="3.124338177s" totalInitContainerRuntime="23.934653ms" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:37.984605522 +0000 UTC m=+88.063341263" watchObservedRunningTime="2026-06-10 11:59:37.984956195 +0000 UTC m=+88.063691935" Jun 10 11:59:38.005231 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:38.005174 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" podStartSLOduration=1.4734995 podStartE2EDuration="3.005152827s" totalImagesPullingTime="1.531653327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:38.004471732 +0000 UTC m=+88.083207516" watchObservedRunningTime="2026-06-10 11:59:38.005152827 +0000 UTC m=+88.083888567" Jun 10 11:59:38.825691 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:38.825663 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 11:59:38.959608 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:38.959568 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" event={"ID":"e974c50f-2167-40f6-a270-b9bd1bc67630","Type":"ContainerStarted","Data":"450d1ab32597ce472b7212017270982b3a2c8445f36ccf8692598b016a2a4267"} Jun 10 11:59:38.981401 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:38.981344 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" podStartSLOduration=2.221269861 podStartE2EDuration="3.981326514s" totalImagesPullingTime="1.760056653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:38.980538592 +0000 UTC m=+89.059274333" watchObservedRunningTime="2026-06-10 11:59:38.981326514 +0000 UTC m=+89.060062253" Jun 10 11:59:39.963227 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:39.963197 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" Jun 10 11:59:39.967985 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:39.967964 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wbr7v" Jun 10 11:59:42.811047 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:42.811009 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d77bcc54-tncn8"] Jun 10 11:59:43.672925 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.672890 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77cc5bdc58-h56rn"] Jun 10 11:59:43.675173 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.675151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.677681 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.677657 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 11:59:43.678724 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.678704 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bhph2\"" Jun 10 11:59:43.678828 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.678723 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 11:59:43.678828 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.678728 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 11:59:43.678828 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.678727 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 11:59:43.679000 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.678850 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 11:59:43.679000 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.678879 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 11:59:43.679000 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.678915 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 11:59:43.683019 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.683002 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 11:59:43.686177 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.686158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-trusted-ca-bundle\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.686254 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.686196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-console-config\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.686254 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.686215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrz6q\" (UniqueName: \"kubernetes.io/projected/9637461f-445a-4f5a-b956-faf08b068008-kube-api-access-jrz6q\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.686318 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.686269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-oauth-config\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.686318 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.686293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-serving-cert\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.686318 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.686311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-service-ca\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.686411 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.686327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-oauth-serving-cert\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.689344 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.689325 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77cc5bdc58-h56rn"] Jun 10 11:59:43.787147 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.787102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-trusted-ca-bundle\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.787329 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.787157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-console-config\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.787329 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.787180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrz6q\" (UniqueName: \"kubernetes.io/projected/9637461f-445a-4f5a-b956-faf08b068008-kube-api-access-jrz6q\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.787329 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.787204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-oauth-config\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.787329 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.787223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-serving-cert\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.787329 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.787243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-service-ca\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.787329 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.787268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-oauth-serving-cert\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.788038 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.788011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-service-ca\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.788143 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.788050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-console-config\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.788143 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.788095 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-oauth-serving-cert\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.788143 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.788129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-trusted-ca-bundle\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.789826 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.789805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-serving-cert\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.789943 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.789924 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-oauth-config\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.797835 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.797802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrz6q\" (UniqueName: \"kubernetes.io/projected/9637461f-445a-4f5a-b956-faf08b068008-kube-api-access-jrz6q\") pod \"console-77cc5bdc58-h56rn\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:43.985180 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:43.985081 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:44.118934 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:44.118900 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77cc5bdc58-h56rn"] Jun 10 11:59:44.121732 ip-10-0-128-88 kubenswrapper[2576]: W0610 11:59:44.121706 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9637461f_445a_4f5a_b956_faf08b068008.slice/crio-5fa073b8dd219e0dc6dc6efa2289847e64b1868bc48f860c535bb90f6d007e9b WatchSource:0}: Error finding container 5fa073b8dd219e0dc6dc6efa2289847e64b1868bc48f860c535bb90f6d007e9b: Status 404 returned error can't find the container with id 5fa073b8dd219e0dc6dc6efa2289847e64b1868bc48f860c535bb90f6d007e9b Jun 10 11:59:44.986227 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:44.986188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77cc5bdc58-h56rn" event={"ID":"9637461f-445a-4f5a-b956-faf08b068008","Type":"ContainerStarted","Data":"5fa073b8dd219e0dc6dc6efa2289847e64b1868bc48f860c535bb90f6d007e9b"} Jun 10 11:59:46.806931 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:46.806890 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h2prl" Jun 10 11:59:46.996664 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:46.996603 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77cc5bdc58-h56rn" event={"ID":"9637461f-445a-4f5a-b956-faf08b068008","Type":"ContainerStarted","Data":"161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8"} Jun 10 11:59:47.022548 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:47.022451 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77cc5bdc58-h56rn" podStartSLOduration=1.38291326 podStartE2EDuration="4.022435495s" totalImagesPullingTime="2.639522235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:59:47.020387206 +0000 UTC m=+97.099122946" watchObservedRunningTime="2026-06-10 11:59:47.022435495 +0000 UTC m=+97.101171234" Jun 10 11:59:53.985332 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:53.985292 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:53.985750 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:53.985355 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:53.989991 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:53.989967 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:54.027729 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:54.027699 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 11:59:55.962350 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:55.962312 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 11:59:55.962756 ip-10-0-128-88 kubenswrapper[2576]: I0610 11:59:55.962405 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 12:00:00.049423 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:00.049390 2576 generic.go:356] "Generic (PLEG): container finished" podID="f149e6da-2d3d-4296-9bee-9c0addca9a71" containerID="1b5b143e64858f24afdcd4ff4914230a79c9d520f49e779ec55d01247c5c0cdd" exitCode=0 Jun 10 12:00:00.049851 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:00.049463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" event={"ID":"f149e6da-2d3d-4296-9bee-9c0addca9a71","Type":"ContainerDied","Data":"1b5b143e64858f24afdcd4ff4914230a79c9d520f49e779ec55d01247c5c0cdd"} Jun 10 12:00:00.049851 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:00.049797 2576 scope.go:117] "RemoveContainer" containerID="1b5b143e64858f24afdcd4ff4914230a79c9d520f49e779ec55d01247c5c0cdd" Jun 10 12:00:01.055505 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:01.055472 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tnk74" event={"ID":"f149e6da-2d3d-4296-9bee-9c0addca9a71","Type":"ContainerStarted","Data":"0b62b3d8121875c26941fc37b4b6318ce81e4ae95db82b3ed322dbb0540d274c"} Jun 10 12:00:05.074094 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:05.074010 2576 generic.go:356] "Generic (PLEG): container finished" podID="e0c7b2a5-981e-47b0-b8c8-68a3d10847cf" containerID="462f4ae3c1ef8bf0394f3bb52022c3644b62998fb3937115bfb58acb789309d1" exitCode=0 Jun 10 12:00:05.074094 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:05.074076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" event={"ID":"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf","Type":"ContainerDied","Data":"462f4ae3c1ef8bf0394f3bb52022c3644b62998fb3937115bfb58acb789309d1"} Jun 10 12:00:05.074518 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:05.074426 2576 scope.go:117] "RemoveContainer" containerID="462f4ae3c1ef8bf0394f3bb52022c3644b62998fb3937115bfb58acb789309d1" Jun 10 12:00:06.079335 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:06.079293 2576 generic.go:356] "Generic (PLEG): container finished" podID="1e3989bc-4357-4c9e-b974-b2ccfe2ab358" containerID="78c264c2080959a8d5871b4bc24960e1d5e6b803839185ffa24d762e464340e7" exitCode=0 Jun 10 12:00:06.079810 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:06.079365 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hbng4" event={"ID":"1e3989bc-4357-4c9e-b974-b2ccfe2ab358","Type":"ContainerDied","Data":"78c264c2080959a8d5871b4bc24960e1d5e6b803839185ffa24d762e464340e7"} Jun 10 12:00:06.079901 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:06.079889 2576 scope.go:117] "RemoveContainer" containerID="78c264c2080959a8d5871b4bc24960e1d5e6b803839185ffa24d762e464340e7" Jun 10 12:00:06.081543 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:06.081513 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p6n4g" event={"ID":"e0c7b2a5-981e-47b0-b8c8-68a3d10847cf","Type":"ContainerStarted","Data":"40a661e71be73f6fc53e43cc6e62196b46c95a778eebce9648719c655508ae79"} Jun 10 12:00:07.087096 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:07.087063 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hbng4" event={"ID":"1e3989bc-4357-4c9e-b974-b2ccfe2ab358","Type":"ContainerStarted","Data":"4e817c060e4c2135632a0ac0d529d4a341ff738a51f24fdd69f4dffc80c53f68"} Jun 10 12:00:07.831867 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:07.831814 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" podUID="d7102df8-0c0c-4741-9de4-dc0b7056a613" containerName="registry" containerID="cri-o://2dd105089bbef37b08202565625ff83f6696f3ec169afe02b634c9f1ce15f192" gracePeriod=30 Jun 10 12:00:08.092174 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.092090 2576 generic.go:356] "Generic (PLEG): container finished" podID="d7102df8-0c0c-4741-9de4-dc0b7056a613" containerID="2dd105089bbef37b08202565625ff83f6696f3ec169afe02b634c9f1ce15f192" exitCode=0 Jun 10 12:00:08.092174 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.092162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" event={"ID":"d7102df8-0c0c-4741-9de4-dc0b7056a613","Type":"ContainerDied","Data":"2dd105089bbef37b08202565625ff83f6696f3ec169afe02b634c9f1ce15f192"} Jun 10 12:00:08.092519 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.092215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" event={"ID":"d7102df8-0c0c-4741-9de4-dc0b7056a613","Type":"ContainerDied","Data":"09296820a2a3ccd8750e45dc543e4abd9fc82e5c4c17719534a008a87ac4b5b2"} Jun 10 12:00:08.092519 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.092233 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09296820a2a3ccd8750e45dc543e4abd9fc82e5c4c17719534a008a87ac4b5b2" Jun 10 12:00:08.105334 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.105306 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 12:00:08.212020 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.211955 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-trusted-ca\") pod \"d7102df8-0c0c-4741-9de4-dc0b7056a613\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " Jun 10 12:00:08.212216 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.212056 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls\") pod \"d7102df8-0c0c-4741-9de4-dc0b7056a613\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " Jun 10 12:00:08.212216 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.212083 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dhwr\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-kube-api-access-8dhwr\") pod \"d7102df8-0c0c-4741-9de4-dc0b7056a613\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " Jun 10 12:00:08.212216 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.212099 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-bound-sa-token\") pod \"d7102df8-0c0c-4741-9de4-dc0b7056a613\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " Jun 10 12:00:08.212216 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.212121 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-image-registry-private-configuration\") pod \"d7102df8-0c0c-4741-9de4-dc0b7056a613\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " Jun 10 12:00:08.212216 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.212161 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7102df8-0c0c-4741-9de4-dc0b7056a613-ca-trust-extracted\") pod \"d7102df8-0c0c-4741-9de4-dc0b7056a613\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " Jun 10 12:00:08.212216 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.212212 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-installation-pull-secrets\") pod \"d7102df8-0c0c-4741-9de4-dc0b7056a613\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " Jun 10 12:00:08.212537 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.212258 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-certificates\") pod \"d7102df8-0c0c-4741-9de4-dc0b7056a613\" (UID: \"d7102df8-0c0c-4741-9de4-dc0b7056a613\") " Jun 10 12:00:08.212861 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.212830 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d7102df8-0c0c-4741-9de4-dc0b7056a613" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:00:08.213144 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.213120 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d7102df8-0c0c-4741-9de4-dc0b7056a613" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:00:08.214772 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.214677 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d7102df8-0c0c-4741-9de4-dc0b7056a613" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:00:08.214772 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.214747 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-kube-api-access-8dhwr" (OuterVolumeSpecName: "kube-api-access-8dhwr") pod "d7102df8-0c0c-4741-9de4-dc0b7056a613" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613"). InnerVolumeSpecName "kube-api-access-8dhwr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:00:08.214942 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.214748 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d7102df8-0c0c-4741-9de4-dc0b7056a613" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:08.215006 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.214992 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d7102df8-0c0c-4741-9de4-dc0b7056a613" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:08.215047 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.214991 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d7102df8-0c0c-4741-9de4-dc0b7056a613" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:00:08.221044 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.221012 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7102df8-0c0c-4741-9de4-dc0b7056a613-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d7102df8-0c0c-4741-9de4-dc0b7056a613" (UID: "d7102df8-0c0c-4741-9de4-dc0b7056a613"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:00:08.313360 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.313321 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-installation-pull-secrets\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:08.313360 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.313356 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-certificates\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:08.313360 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.313367 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7102df8-0c0c-4741-9de4-dc0b7056a613-trusted-ca\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:08.313576 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.313375 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-registry-tls\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:08.313576 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.313384 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dhwr\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-kube-api-access-8dhwr\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:08.313576 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.313393 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7102df8-0c0c-4741-9de4-dc0b7056a613-bound-sa-token\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:08.313576 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.313402 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7102df8-0c0c-4741-9de4-dc0b7056a613-image-registry-private-configuration\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:08.313576 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:08.313413 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7102df8-0c0c-4741-9de4-dc0b7056a613-ca-trust-extracted\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:09.096160 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:09.096126 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d77bcc54-tncn8" Jun 10 12:00:09.117356 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:09.117326 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d77bcc54-tncn8"] Jun 10 12:00:09.124553 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:09.124511 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d77bcc54-tncn8"] Jun 10 12:00:10.348304 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:10.348271 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7102df8-0c0c-4741-9de4-dc0b7056a613" path="/var/lib/kubelet/pods/d7102df8-0c0c-4741-9de4-dc0b7056a613/volumes" Jun 10 12:00:15.967746 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:15.967718 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 12:00:15.971651 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:15.971610 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-657fc6c5f8-5zr9t" Jun 10 12:00:51.800575 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:51.800535 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:00:51.801080 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:51.800831 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="alertmanager" containerID="cri-o://2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6" gracePeriod=120 Jun 10 12:00:51.801080 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:51.800887 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy-metric" containerID="cri-o://b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94" gracePeriod=120 Jun 10 12:00:51.801080 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:51.800913 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy-web" containerID="cri-o://d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b" gracePeriod=120 Jun 10 12:00:51.801080 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:51.800934 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="config-reloader" containerID="cri-o://30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1" gracePeriod=120 Jun 10 12:00:51.801080 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:51.800981 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy" containerID="cri-o://470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914" gracePeriod=120 Jun 10 12:00:51.801080 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:51.801011 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="prom-label-proxy" containerID="cri-o://b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28" gracePeriod=120 Jun 10 12:00:52.273177 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:52.273145 2576 generic.go:356] "Generic (PLEG): container finished" podID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerID="b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28" exitCode=0 Jun 10 12:00:52.273177 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:52.273172 2576 generic.go:356] "Generic (PLEG): container finished" podID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerID="470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914" exitCode=0 Jun 10 12:00:52.273177 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:52.273178 2576 generic.go:356] "Generic (PLEG): container finished" podID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerID="30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1" exitCode=0 Jun 10 12:00:52.273177 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:52.273184 2576 generic.go:356] "Generic (PLEG): container finished" podID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerID="2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6" exitCode=0 Jun 10 12:00:52.273439 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:52.273215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerDied","Data":"b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28"} Jun 10 12:00:52.273439 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:52.273299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerDied","Data":"470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914"} Jun 10 12:00:52.273439 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:52.273326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerDied","Data":"30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1"} Jun 10 12:00:52.273439 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:52.273351 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerDied","Data":"2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6"} Jun 10 12:00:53.044772 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.044741 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.102002 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.101966 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7lnj\" (UniqueName: \"kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-kube-api-access-p7lnj\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102002 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102008 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-volume\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102239 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102033 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102239 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102066 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-metrics-client-ca\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102239 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102095 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-cluster-tls-config\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102239 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102118 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-main-db\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102457 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:00:53.102923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102497 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-trusted-ca-bundle\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102511 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:00:53.102923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102546 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-tls-assets\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102584 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-web-config\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102611 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-web\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102672 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-out\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102709 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-main-tls\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.102923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102766 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9dd285c8-5d0b-4098-a06e-f9095b32db73\" (UID: \"9dd285c8-5d0b-4098-a06e-f9095b32db73\") " Jun 10 12:00:53.103454 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.102966 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:00:53.103454 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.103075 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-metrics-client-ca\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.103454 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.103093 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-main-db\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.103454 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.103107 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dd285c8-5d0b-4098-a06e-f9095b32db73-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.105009 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.104975 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-volume" (OuterVolumeSpecName: "config-volume") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:53.105282 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.105260 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-kube-api-access-p7lnj" (OuterVolumeSpecName: "kube-api-access-p7lnj") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "kube-api-access-p7lnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:00:53.105527 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.105502 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:53.107297 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.107254 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:53.107609 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.107569 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:53.107783 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.107751 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:00:53.107901 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.107794 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-out" (OuterVolumeSpecName: "config-out") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:00:53.107901 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.107797 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:53.111183 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.111161 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:53.117592 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.117561 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-web-config" (OuterVolumeSpecName: "web-config") pod "9dd285c8-5d0b-4098-a06e-f9095b32db73" (UID: "9dd285c8-5d0b-4098-a06e-f9095b32db73"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:00:53.204159 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.204123 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.204159 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.204155 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-cluster-tls-config\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.204159 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.204167 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-tls-assets\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.204404 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.204176 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-web-config\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.204404 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.204185 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.204404 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.204193 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-out\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.204404 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.204202 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-main-tls\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.204404 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.204210 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.204404 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.204220 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7lnj\" (UniqueName: \"kubernetes.io/projected/9dd285c8-5d0b-4098-a06e-f9095b32db73-kube-api-access-p7lnj\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.204404 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.204231 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9dd285c8-5d0b-4098-a06e-f9095b32db73-config-volume\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:00:53.280879 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.280849 2576 generic.go:356] "Generic (PLEG): container finished" podID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerID="b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94" exitCode=0 Jun 10 12:00:53.280879 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.280873 2576 generic.go:356] "Generic (PLEG): container finished" podID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerID="d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b" exitCode=0 Jun 10 12:00:53.281077 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.280930 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.281077 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.280940 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerDied","Data":"b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94"} Jun 10 12:00:53.281077 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.281015 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerDied","Data":"d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b"} Jun 10 12:00:53.281077 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.281046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9dd285c8-5d0b-4098-a06e-f9095b32db73","Type":"ContainerDied","Data":"ae5b1092f907f68e672f2682e52e7663350203dd3289d33f0364c8bdd627dace"} Jun 10 12:00:53.281204 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.281081 2576 scope.go:117] "RemoveContainer" containerID="b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28" Jun 10 12:00:53.289823 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.289806 2576 scope.go:117] "RemoveContainer" containerID="b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94" Jun 10 12:00:53.297306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.297290 2576 scope.go:117] "RemoveContainer" containerID="470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914" Jun 10 12:00:53.304368 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.304343 2576 scope.go:117] "RemoveContainer" containerID="d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b" Jun 10 12:00:53.307844 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.307817 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:00:53.312448 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.312426 2576 scope.go:117] "RemoveContainer" containerID="30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1" Jun 10 12:00:53.313112 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.313091 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:00:53.319741 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.319720 2576 scope.go:117] "RemoveContainer" containerID="2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6" Jun 10 12:00:53.326946 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.326926 2576 scope.go:117] "RemoveContainer" containerID="95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346" Jun 10 12:00:53.335464 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.335443 2576 scope.go:117] "RemoveContainer" containerID="b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28" Jun 10 12:00:53.335913 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:00:53.335889 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28\": container with ID starting with b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28 not found: ID does not exist" containerID="b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28" Jun 10 12:00:53.336007 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.335920 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28"} err="failed to get container status \"b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28\": rpc error: code = NotFound desc = could not find container \"b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28\": container with ID starting with b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28 not found: ID does not exist" Jun 10 12:00:53.336007 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.335953 2576 scope.go:117] "RemoveContainer" containerID="b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94" Jun 10 12:00:53.336259 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:00:53.336238 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94\": container with ID starting with b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94 not found: ID does not exist" containerID="b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94" Jun 10 12:00:53.336306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.336267 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94"} err="failed to get container status \"b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94\": rpc error: code = NotFound desc = could not find container \"b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94\": container with ID starting with b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94 not found: ID does not exist" Jun 10 12:00:53.336306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.336284 2576 scope.go:117] "RemoveContainer" containerID="470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914" Jun 10 12:00:53.336507 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:00:53.336488 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914\": container with ID starting with 470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914 not found: ID does not exist" containerID="470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914" Jun 10 12:00:53.336559 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.336510 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914"} err="failed to get container status \"470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914\": rpc error: code = NotFound desc = could not find container \"470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914\": container with ID starting with 470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914 not found: ID does not exist" Jun 10 12:00:53.336559 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.336526 2576 scope.go:117] "RemoveContainer" containerID="d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b" Jun 10 12:00:53.336751 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:00:53.336736 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b\": container with ID starting with d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b not found: ID does not exist" containerID="d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b" Jun 10 12:00:53.336796 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.336754 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b"} err="failed to get container status \"d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b\": rpc error: code = NotFound desc = could not find container \"d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b\": container with ID starting with d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b not found: ID does not exist" Jun 10 12:00:53.336796 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.336767 2576 scope.go:117] "RemoveContainer" containerID="30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1" Jun 10 12:00:53.337006 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:00:53.336990 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1\": container with ID starting with 30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1 not found: ID does not exist" containerID="30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1" Jun 10 12:00:53.337044 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.337013 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1"} err="failed to get container status \"30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1\": rpc error: code = NotFound desc = could not find container \"30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1\": container with ID starting with 30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1 not found: ID does not exist" Jun 10 12:00:53.337044 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.337027 2576 scope.go:117] "RemoveContainer" containerID="2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6" Jun 10 12:00:53.337255 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:00:53.337238 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6\": container with ID starting with 2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6 not found: ID does not exist" containerID="2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6" Jun 10 12:00:53.337298 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.337265 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6"} err="failed to get container status \"2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6\": rpc error: code = NotFound desc = could not find container \"2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6\": container with ID starting with 2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6 not found: ID does not exist" Jun 10 12:00:53.337298 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.337278 2576 scope.go:117] "RemoveContainer" containerID="95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346" Jun 10 12:00:53.337491 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:00:53.337476 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346\": container with ID starting with 95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346 not found: ID does not exist" containerID="95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346" Jun 10 12:00:53.337529 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.337494 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346"} err="failed to get container status \"95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346\": rpc error: code = NotFound desc = could not find container \"95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346\": container with ID starting with 95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346 not found: ID does not exist" Jun 10 12:00:53.337529 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.337506 2576 scope.go:117] "RemoveContainer" containerID="b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28" Jun 10 12:00:53.337741 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.337723 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28"} err="failed to get container status \"b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28\": rpc error: code = NotFound desc = could not find container \"b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28\": container with ID starting with b84c492d93893a5b93028885c78f6b7acfda3191414aa3b99834d98445676f28 not found: ID does not exist" Jun 10 12:00:53.337797 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.337743 2576 scope.go:117] "RemoveContainer" containerID="b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94" Jun 10 12:00:53.337933 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.337917 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94"} err="failed to get container status \"b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94\": rpc error: code = NotFound desc = could not find container \"b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94\": container with ID starting with b9c214292830e552da72400d863a5817b4f7241ec217fd75f4de94b6d1219e94 not found: ID does not exist" Jun 10 12:00:53.337975 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.337933 2576 scope.go:117] "RemoveContainer" containerID="470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914" Jun 10 12:00:53.338130 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.338113 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914"} err="failed to get container status \"470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914\": rpc error: code = NotFound desc = could not find container \"470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914\": container with ID starting with 470b0cac25a2959f9e801bbb3c69c7e2987a949931141c69eb5a5c6b762df914 not found: ID does not exist" Jun 10 12:00:53.338178 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.338130 2576 scope.go:117] "RemoveContainer" containerID="d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b" Jun 10 12:00:53.338331 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.338313 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b"} err="failed to get container status \"d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b\": rpc error: code = NotFound desc = could not find container \"d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b\": container with ID starting with d7729a0c3831580f52f1dbc63e9cc7f94b6a413ace8fde688139b6aad159126b not found: ID does not exist" Jun 10 12:00:53.338371 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.338332 2576 scope.go:117] "RemoveContainer" containerID="30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1" Jun 10 12:00:53.338585 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.338563 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1"} err="failed to get container status \"30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1\": rpc error: code = NotFound desc = could not find container \"30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1\": container with ID starting with 30e1a947a2d568b3f2b99ea3ac7caea092ad22bb811fb3191a1a95b02ed3bfa1 not found: ID does not exist" Jun 10 12:00:53.338585 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.338584 2576 scope.go:117] "RemoveContainer" containerID="2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6" Jun 10 12:00:53.338802 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.338785 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6"} err="failed to get container status \"2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6\": rpc error: code = NotFound desc = could not find container \"2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6\": container with ID starting with 2c6fabef0cc67fbfcb804be6476b1ed1cfdeb8d1053a71e0e4ca5bfb0ee446f6 not found: ID does not exist" Jun 10 12:00:53.338849 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.338802 2576 scope.go:117] "RemoveContainer" containerID="95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346" Jun 10 12:00:53.338974 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.338960 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346"} err="failed to get container status \"95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346\": rpc error: code = NotFound desc = could not find container \"95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346\": container with ID starting with 95c256bcf1cf58cc7c9e868e38aa9de0cb65a98dd21329d278050270be158346 not found: ID does not exist" Jun 10 12:00:53.345066 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345044 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:00:53.345345 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345333 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy" Jun 10 12:00:53.345400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345349 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy" Jun 10 12:00:53.345400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345364 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="init-config-reloader" Jun 10 12:00:53.345400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345373 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="init-config-reloader" Jun 10 12:00:53.345400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345383 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="prom-label-proxy" Jun 10 12:00:53.345400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345389 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="prom-label-proxy" Jun 10 12:00:53.345400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345398 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="config-reloader" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345403 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="config-reloader" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345409 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy-web" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345414 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy-web" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345422 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy-metric" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345430 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy-metric" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345440 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7102df8-0c0c-4741-9de4-dc0b7056a613" containerName="registry" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345447 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7102df8-0c0c-4741-9de4-dc0b7056a613" containerName="registry" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345458 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="alertmanager" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345464 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="alertmanager" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345514 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy-metric" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345524 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345531 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7102df8-0c0c-4741-9de4-dc0b7056a613" containerName="registry" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345537 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="kube-rbac-proxy-web" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345542 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="prom-label-proxy" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345548 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="alertmanager" Jun 10 12:00:53.345571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.345554 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" containerName="config-reloader" Jun 10 12:00:53.350308 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.350292 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.354893 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.353111 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 12:00:53.354893 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.353391 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 12:00:53.354893 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.353576 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 12:00:53.354893 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.353773 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 12:00:53.354893 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.353919 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 12:00:53.354893 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.354059 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 12:00:53.354893 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.354198 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 12:00:53.354893 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.354875 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 12:00:53.355524 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.354953 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8lkmh\"" Jun 10 12:00:53.358069 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.358013 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 12:00:53.363586 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.363561 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:00:53.405258 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405328 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgwvp\" (UniqueName: \"kubernetes.io/projected/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-kube-api-access-fgwvp\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405667 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405667 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405667 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405667 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-web-config\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405667 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-config-out\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.405667 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.405628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506468 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506468 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506468 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-web-config\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-config-out\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.506787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.506762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwvp\" (UniqueName: \"kubernetes.io/projected/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-kube-api-access-fgwvp\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.508079 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.507741 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.509814 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.509563 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.509814 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.509571 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.509814 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.509754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.510105 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.510082 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.510392 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.510371 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-config-out\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.510503 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.510487 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-web-config\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.510606 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.510484 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.510606 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.510589 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.510749 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.510591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.510810 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.510745 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.511447 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.511431 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.518693 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.518666 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgwvp\" (UniqueName: \"kubernetes.io/projected/ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a-kube-api-access-fgwvp\") pod \"alertmanager-main-0\" (UID: \"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.662114 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.662079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:00:53.802620 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:53.802530 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:00:53.805592 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:00:53.805563 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1cfa59_f1b7_40f0_afd9_8e7451b5b15a.slice/crio-4584048fb023f8490c6e75a54403bc148f13c4e3dd6f58d2e5b0f69bd7267038 WatchSource:0}: Error finding container 4584048fb023f8490c6e75a54403bc148f13c4e3dd6f58d2e5b0f69bd7267038: Status 404 returned error can't find the container with id 4584048fb023f8490c6e75a54403bc148f13c4e3dd6f58d2e5b0f69bd7267038 Jun 10 12:00:54.285946 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:54.285914 2576 generic.go:356] "Generic (PLEG): container finished" podID="ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a" containerID="a834122bc5f28158821126203e51ca88b4e4c7d320f92014d018d4d7b66a8a53" exitCode=0 Jun 10 12:00:54.286361 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:54.285999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a","Type":"ContainerDied","Data":"a834122bc5f28158821126203e51ca88b4e4c7d320f92014d018d4d7b66a8a53"} Jun 10 12:00:54.286361 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:54.286080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a","Type":"ContainerStarted","Data":"4584048fb023f8490c6e75a54403bc148f13c4e3dd6f58d2e5b0f69bd7267038"} Jun 10 12:00:54.346921 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:54.346898 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dd285c8-5d0b-4098-a06e-f9095b32db73" path="/var/lib/kubelet/pods/9dd285c8-5d0b-4098-a06e-f9095b32db73/volumes" Jun 10 12:00:55.294281 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:55.294241 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a","Type":"ContainerStarted","Data":"72ef3af5f8385bf7fc29f1bfdf6e12f727e10b343bd844729dba6a7c9750e554"} Jun 10 12:00:55.294681 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:55.294333 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a","Type":"ContainerStarted","Data":"ef3dd24939994535475b79d105aec1ec2843634e719cb5178d0bb64e3817e2a0"} Jun 10 12:00:55.294681 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:55.294363 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a","Type":"ContainerStarted","Data":"b5f816092fc3959a8e7a278798716e51eacdc10f608796b9686df591c37a9e5c"} Jun 10 12:00:55.294681 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:55.294387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a","Type":"ContainerStarted","Data":"fcb40c26ffbf780d4f4595bb55a39156a9831184f7f9c23dd517bc6e3772ddaa"} Jun 10 12:00:55.294681 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:55.294410 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a","Type":"ContainerStarted","Data":"36745d35cd1a12b5e8c7c9b03fe685469717bcfe2777c3c44cd0b9befd13e0d5"} Jun 10 12:00:55.294681 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:55.294433 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a","Type":"ContainerStarted","Data":"1bfc26035a3ddf8c1697a321dacb250b6e24c3a46acc2b8c685d90532958c21d"} Jun 10 12:00:55.327824 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:00:55.327770 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.307303575 podStartE2EDuration="2.327754565s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.45099ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:00:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:00:55.326334663 +0000 UTC m=+165.405070427" watchObservedRunningTime="2026-06-10 12:00:55.327754565 +0000 UTC m=+165.406490347" Jun 10 12:01:29.567189 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.567146 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b6bc5c76f-ntp4h"] Jun 10 12:01:29.570424 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.570396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.589030 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.588996 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6bc5c76f-ntp4h"] Jun 10 12:01:29.612173 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.612139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-console-config\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.612372 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.612194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-trusted-ca-bundle\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.612372 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.612273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-service-ca\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.612372 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.612318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-oauth-config\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.612372 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.612339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjv5x\" (UniqueName: \"kubernetes.io/projected/f37a2c18-91ef-4689-9fa7-4d958121798e-kube-api-access-xjv5x\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.612372 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.612372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-serving-cert\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.612600 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.612447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-oauth-serving-cert\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.713028 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.712990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-service-ca\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.713028 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.713034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-oauth-config\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.713245 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.713051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjv5x\" (UniqueName: \"kubernetes.io/projected/f37a2c18-91ef-4689-9fa7-4d958121798e-kube-api-access-xjv5x\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.713245 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.713179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-serving-cert\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.713341 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.713242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-oauth-serving-cert\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.713341 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.713297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-console-config\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.713427 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.713342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-trusted-ca-bundle\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.713923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.713893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-service-ca\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.714063 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.713965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-oauth-serving-cert\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.714063 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.714010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-console-config\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.714209 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.714187 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-trusted-ca-bundle\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.715515 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.715489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-oauth-config\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.715679 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.715660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-serving-cert\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.724335 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.724308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjv5x\" (UniqueName: \"kubernetes.io/projected/f37a2c18-91ef-4689-9fa7-4d958121798e-kube-api-access-xjv5x\") pod \"console-7b6bc5c76f-ntp4h\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:29.880693 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:29.880578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:30.027599 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:30.027535 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6bc5c76f-ntp4h"] Jun 10 12:01:30.031804 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:01:30.031778 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37a2c18_91ef_4689_9fa7_4d958121798e.slice/crio-002bf05a45d74dfcabe9e19ab03f796387fe4dcba5b6d814e71a7bd89ee7cb28 WatchSource:0}: Error finding container 002bf05a45d74dfcabe9e19ab03f796387fe4dcba5b6d814e71a7bd89ee7cb28: Status 404 returned error can't find the container with id 002bf05a45d74dfcabe9e19ab03f796387fe4dcba5b6d814e71a7bd89ee7cb28 Jun 10 12:01:30.446244 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:30.446212 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6bc5c76f-ntp4h" event={"ID":"f37a2c18-91ef-4689-9fa7-4d958121798e","Type":"ContainerStarted","Data":"e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506"} Jun 10 12:01:30.446244 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:30.446261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6bc5c76f-ntp4h" event={"ID":"f37a2c18-91ef-4689-9fa7-4d958121798e","Type":"ContainerStarted","Data":"002bf05a45d74dfcabe9e19ab03f796387fe4dcba5b6d814e71a7bd89ee7cb28"} Jun 10 12:01:30.476795 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:30.476736 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b6bc5c76f-ntp4h" podStartSLOduration=1.476716779 podStartE2EDuration="1.476716779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:01:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:01:30.475864427 +0000 UTC m=+200.554600179" watchObservedRunningTime="2026-06-10 12:01:30.476716779 +0000 UTC m=+200.555452517" Jun 10 12:01:39.881379 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:39.881342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:39.881811 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:39.881403 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:39.886162 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:39.886140 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:40.491928 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:40.491900 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:01:40.550356 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:01:40.550317 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77cc5bdc58-h56rn"] Jun 10 12:02:01.302529 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.302489 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz"] Jun 10 12:02:01.311315 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.311289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:01.314998 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.314972 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:02:01.315151 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.315064 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v8fj7\"" Jun 10 12:02:01.316065 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.316046 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:02:01.318072 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.318049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz"] Jun 10 12:02:01.396319 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.396278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:01.396319 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.396329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:01.396590 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.396413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-944xp\" (UniqueName: \"kubernetes.io/projected/01d39ce2-19b7-4129-9039-c99d64ea2f4f-kube-api-access-944xp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:01.497484 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.497446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:01.497484 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.497481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:01.497737 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.497512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-944xp\" (UniqueName: \"kubernetes.io/projected/01d39ce2-19b7-4129-9039-c99d64ea2f4f-kube-api-access-944xp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:01.497920 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.497897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:01.497962 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.497913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:01.508708 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.508674 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-944xp\" (UniqueName: \"kubernetes.io/projected/01d39ce2-19b7-4129-9039-c99d64ea2f4f-kube-api-access-944xp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:01.621408 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.621319 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:01.763600 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:01.763576 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz"] Jun 10 12:02:01.765251 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:02:01.765217 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d39ce2_19b7_4129_9039_c99d64ea2f4f.slice/crio-b39fba4ec0bda64756630d11b58fcfa662be276ee31020b7ddf47e46131991ee WatchSource:0}: Error finding container b39fba4ec0bda64756630d11b58fcfa662be276ee31020b7ddf47e46131991ee: Status 404 returned error can't find the container with id b39fba4ec0bda64756630d11b58fcfa662be276ee31020b7ddf47e46131991ee Jun 10 12:02:02.574938 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:02.574900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" event={"ID":"01d39ce2-19b7-4129-9039-c99d64ea2f4f","Type":"ContainerStarted","Data":"b39fba4ec0bda64756630d11b58fcfa662be276ee31020b7ddf47e46131991ee"} Jun 10 12:02:05.573381 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:05.573338 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77cc5bdc58-h56rn" podUID="9637461f-445a-4f5a-b956-faf08b068008" containerName="console" containerID="cri-o://161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8" gracePeriod=15 Jun 10 12:02:07.109656 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.109609 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 12:02:07.252047 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.251950 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-console-config\") pod \"9637461f-445a-4f5a-b956-faf08b068008\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " Jun 10 12:02:07.252047 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.252000 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-oauth-config\") pod \"9637461f-445a-4f5a-b956-faf08b068008\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " Jun 10 12:02:07.252257 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.252052 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-oauth-serving-cert\") pod \"9637461f-445a-4f5a-b956-faf08b068008\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " Jun 10 12:02:07.252257 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.252100 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrz6q\" (UniqueName: \"kubernetes.io/projected/9637461f-445a-4f5a-b956-faf08b068008-kube-api-access-jrz6q\") pod \"9637461f-445a-4f5a-b956-faf08b068008\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " Jun 10 12:02:07.252257 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.252125 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-serving-cert\") pod \"9637461f-445a-4f5a-b956-faf08b068008\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " Jun 10 12:02:07.252257 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.252150 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-trusted-ca-bundle\") pod \"9637461f-445a-4f5a-b956-faf08b068008\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " Jun 10 12:02:07.252257 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.252185 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-service-ca\") pod \"9637461f-445a-4f5a-b956-faf08b068008\" (UID: \"9637461f-445a-4f5a-b956-faf08b068008\") " Jun 10 12:02:07.252535 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.252411 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-console-config" (OuterVolumeSpecName: "console-config") pod "9637461f-445a-4f5a-b956-faf08b068008" (UID: "9637461f-445a-4f5a-b956-faf08b068008"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:02:07.252679 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.252620 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9637461f-445a-4f5a-b956-faf08b068008" (UID: "9637461f-445a-4f5a-b956-faf08b068008"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:02:07.252752 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.252632 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9637461f-445a-4f5a-b956-faf08b068008" (UID: "9637461f-445a-4f5a-b956-faf08b068008"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:02:07.252752 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.252711 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-service-ca" (OuterVolumeSpecName: "service-ca") pod "9637461f-445a-4f5a-b956-faf08b068008" (UID: "9637461f-445a-4f5a-b956-faf08b068008"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:02:07.254400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.254376 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9637461f-445a-4f5a-b956-faf08b068008" (UID: "9637461f-445a-4f5a-b956-faf08b068008"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:02:07.254400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.254390 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9637461f-445a-4f5a-b956-faf08b068008" (UID: "9637461f-445a-4f5a-b956-faf08b068008"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:02:07.254400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.254392 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9637461f-445a-4f5a-b956-faf08b068008-kube-api-access-jrz6q" (OuterVolumeSpecName: "kube-api-access-jrz6q") pod "9637461f-445a-4f5a-b956-faf08b068008" (UID: "9637461f-445a-4f5a-b956-faf08b068008"). InnerVolumeSpecName "kube-api-access-jrz6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:02:07.353872 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.353836 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-oauth-config\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:07.353872 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.353864 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-oauth-serving-cert\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:07.353872 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.353876 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrz6q\" (UniqueName: \"kubernetes.io/projected/9637461f-445a-4f5a-b956-faf08b068008-kube-api-access-jrz6q\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:07.354106 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.353887 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9637461f-445a-4f5a-b956-faf08b068008-console-serving-cert\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:07.354106 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.353895 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-trusted-ca-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:07.354106 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.353905 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-service-ca\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:07.354106 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.353913 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9637461f-445a-4f5a-b956-faf08b068008-console-config\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:07.598787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.598701 2576 generic.go:356] "Generic (PLEG): container finished" podID="01d39ce2-19b7-4129-9039-c99d64ea2f4f" containerID="2aa1b34d584b2b778004ff589a3fc34f3625b7d31dbce8ae005be114a7b786dc" exitCode=0 Jun 10 12:02:07.598949 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.598788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" event={"ID":"01d39ce2-19b7-4129-9039-c99d64ea2f4f","Type":"ContainerDied","Data":"2aa1b34d584b2b778004ff589a3fc34f3625b7d31dbce8ae005be114a7b786dc"} Jun 10 12:02:07.605492 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.605457 2576 generic.go:356] "Generic (PLEG): container finished" podID="9637461f-445a-4f5a-b956-faf08b068008" containerID="161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8" exitCode=0 Jun 10 12:02:07.605688 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.605659 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77cc5bdc58-h56rn" event={"ID":"9637461f-445a-4f5a-b956-faf08b068008","Type":"ContainerDied","Data":"161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8"} Jun 10 12:02:07.605688 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.605674 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77cc5bdc58-h56rn" Jun 10 12:02:07.605863 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.605743 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77cc5bdc58-h56rn" event={"ID":"9637461f-445a-4f5a-b956-faf08b068008","Type":"ContainerDied","Data":"5fa073b8dd219e0dc6dc6efa2289847e64b1868bc48f860c535bb90f6d007e9b"} Jun 10 12:02:07.605863 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.605771 2576 scope.go:117] "RemoveContainer" containerID="161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8" Jun 10 12:02:07.614578 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.614559 2576 scope.go:117] "RemoveContainer" containerID="161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8" Jun 10 12:02:07.614895 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:02:07.614873 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8\": container with ID starting with 161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8 not found: ID does not exist" containerID="161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8" Jun 10 12:02:07.614975 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.614901 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8"} err="failed to get container status \"161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8\": rpc error: code = NotFound desc = could not find container \"161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8\": container with ID starting with 161f38e2f7c5f8171c1a4c0a922367717bf97814b014e7e4f065fd4fe6f30db8 not found: ID does not exist" Jun 10 12:02:07.658083 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.658046 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77cc5bdc58-h56rn"] Jun 10 12:02:07.664540 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:07.664514 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77cc5bdc58-h56rn"] Jun 10 12:02:08.348582 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:08.348504 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9637461f-445a-4f5a-b956-faf08b068008" path="/var/lib/kubelet/pods/9637461f-445a-4f5a-b956-faf08b068008/volumes" Jun 10 12:02:10.621373 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:10.621288 2576 generic.go:356] "Generic (PLEG): container finished" podID="01d39ce2-19b7-4129-9039-c99d64ea2f4f" containerID="2d85a4e9e7208ad0a5b306dd7eaa6e29dc97beb190030dfd4b335164578dc109" exitCode=0 Jun 10 12:02:10.621373 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:10.621357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" event={"ID":"01d39ce2-19b7-4129-9039-c99d64ea2f4f","Type":"ContainerDied","Data":"2d85a4e9e7208ad0a5b306dd7eaa6e29dc97beb190030dfd4b335164578dc109"} Jun 10 12:02:18.662158 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:18.662121 2576 generic.go:356] "Generic (PLEG): container finished" podID="01d39ce2-19b7-4129-9039-c99d64ea2f4f" containerID="66f5bbaaa8fb6d085d2135fea8277f6fe3ede7d6e6d34beea15da5b61208fae3" exitCode=0 Jun 10 12:02:18.662550 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:18.662209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" event={"ID":"01d39ce2-19b7-4129-9039-c99d64ea2f4f","Type":"ContainerDied","Data":"66f5bbaaa8fb6d085d2135fea8277f6fe3ede7d6e6d34beea15da5b61208fae3"} Jun 10 12:02:19.794251 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:19.794225 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:19.864707 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:19.864672 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-util\") pod \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " Jun 10 12:02:19.864881 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:19.864719 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-944xp\" (UniqueName: \"kubernetes.io/projected/01d39ce2-19b7-4129-9039-c99d64ea2f4f-kube-api-access-944xp\") pod \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " Jun 10 12:02:19.864881 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:19.864745 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-bundle\") pod \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\" (UID: \"01d39ce2-19b7-4129-9039-c99d64ea2f4f\") " Jun 10 12:02:19.865460 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:19.865422 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-bundle" (OuterVolumeSpecName: "bundle") pod "01d39ce2-19b7-4129-9039-c99d64ea2f4f" (UID: "01d39ce2-19b7-4129-9039-c99d64ea2f4f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:02:19.867053 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:19.867032 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d39ce2-19b7-4129-9039-c99d64ea2f4f-kube-api-access-944xp" (OuterVolumeSpecName: "kube-api-access-944xp") pod "01d39ce2-19b7-4129-9039-c99d64ea2f4f" (UID: "01d39ce2-19b7-4129-9039-c99d64ea2f4f"). InnerVolumeSpecName "kube-api-access-944xp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:02:19.868715 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:19.868692 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-util" (OuterVolumeSpecName: "util") pod "01d39ce2-19b7-4129-9039-c99d64ea2f4f" (UID: "01d39ce2-19b7-4129-9039-c99d64ea2f4f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:02:19.965554 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:19.965464 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-util\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:19.965554 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:19.965489 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-944xp\" (UniqueName: \"kubernetes.io/projected/01d39ce2-19b7-4129-9039-c99d64ea2f4f-kube-api-access-944xp\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:19.965554 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:19.965501 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01d39ce2-19b7-4129-9039-c99d64ea2f4f-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:20.671994 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:20.671965 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" Jun 10 12:02:20.672170 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:20.671964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc4mwz" event={"ID":"01d39ce2-19b7-4129-9039-c99d64ea2f4f","Type":"ContainerDied","Data":"b39fba4ec0bda64756630d11b58fcfa662be276ee31020b7ddf47e46131991ee"} Jun 10 12:02:20.672170 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:20.672083 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b39fba4ec0bda64756630d11b58fcfa662be276ee31020b7ddf47e46131991ee" Jun 10 12:02:24.334775 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.334735 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn"] Jun 10 12:02:24.335195 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.335070 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d39ce2-19b7-4129-9039-c99d64ea2f4f" containerName="extract" Jun 10 12:02:24.335195 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.335081 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d39ce2-19b7-4129-9039-c99d64ea2f4f" containerName="extract" Jun 10 12:02:24.335195 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.335102 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9637461f-445a-4f5a-b956-faf08b068008" containerName="console" Jun 10 12:02:24.335195 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.335109 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9637461f-445a-4f5a-b956-faf08b068008" containerName="console" Jun 10 12:02:24.335195 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.335119 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d39ce2-19b7-4129-9039-c99d64ea2f4f" containerName="pull" Jun 10 12:02:24.335195 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.335125 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d39ce2-19b7-4129-9039-c99d64ea2f4f" containerName="pull" Jun 10 12:02:24.335195 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.335132 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d39ce2-19b7-4129-9039-c99d64ea2f4f" containerName="util" Jun 10 12:02:24.335195 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.335137 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d39ce2-19b7-4129-9039-c99d64ea2f4f" containerName="util" Jun 10 12:02:24.335195 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.335189 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="01d39ce2-19b7-4129-9039-c99d64ea2f4f" containerName="extract" Jun 10 12:02:24.335195 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.335197 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9637461f-445a-4f5a-b956-faf08b068008" containerName="console" Jun 10 12:02:24.381170 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.381131 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn"] Jun 10 12:02:24.381344 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.381252 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn" Jun 10 12:02:24.384597 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.384569 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:02:24.384889 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.384868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-f4dfn\"" Jun 10 12:02:24.385006 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.384899 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 12:02:24.406549 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.406512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aea1140-2447-473a-8131-3d1b0025f598-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-frvbn\" (UID: \"1aea1140-2447-473a-8131-3d1b0025f598\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn" Jun 10 12:02:24.406738 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.406588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hknx7\" (UniqueName: \"kubernetes.io/projected/1aea1140-2447-473a-8131-3d1b0025f598-kube-api-access-hknx7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-frvbn\" (UID: \"1aea1140-2447-473a-8131-3d1b0025f598\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn" Jun 10 12:02:24.507874 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.507825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hknx7\" (UniqueName: \"kubernetes.io/projected/1aea1140-2447-473a-8131-3d1b0025f598-kube-api-access-hknx7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-frvbn\" (UID: \"1aea1140-2447-473a-8131-3d1b0025f598\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn" Jun 10 12:02:24.508064 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.507920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aea1140-2447-473a-8131-3d1b0025f598-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-frvbn\" (UID: \"1aea1140-2447-473a-8131-3d1b0025f598\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn" Jun 10 12:02:24.508279 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.508263 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aea1140-2447-473a-8131-3d1b0025f598-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-frvbn\" (UID: \"1aea1140-2447-473a-8131-3d1b0025f598\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn" Jun 10 12:02:24.518968 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.518946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hknx7\" (UniqueName: \"kubernetes.io/projected/1aea1140-2447-473a-8131-3d1b0025f598-kube-api-access-hknx7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-frvbn\" (UID: \"1aea1140-2447-473a-8131-3d1b0025f598\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn" Jun 10 12:02:24.691454 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.691426 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn" Jun 10 12:02:24.851578 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:24.851543 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn"] Jun 10 12:02:24.855281 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:02:24.855252 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aea1140_2447_473a_8131_3d1b0025f598.slice/crio-a854dd578e7f5fea6cbc5744760ccccd6b56f140b67bca8e637a0e097ca31082 WatchSource:0}: Error finding container a854dd578e7f5fea6cbc5744760ccccd6b56f140b67bca8e637a0e097ca31082: Status 404 returned error can't find the container with id a854dd578e7f5fea6cbc5744760ccccd6b56f140b67bca8e637a0e097ca31082 Jun 10 12:02:25.695825 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:25.695790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn" event={"ID":"1aea1140-2447-473a-8131-3d1b0025f598","Type":"ContainerStarted","Data":"a854dd578e7f5fea6cbc5744760ccccd6b56f140b67bca8e637a0e097ca31082"} Jun 10 12:02:27.707148 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:27.707107 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn" event={"ID":"1aea1140-2447-473a-8131-3d1b0025f598","Type":"ContainerStarted","Data":"ba6252cf1e61ab73d2c27b3c345a97f12b7f25f4f18086a0c623ef9afbe6b25f"} Jun 10 12:02:27.763896 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:27.763828 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-frvbn" podStartSLOduration=1.548656335 podStartE2EDuration="3.763808357s" totalImagesPullingTime="2.215152022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:02:27.760440032 +0000 UTC m=+257.839175782" watchObservedRunningTime="2026-06-10 12:02:27.763808357 +0000 UTC m=+257.842544097" Jun 10 12:02:28.991171 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:28.991134 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6"] Jun 10 12:02:29.007798 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.007772 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:29.010946 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.010917 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:02:29.012058 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.012024 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:02:29.012168 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.012057 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v8fj7\"" Jun 10 12:02:29.016597 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.016570 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6"] Jun 10 12:02:29.049270 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.049231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp4fh\" (UniqueName: \"kubernetes.io/projected/93f0229c-fcb7-4573-8db0-f162466bab0e-kube-api-access-hp4fh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:29.049460 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.049308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:29.049460 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.049336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:29.150553 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.150516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:29.150553 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.150555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:29.150853 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.150710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp4fh\" (UniqueName: \"kubernetes.io/projected/93f0229c-fcb7-4573-8db0-f162466bab0e-kube-api-access-hp4fh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:29.150974 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.150957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:29.151041 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.151003 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:29.178467 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.178432 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp4fh\" (UniqueName: \"kubernetes.io/projected/93f0229c-fcb7-4573-8db0-f162466bab0e-kube-api-access-hp4fh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:29.318466 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.318376 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:29.471937 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.471912 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6"] Jun 10 12:02:29.474484 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:02:29.474447 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f0229c_fcb7_4573_8db0_f162466bab0e.slice/crio-08352020dc7bf62248c6b3448656712348c5a48608ca06ec39a604fc044c8f5c WatchSource:0}: Error finding container 08352020dc7bf62248c6b3448656712348c5a48608ca06ec39a604fc044c8f5c: Status 404 returned error can't find the container with id 08352020dc7bf62248c6b3448656712348c5a48608ca06ec39a604fc044c8f5c Jun 10 12:02:29.717843 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.717808 2576 generic.go:356] "Generic (PLEG): container finished" podID="93f0229c-fcb7-4573-8db0-f162466bab0e" containerID="fa1dcb5b17ef1f6223238f7fab4b3abec5e85b9daf557fd69ffcf0ca7b72ed36" exitCode=0 Jun 10 12:02:29.718036 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.717895 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" event={"ID":"93f0229c-fcb7-4573-8db0-f162466bab0e","Type":"ContainerDied","Data":"fa1dcb5b17ef1f6223238f7fab4b3abec5e85b9daf557fd69ffcf0ca7b72ed36"} Jun 10 12:02:29.718036 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:29.717950 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" event={"ID":"93f0229c-fcb7-4573-8db0-f162466bab0e","Type":"ContainerStarted","Data":"08352020dc7bf62248c6b3448656712348c5a48608ca06ec39a604fc044c8f5c"} Jun 10 12:02:30.536675 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.536578 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx"] Jun 10 12:02:30.538803 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.538787 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" Jun 10 12:02:30.542790 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.542769 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 12:02:30.543438 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.543421 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-t69rv\"" Jun 10 12:02:30.543548 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.543491 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 12:02:30.618316 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.618281 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx"] Jun 10 12:02:30.663035 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.662997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8018675c-9d69-4602-87bc-cbd65ec1ca79-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-f5dhx\" (UID: \"8018675c-9d69-4602-87bc-cbd65ec1ca79\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" Jun 10 12:02:30.663243 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.663043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgzck\" (UniqueName: \"kubernetes.io/projected/8018675c-9d69-4602-87bc-cbd65ec1ca79-kube-api-access-hgzck\") pod \"cert-manager-webhook-7dc76cbb94-f5dhx\" (UID: \"8018675c-9d69-4602-87bc-cbd65ec1ca79\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" Jun 10 12:02:30.764011 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.763977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8018675c-9d69-4602-87bc-cbd65ec1ca79-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-f5dhx\" (UID: \"8018675c-9d69-4602-87bc-cbd65ec1ca79\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" Jun 10 12:02:30.764229 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.764037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgzck\" (UniqueName: \"kubernetes.io/projected/8018675c-9d69-4602-87bc-cbd65ec1ca79-kube-api-access-hgzck\") pod \"cert-manager-webhook-7dc76cbb94-f5dhx\" (UID: \"8018675c-9d69-4602-87bc-cbd65ec1ca79\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" Jun 10 12:02:30.773456 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.773432 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgzck\" (UniqueName: \"kubernetes.io/projected/8018675c-9d69-4602-87bc-cbd65ec1ca79-kube-api-access-hgzck\") pod \"cert-manager-webhook-7dc76cbb94-f5dhx\" (UID: \"8018675c-9d69-4602-87bc-cbd65ec1ca79\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" Jun 10 12:02:30.773924 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.773903 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8018675c-9d69-4602-87bc-cbd65ec1ca79-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-f5dhx\" (UID: \"8018675c-9d69-4602-87bc-cbd65ec1ca79\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" Jun 10 12:02:30.866999 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:30.866906 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" Jun 10 12:02:31.012756 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:31.012723 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx"] Jun 10 12:02:31.015553 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:02:31.015526 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8018675c_9d69_4602_87bc_cbd65ec1ca79.slice/crio-bf3464410d89206ee7580c8433db14a5cc443cf79f343f379ecdb687eb6216e1 WatchSource:0}: Error finding container bf3464410d89206ee7580c8433db14a5cc443cf79f343f379ecdb687eb6216e1: Status 404 returned error can't find the container with id bf3464410d89206ee7580c8433db14a5cc443cf79f343f379ecdb687eb6216e1 Jun 10 12:02:31.730019 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:31.729970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" event={"ID":"8018675c-9d69-4602-87bc-cbd65ec1ca79","Type":"ContainerStarted","Data":"bf3464410d89206ee7580c8433db14a5cc443cf79f343f379ecdb687eb6216e1"} Jun 10 12:02:33.059741 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:33.059707 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv"] Jun 10 12:02:33.062205 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:33.062180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv" Jun 10 12:02:33.065189 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:33.065170 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-spbdx\"" Jun 10 12:02:33.072934 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:33.072907 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv"] Jun 10 12:02:33.187614 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:33.187575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a0ad8cd-08d3-4656-89de-c39b4fa58c46-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-w6bpv\" (UID: \"0a0ad8cd-08d3-4656-89de-c39b4fa58c46\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv" Jun 10 12:02:33.187890 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:33.187625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqtlr\" (UniqueName: \"kubernetes.io/projected/0a0ad8cd-08d3-4656-89de-c39b4fa58c46-kube-api-access-nqtlr\") pod \"cert-manager-cainjector-5d99449ffd-w6bpv\" (UID: \"0a0ad8cd-08d3-4656-89de-c39b4fa58c46\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv" Jun 10 12:02:33.289000 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:33.288960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a0ad8cd-08d3-4656-89de-c39b4fa58c46-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-w6bpv\" (UID: \"0a0ad8cd-08d3-4656-89de-c39b4fa58c46\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv" Jun 10 12:02:33.289178 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:33.289008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqtlr\" (UniqueName: \"kubernetes.io/projected/0a0ad8cd-08d3-4656-89de-c39b4fa58c46-kube-api-access-nqtlr\") pod \"cert-manager-cainjector-5d99449ffd-w6bpv\" (UID: \"0a0ad8cd-08d3-4656-89de-c39b4fa58c46\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv" Jun 10 12:02:33.299410 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:33.299380 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a0ad8cd-08d3-4656-89de-c39b4fa58c46-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-w6bpv\" (UID: \"0a0ad8cd-08d3-4656-89de-c39b4fa58c46\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv" Jun 10 12:02:33.299565 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:33.299520 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqtlr\" (UniqueName: \"kubernetes.io/projected/0a0ad8cd-08d3-4656-89de-c39b4fa58c46-kube-api-access-nqtlr\") pod \"cert-manager-cainjector-5d99449ffd-w6bpv\" (UID: \"0a0ad8cd-08d3-4656-89de-c39b4fa58c46\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv" Jun 10 12:02:33.374192 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:33.374093 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv" Jun 10 12:02:34.123088 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:34.123059 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv"] Jun 10 12:02:34.125730 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:02:34.125694 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a0ad8cd_08d3_4656_89de_c39b4fa58c46.slice/crio-499b17a0030fd88ecde2d330f2ca88c798cfca1fb2a95bd172984e9e5db66326 WatchSource:0}: Error finding container 499b17a0030fd88ecde2d330f2ca88c798cfca1fb2a95bd172984e9e5db66326: Status 404 returned error can't find the container with id 499b17a0030fd88ecde2d330f2ca88c798cfca1fb2a95bd172984e9e5db66326 Jun 10 12:02:34.747718 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:34.747669 2576 generic.go:356] "Generic (PLEG): container finished" podID="93f0229c-fcb7-4573-8db0-f162466bab0e" containerID="847c5e60f3cafef7a4f10c84b308151af3d70ae4b337c653e2644074ee23e3b9" exitCode=0 Jun 10 12:02:34.747919 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:34.747752 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" event={"ID":"93f0229c-fcb7-4573-8db0-f162466bab0e","Type":"ContainerDied","Data":"847c5e60f3cafef7a4f10c84b308151af3d70ae4b337c653e2644074ee23e3b9"} Jun 10 12:02:34.749289 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:34.749264 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv" event={"ID":"0a0ad8cd-08d3-4656-89de-c39b4fa58c46","Type":"ContainerStarted","Data":"3725166a0d792573d67ccb00ce04cdab9ea37825cce2f8d949b1332a6bafe3d9"} Jun 10 12:02:34.749385 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:34.749301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv" event={"ID":"0a0ad8cd-08d3-4656-89de-c39b4fa58c46","Type":"ContainerStarted","Data":"499b17a0030fd88ecde2d330f2ca88c798cfca1fb2a95bd172984e9e5db66326"} Jun 10 12:02:34.750773 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:34.750749 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" event={"ID":"8018675c-9d69-4602-87bc-cbd65ec1ca79","Type":"ContainerStarted","Data":"506072bb62fd50816f36f298d0b810f86d1d1dcbc6b7bef9b4c0899348fb3241"} Jun 10 12:02:34.750905 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:34.750885 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" Jun 10 12:02:34.787106 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:34.787057 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" podStartSLOduration=1.811480102 podStartE2EDuration="4.787041187s" totalImagesPullingTime="2.975561085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:02:34.784999436 +0000 UTC m=+264.863735176" watchObservedRunningTime="2026-06-10 12:02:34.787041187 +0000 UTC m=+264.865776926" Jun 10 12:02:34.804702 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:34.804651 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-w6bpv" podStartSLOduration=1.804618654 podStartE2EDuration="1.804618654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:02:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:02:34.802507627 +0000 UTC m=+264.881243366" watchObservedRunningTime="2026-06-10 12:02:34.804618654 +0000 UTC m=+264.883354393" Jun 10 12:02:35.757552 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:35.757518 2576 generic.go:356] "Generic (PLEG): container finished" podID="93f0229c-fcb7-4573-8db0-f162466bab0e" containerID="938548a450ac1b0430f8e84e5092431ccf26365408248a0d38167b6e610d89ad" exitCode=0 Jun 10 12:02:35.757971 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:35.757613 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" event={"ID":"93f0229c-fcb7-4573-8db0-f162466bab0e","Type":"ContainerDied","Data":"938548a450ac1b0430f8e84e5092431ccf26365408248a0d38167b6e610d89ad"} Jun 10 12:02:36.890477 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:36.890452 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:37.025585 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.025484 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp4fh\" (UniqueName: \"kubernetes.io/projected/93f0229c-fcb7-4573-8db0-f162466bab0e-kube-api-access-hp4fh\") pod \"93f0229c-fcb7-4573-8db0-f162466bab0e\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " Jun 10 12:02:37.025585 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.025545 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-bundle\") pod \"93f0229c-fcb7-4573-8db0-f162466bab0e\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " Jun 10 12:02:37.025585 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.025567 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-util\") pod \"93f0229c-fcb7-4573-8db0-f162466bab0e\" (UID: \"93f0229c-fcb7-4573-8db0-f162466bab0e\") " Jun 10 12:02:37.026044 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.026016 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-bundle" (OuterVolumeSpecName: "bundle") pod "93f0229c-fcb7-4573-8db0-f162466bab0e" (UID: "93f0229c-fcb7-4573-8db0-f162466bab0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:02:37.027649 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.027602 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f0229c-fcb7-4573-8db0-f162466bab0e-kube-api-access-hp4fh" (OuterVolumeSpecName: "kube-api-access-hp4fh") pod "93f0229c-fcb7-4573-8db0-f162466bab0e" (UID: "93f0229c-fcb7-4573-8db0-f162466bab0e"). InnerVolumeSpecName "kube-api-access-hp4fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:02:37.032119 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.032089 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-util" (OuterVolumeSpecName: "util") pod "93f0229c-fcb7-4573-8db0-f162466bab0e" (UID: "93f0229c-fcb7-4573-8db0-f162466bab0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:02:37.126236 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.126192 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:37.126236 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.126228 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93f0229c-fcb7-4573-8db0-f162466bab0e-util\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:37.126236 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.126241 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp4fh\" (UniqueName: \"kubernetes.io/projected/93f0229c-fcb7-4573-8db0-f162466bab0e-kube-api-access-hp4fh\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:37.768798 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.768773 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" Jun 10 12:02:37.768969 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.768805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhfl6" event={"ID":"93f0229c-fcb7-4573-8db0-f162466bab0e","Type":"ContainerDied","Data":"08352020dc7bf62248c6b3448656712348c5a48608ca06ec39a604fc044c8f5c"} Jun 10 12:02:37.768969 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:37.768856 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08352020dc7bf62248c6b3448656712348c5a48608ca06ec39a604fc044c8f5c" Jun 10 12:02:40.760732 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:40.760704 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-f5dhx" Jun 10 12:02:45.020991 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.020955 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c"] Jun 10 12:02:45.021422 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.021285 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f0229c-fcb7-4573-8db0-f162466bab0e" containerName="pull" Jun 10 12:02:45.021422 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.021297 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f0229c-fcb7-4573-8db0-f162466bab0e" containerName="pull" Jun 10 12:02:45.021422 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.021312 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f0229c-fcb7-4573-8db0-f162466bab0e" containerName="extract" Jun 10 12:02:45.021422 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.021320 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f0229c-fcb7-4573-8db0-f162466bab0e" containerName="extract" Jun 10 12:02:45.021422 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.021337 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f0229c-fcb7-4573-8db0-f162466bab0e" containerName="util" Jun 10 12:02:45.021422 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.021343 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f0229c-fcb7-4573-8db0-f162466bab0e" containerName="util" Jun 10 12:02:45.021422 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.021404 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f0229c-fcb7-4573-8db0-f162466bab0e" containerName="extract" Jun 10 12:02:45.024887 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.024869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c" Jun 10 12:02:45.027807 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.027786 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kqq59\"" Jun 10 12:02:45.027807 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.027800 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:02:45.028969 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.028950 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 12:02:45.034235 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.034206 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c"] Jun 10 12:02:45.095487 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.095451 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2eb4e9-6235-474c-bd76-b60f3ae43113-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rlk8c\" (UID: \"dc2eb4e9-6235-474c-bd76-b60f3ae43113\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c" Jun 10 12:02:45.095703 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.095520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvrjv\" (UniqueName: \"kubernetes.io/projected/dc2eb4e9-6235-474c-bd76-b60f3ae43113-kube-api-access-zvrjv\") pod \"openshift-lws-operator-fd8ccff4c-rlk8c\" (UID: \"dc2eb4e9-6235-474c-bd76-b60f3ae43113\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c" Jun 10 12:02:45.196861 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.196825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2eb4e9-6235-474c-bd76-b60f3ae43113-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rlk8c\" (UID: \"dc2eb4e9-6235-474c-bd76-b60f3ae43113\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c" Jun 10 12:02:45.197035 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.196894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvrjv\" (UniqueName: \"kubernetes.io/projected/dc2eb4e9-6235-474c-bd76-b60f3ae43113-kube-api-access-zvrjv\") pod \"openshift-lws-operator-fd8ccff4c-rlk8c\" (UID: \"dc2eb4e9-6235-474c-bd76-b60f3ae43113\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c" Jun 10 12:02:45.197237 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.197216 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2eb4e9-6235-474c-bd76-b60f3ae43113-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rlk8c\" (UID: \"dc2eb4e9-6235-474c-bd76-b60f3ae43113\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c" Jun 10 12:02:45.210082 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.210051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvrjv\" (UniqueName: \"kubernetes.io/projected/dc2eb4e9-6235-474c-bd76-b60f3ae43113-kube-api-access-zvrjv\") pod \"openshift-lws-operator-fd8ccff4c-rlk8c\" (UID: \"dc2eb4e9-6235-474c-bd76-b60f3ae43113\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c" Jun 10 12:02:45.335121 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.335029 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c" Jun 10 12:02:45.471622 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.471600 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c"] Jun 10 12:02:45.473275 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:02:45.473246 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc2eb4e9_6235_474c_bd76_b60f3ae43113.slice/crio-64f34f259d18485a0fd79afffef7129999ee94500eba1f146387079273f5f8b5 WatchSource:0}: Error finding container 64f34f259d18485a0fd79afffef7129999ee94500eba1f146387079273f5f8b5: Status 404 returned error can't find the container with id 64f34f259d18485a0fd79afffef7129999ee94500eba1f146387079273f5f8b5 Jun 10 12:02:45.805597 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:45.805560 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c" event={"ID":"dc2eb4e9-6235-474c-bd76-b60f3ae43113","Type":"ContainerStarted","Data":"64f34f259d18485a0fd79afffef7129999ee94500eba1f146387079273f5f8b5"} Jun 10 12:02:47.817706 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:47.817666 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c" event={"ID":"dc2eb4e9-6235-474c-bd76-b60f3ae43113","Type":"ContainerStarted","Data":"92950f2beca16a56d60455f4fd842a7f2cab2e81bb54ad6b5f329234d0574030"} Jun 10 12:02:47.842269 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:47.842212 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlk8c" podStartSLOduration=2.102304035 podStartE2EDuration="3.842194839s" totalImagesPullingTime="1.739890804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:02:47.841733062 +0000 UTC m=+277.920468802" watchObservedRunningTime="2026-06-10 12:02:47.842194839 +0000 UTC m=+277.920930578" Jun 10 12:02:50.720042 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.720007 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht"] Jun 10 12:02:50.724288 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.724265 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:50.728199 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.728176 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:02:50.728473 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.728458 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:02:50.728529 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.728461 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v8fj7\"" Jun 10 12:02:50.742400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.742367 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht"] Jun 10 12:02:50.851248 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.851215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:50.851402 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.851261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9vcr\" (UniqueName: \"kubernetes.io/projected/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-kube-api-access-l9vcr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:50.851402 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.851380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:50.952709 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.952603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:50.952903 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.952738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9vcr\" (UniqueName: \"kubernetes.io/projected/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-kube-api-access-l9vcr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:50.952903 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.952820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:50.953101 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.953077 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:50.953154 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.953133 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:50.963368 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:50.963335 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9vcr\" (UniqueName: \"kubernetes.io/projected/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-kube-api-access-l9vcr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:51.034131 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:51.034044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:51.177601 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:51.177567 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht"] Jun 10 12:02:51.180878 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:02:51.180849 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce1e322_3aab_4a3d_a66b_0a9c951452f9.slice/crio-19f78e55e001a24cf1a399ef3463b742465b20adb09c4b0d3281104d2d90ccea WatchSource:0}: Error finding container 19f78e55e001a24cf1a399ef3463b742465b20adb09c4b0d3281104d2d90ccea: Status 404 returned error can't find the container with id 19f78e55e001a24cf1a399ef3463b742465b20adb09c4b0d3281104d2d90ccea Jun 10 12:02:51.839069 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:51.839025 2576 generic.go:356] "Generic (PLEG): container finished" podID="5ce1e322-3aab-4a3d-a66b-0a9c951452f9" containerID="94e2095a6a1d96edfc71ebe7447a1a5ad4e85d00999b2e0a77d6e242adf1daa3" exitCode=0 Jun 10 12:02:51.839530 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:51.839084 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" event={"ID":"5ce1e322-3aab-4a3d-a66b-0a9c951452f9","Type":"ContainerDied","Data":"94e2095a6a1d96edfc71ebe7447a1a5ad4e85d00999b2e0a77d6e242adf1daa3"} Jun 10 12:02:51.839530 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:51.839125 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" event={"ID":"5ce1e322-3aab-4a3d-a66b-0a9c951452f9","Type":"ContainerStarted","Data":"19f78e55e001a24cf1a399ef3463b742465b20adb09c4b0d3281104d2d90ccea"} Jun 10 12:02:52.845600 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:52.845500 2576 generic.go:356] "Generic (PLEG): container finished" podID="5ce1e322-3aab-4a3d-a66b-0a9c951452f9" containerID="27dc5e40fdbdd578bffcdc0ce4957d5c0925416c4075c66572caf4d37c947d43" exitCode=0 Jun 10 12:02:52.845600 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:52.845587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" event={"ID":"5ce1e322-3aab-4a3d-a66b-0a9c951452f9","Type":"ContainerDied","Data":"27dc5e40fdbdd578bffcdc0ce4957d5c0925416c4075c66572caf4d37c947d43"} Jun 10 12:02:53.852737 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:53.852701 2576 generic.go:356] "Generic (PLEG): container finished" podID="5ce1e322-3aab-4a3d-a66b-0a9c951452f9" containerID="e46dab034ea38e97494a3f84b9d4ad943dbf04489c0354eb1b41a613c50bd7a5" exitCode=0 Jun 10 12:02:53.853178 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:53.852789 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" event={"ID":"5ce1e322-3aab-4a3d-a66b-0a9c951452f9","Type":"ContainerDied","Data":"e46dab034ea38e97494a3f84b9d4ad943dbf04489c0354eb1b41a613c50bd7a5"} Jun 10 12:02:54.989064 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:54.989039 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:55.094364 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.094322 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9vcr\" (UniqueName: \"kubernetes.io/projected/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-kube-api-access-l9vcr\") pod \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " Jun 10 12:02:55.094536 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.094382 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-util\") pod \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " Jun 10 12:02:55.094536 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.094410 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-bundle\") pod \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\" (UID: \"5ce1e322-3aab-4a3d-a66b-0a9c951452f9\") " Jun 10 12:02:55.095213 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.095185 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-bundle" (OuterVolumeSpecName: "bundle") pod "5ce1e322-3aab-4a3d-a66b-0a9c951452f9" (UID: "5ce1e322-3aab-4a3d-a66b-0a9c951452f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:02:55.096576 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.096544 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-kube-api-access-l9vcr" (OuterVolumeSpecName: "kube-api-access-l9vcr") pod "5ce1e322-3aab-4a3d-a66b-0a9c951452f9" (UID: "5ce1e322-3aab-4a3d-a66b-0a9c951452f9"). InnerVolumeSpecName "kube-api-access-l9vcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:02:55.099894 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.099872 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-util" (OuterVolumeSpecName: "util") pod "5ce1e322-3aab-4a3d-a66b-0a9c951452f9" (UID: "5ce1e322-3aab-4a3d-a66b-0a9c951452f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:02:55.195341 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.195301 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9vcr\" (UniqueName: \"kubernetes.io/projected/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-kube-api-access-l9vcr\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:55.195341 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.195335 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-util\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:55.195341 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.195344 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ce1e322-3aab-4a3d-a66b-0a9c951452f9-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:02:55.863849 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.863815 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" event={"ID":"5ce1e322-3aab-4a3d-a66b-0a9c951452f9","Type":"ContainerDied","Data":"19f78e55e001a24cf1a399ef3463b742465b20adb09c4b0d3281104d2d90ccea"} Jun 10 12:02:55.863849 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.863836 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrfvht" Jun 10 12:02:55.864064 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:02:55.863861 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19f78e55e001a24cf1a399ef3463b742465b20adb09c4b0d3281104d2d90ccea" Jun 10 12:03:04.313489 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.313456 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx"] Jun 10 12:03:04.313991 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.313817 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ce1e322-3aab-4a3d-a66b-0a9c951452f9" containerName="pull" Jun 10 12:03:04.313991 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.313830 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ce1e322-3aab-4a3d-a66b-0a9c951452f9" containerName="pull" Jun 10 12:03:04.313991 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.313847 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ce1e322-3aab-4a3d-a66b-0a9c951452f9" containerName="util" Jun 10 12:03:04.313991 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.313853 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ce1e322-3aab-4a3d-a66b-0a9c951452f9" containerName="util" Jun 10 12:03:04.313991 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.313863 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ce1e322-3aab-4a3d-a66b-0a9c951452f9" containerName="extract" Jun 10 12:03:04.313991 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.313869 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ce1e322-3aab-4a3d-a66b-0a9c951452f9" containerName="extract" Jun 10 12:03:04.313991 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.313916 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ce1e322-3aab-4a3d-a66b-0a9c951452f9" containerName="extract" Jun 10 12:03:04.317171 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.317152 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.321836 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.321805 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 12:03:04.321984 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.321870 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 12:03:04.321984 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.321815 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 12:03:04.322114 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.321986 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 12:03:04.322114 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.322049 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wc264\"" Jun 10 12:03:04.348492 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.348464 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx"] Jun 10 12:03:04.373274 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.373248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f588f053-e8b4-4093-a374-2b9abac9806d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.373446 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.373289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f588f053-e8b4-4093-a374-2b9abac9806d-tmp\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.373446 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.373313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f588f053-e8b4-4093-a374-2b9abac9806d-manifests\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.373446 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.373338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f588f053-e8b4-4093-a374-2b9abac9806d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.373446 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.373417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bf8m\" (UniqueName: \"kubernetes.io/projected/f588f053-e8b4-4093-a374-2b9abac9806d-kube-api-access-4bf8m\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.474518 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.474484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bf8m\" (UniqueName: \"kubernetes.io/projected/f588f053-e8b4-4093-a374-2b9abac9806d-kube-api-access-4bf8m\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.474739 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.474542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f588f053-e8b4-4093-a374-2b9abac9806d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.474739 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.474578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f588f053-e8b4-4093-a374-2b9abac9806d-tmp\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.474739 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.474599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f588f053-e8b4-4093-a374-2b9abac9806d-manifests\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.474739 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.474615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f588f053-e8b4-4093-a374-2b9abac9806d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.475105 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.475078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f588f053-e8b4-4093-a374-2b9abac9806d-manifests\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.477191 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.477161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f588f053-e8b4-4093-a374-2b9abac9806d-tmp\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.477295 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.477278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f588f053-e8b4-4093-a374-2b9abac9806d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.477337 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.477312 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f588f053-e8b4-4093-a374-2b9abac9806d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.485415 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.485394 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bf8m\" (UniqueName: \"kubernetes.io/projected/f588f053-e8b4-4093-a374-2b9abac9806d-kube-api-access-4bf8m\") pod \"opendatahub-operator-controller-manager-76c45549f7-8hrnx\" (UID: \"f588f053-e8b4-4093-a374-2b9abac9806d\") " pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.627931 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.627842 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:04.807753 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.807721 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx"] Jun 10 12:03:04.811318 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:03:04.811288 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf588f053_e8b4_4093_a374_2b9abac9806d.slice/crio-23b8eeb42b5d2820dc548828b8bc8c8dd7ba097c50f0ec3e142541e9dce02517 WatchSource:0}: Error finding container 23b8eeb42b5d2820dc548828b8bc8c8dd7ba097c50f0ec3e142541e9dce02517: Status 404 returned error can't find the container with id 23b8eeb42b5d2820dc548828b8bc8c8dd7ba097c50f0ec3e142541e9dce02517 Jun 10 12:03:04.907672 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:04.907622 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" event={"ID":"f588f053-e8b4-4093-a374-2b9abac9806d","Type":"ContainerStarted","Data":"23b8eeb42b5d2820dc548828b8bc8c8dd7ba097c50f0ec3e142541e9dce02517"} Jun 10 12:03:07.925403 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:07.925356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" event={"ID":"f588f053-e8b4-4093-a374-2b9abac9806d","Type":"ContainerStarted","Data":"f1b05c2292741bbc9cc4ce52e9705ace99214594b3f7d04edf8b9b7493997a90"} Jun 10 12:03:09.936920 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:09.936881 2576 generic.go:356] "Generic (PLEG): container finished" podID="f588f053-e8b4-4093-a374-2b9abac9806d" containerID="f1b05c2292741bbc9cc4ce52e9705ace99214594b3f7d04edf8b9b7493997a90" exitCode=0 Jun 10 12:03:09.937337 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:09.936932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" event={"ID":"f588f053-e8b4-4093-a374-2b9abac9806d","Type":"ContainerDied","Data":"f1b05c2292741bbc9cc4ce52e9705ace99214594b3f7d04edf8b9b7493997a90"} Jun 10 12:03:10.294154 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:10.294124 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:03:10.298178 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:10.298151 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:03:10.312445 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:10.312424 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 12:03:10.944036 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:10.943997 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" event={"ID":"f588f053-e8b4-4093-a374-2b9abac9806d","Type":"ContainerStarted","Data":"5ad0d907871bbca6ee51264c9627eccdcdc9f6bbe177bc74dd0a914f415f2fbc"} Jun 10 12:03:10.946554 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:10.944256 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:10.982257 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:10.982200 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" podStartSLOduration=2.62977451 podStartE2EDuration="6.982181371s" totalImagesPullingTime="3.300265602s" totalInitContainerRuntime="1.052141259s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:10.980473066 +0000 UTC m=+301.059208807" watchObservedRunningTime="2026-06-10 12:03:10.982181371 +0000 UTC m=+301.060917109" Jun 10 12:03:21.951709 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:21.951677 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76c45549f7-8hrnx" Jun 10 12:03:27.790392 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.790354 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm"] Jun 10 12:03:27.793648 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.793619 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:27.797586 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.797562 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:03:27.798440 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.798425 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:03:27.798534 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.798428 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v8fj7\"" Jun 10 12:03:27.817791 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.817762 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm"] Jun 10 12:03:27.819686 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.819660 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cb945c55-cm2vl"] Jun 10 12:03:27.822536 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.822517 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" Jun 10 12:03:27.826648 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.826608 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 12:03:27.826648 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.826625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rb7fl\"" Jun 10 12:03:27.826816 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.826648 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 12:03:27.866815 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.866770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cb945c55-cm2vl"] Jun 10 12:03:27.887216 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.887183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef1d7611-7c83-45a2-a745-5316819c5e9d-tls-certs\") pod \"kube-auth-proxy-cb945c55-cm2vl\" (UID: \"ef1d7611-7c83-45a2-a745-5316819c5e9d\") " pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" Jun 10 12:03:27.887352 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.887227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s97w5\" (UniqueName: \"kubernetes.io/projected/ef1d7611-7c83-45a2-a745-5316819c5e9d-kube-api-access-s97w5\") pod \"kube-auth-proxy-cb945c55-cm2vl\" (UID: \"ef1d7611-7c83-45a2-a745-5316819c5e9d\") " pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" Jun 10 12:03:27.887352 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.887264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zz5t\" (UniqueName: \"kubernetes.io/projected/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-kube-api-access-4zz5t\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:27.887352 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.887329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:27.887456 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.887362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef1d7611-7c83-45a2-a745-5316819c5e9d-tmp\") pod \"kube-auth-proxy-cb945c55-cm2vl\" (UID: \"ef1d7611-7c83-45a2-a745-5316819c5e9d\") " pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" Jun 10 12:03:27.887456 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.887420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:27.988574 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.988536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s97w5\" (UniqueName: \"kubernetes.io/projected/ef1d7611-7c83-45a2-a745-5316819c5e9d-kube-api-access-s97w5\") pod \"kube-auth-proxy-cb945c55-cm2vl\" (UID: \"ef1d7611-7c83-45a2-a745-5316819c5e9d\") " pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" Jun 10 12:03:27.988809 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.988595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zz5t\" (UniqueName: \"kubernetes.io/projected/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-kube-api-access-4zz5t\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:27.988809 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.988662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:27.988809 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.988779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef1d7611-7c83-45a2-a745-5316819c5e9d-tmp\") pod \"kube-auth-proxy-cb945c55-cm2vl\" (UID: \"ef1d7611-7c83-45a2-a745-5316819c5e9d\") " pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" Jun 10 12:03:27.988985 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.988869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:27.988985 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.988924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef1d7611-7c83-45a2-a745-5316819c5e9d-tls-certs\") pod \"kube-auth-proxy-cb945c55-cm2vl\" (UID: \"ef1d7611-7c83-45a2-a745-5316819c5e9d\") " pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" Jun 10 12:03:27.989135 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.989116 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:27.989209 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.989169 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:27.990996 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.990976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef1d7611-7c83-45a2-a745-5316819c5e9d-tmp\") pod \"kube-auth-proxy-cb945c55-cm2vl\" (UID: \"ef1d7611-7c83-45a2-a745-5316819c5e9d\") " pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" Jun 10 12:03:27.991188 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:27.991171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef1d7611-7c83-45a2-a745-5316819c5e9d-tls-certs\") pod \"kube-auth-proxy-cb945c55-cm2vl\" (UID: \"ef1d7611-7c83-45a2-a745-5316819c5e9d\") " pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" Jun 10 12:03:28.003943 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:28.003915 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s97w5\" (UniqueName: \"kubernetes.io/projected/ef1d7611-7c83-45a2-a745-5316819c5e9d-kube-api-access-s97w5\") pod \"kube-auth-proxy-cb945c55-cm2vl\" (UID: \"ef1d7611-7c83-45a2-a745-5316819c5e9d\") " pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" Jun 10 12:03:28.004263 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:28.004243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zz5t\" (UniqueName: \"kubernetes.io/projected/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-kube-api-access-4zz5t\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:28.103124 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:28.103043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:28.132092 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:28.132063 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" Jun 10 12:03:28.272764 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:28.272724 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm"] Jun 10 12:03:28.277794 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:03:28.277765 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bc6bc3_921a_4ffc_adbe_64af59ddb52c.slice/crio-b96b7c45f26b6fbe1790aa284e8d5d253b87ca5753bbf07f468decbd6ff75c25 WatchSource:0}: Error finding container b96b7c45f26b6fbe1790aa284e8d5d253b87ca5753bbf07f468decbd6ff75c25: Status 404 returned error can't find the container with id b96b7c45f26b6fbe1790aa284e8d5d253b87ca5753bbf07f468decbd6ff75c25 Jun 10 12:03:28.284150 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:28.284119 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cb945c55-cm2vl"] Jun 10 12:03:28.286891 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:03:28.286867 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1d7611_7c83_45a2_a745_5316819c5e9d.slice/crio-5b2e8e1b589c4b9976a0a36bfa7fc4e51db12394a2d14d5adc96c70f0cefef51 WatchSource:0}: Error finding container 5b2e8e1b589c4b9976a0a36bfa7fc4e51db12394a2d14d5adc96c70f0cefef51: Status 404 returned error can't find the container with id 5b2e8e1b589c4b9976a0a36bfa7fc4e51db12394a2d14d5adc96c70f0cefef51 Jun 10 12:03:28.289148 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:28.289131 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:03:29.033657 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:29.033601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" event={"ID":"ef1d7611-7c83-45a2-a745-5316819c5e9d","Type":"ContainerStarted","Data":"5b2e8e1b589c4b9976a0a36bfa7fc4e51db12394a2d14d5adc96c70f0cefef51"} Jun 10 12:03:29.035547 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:29.035414 2576 generic.go:356] "Generic (PLEG): container finished" podID="77bc6bc3-921a-4ffc-adbe-64af59ddb52c" containerID="ee79072b16d9de444e4a62a8c7e784219eb01936e6e204e1516c49b77b613b9d" exitCode=0 Jun 10 12:03:29.035547 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:29.035476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" event={"ID":"77bc6bc3-921a-4ffc-adbe-64af59ddb52c","Type":"ContainerDied","Data":"ee79072b16d9de444e4a62a8c7e784219eb01936e6e204e1516c49b77b613b9d"} Jun 10 12:03:29.035547 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:29.035515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" event={"ID":"77bc6bc3-921a-4ffc-adbe-64af59ddb52c","Type":"ContainerStarted","Data":"b96b7c45f26b6fbe1790aa284e8d5d253b87ca5753bbf07f468decbd6ff75c25"} Jun 10 12:03:31.049817 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:31.049769 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" event={"ID":"77bc6bc3-921a-4ffc-adbe-64af59ddb52c","Type":"ContainerStarted","Data":"6aa55fdbd98ac5966f9a9c74f511d9e7a6e7ffad8baaf07077496ebd99f6c520"} Jun 10 12:03:32.056109 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:32.056075 2576 generic.go:356] "Generic (PLEG): container finished" podID="77bc6bc3-921a-4ffc-adbe-64af59ddb52c" containerID="6aa55fdbd98ac5966f9a9c74f511d9e7a6e7ffad8baaf07077496ebd99f6c520" exitCode=0 Jun 10 12:03:32.056565 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:32.056149 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" event={"ID":"77bc6bc3-921a-4ffc-adbe-64af59ddb52c","Type":"ContainerDied","Data":"6aa55fdbd98ac5966f9a9c74f511d9e7a6e7ffad8baaf07077496ebd99f6c520"} Jun 10 12:03:32.057819 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:32.057721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" event={"ID":"ef1d7611-7c83-45a2-a745-5316819c5e9d","Type":"ContainerStarted","Data":"0ef09ac751ea755fb40ec7778ec2d5c9e381b0322cecf85324c9585b44934702"} Jun 10 12:03:32.124808 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:32.124752 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cb945c55-cm2vl" podStartSLOduration=2.221937008 podStartE2EDuration="5.124729584s" totalImagesPullingTime="2.902792576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:32.123311799 +0000 UTC m=+322.202047541" watchObservedRunningTime="2026-06-10 12:03:32.124729584 +0000 UTC m=+322.203465329" Jun 10 12:03:33.065428 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.065351 2576 generic.go:356] "Generic (PLEG): container finished" podID="77bc6bc3-921a-4ffc-adbe-64af59ddb52c" containerID="7e54e6f72cdd0fd0c82502614f7eb2afeaf18b43b695574f68f418f2bd0e459b" exitCode=0 Jun 10 12:03:33.066155 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.065436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" event={"ID":"77bc6bc3-921a-4ffc-adbe-64af59ddb52c","Type":"ContainerDied","Data":"7e54e6f72cdd0fd0c82502614f7eb2afeaf18b43b695574f68f418f2bd0e459b"} Jun 10 12:03:33.757053 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.757016 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9"] Jun 10 12:03:33.761158 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.761140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.765176 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.765151 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vrkxr\"" Jun 10 12:03:33.770193 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.770167 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 12:03:33.770297 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.770249 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 12:03:33.770297 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.770260 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 12:03:33.777235 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.777213 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9"] Jun 10 12:03:33.841458 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.841421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt4lg\" (UniqueName: \"kubernetes.io/projected/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-kube-api-access-wt4lg\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.841630 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.841496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-cert\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.841630 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.841515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-metrics-cert\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.841630 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.841533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-manager-config\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.942818 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.942785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt4lg\" (UniqueName: \"kubernetes.io/projected/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-kube-api-access-wt4lg\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.942998 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.942928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-cert\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.942998 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.942952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-metrics-cert\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.942998 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.942973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-manager-config\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.943627 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.943609 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-manager-config\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.945541 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.945510 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-metrics-cert\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.945667 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.945542 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-cert\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:33.956509 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:33.956481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt4lg\" (UniqueName: \"kubernetes.io/projected/6fe688d7-09f4-4cb0-afc7-574e6cd26d21-kube-api-access-wt4lg\") pod \"lws-controller-manager-85c5ffbff9-2qrx9\" (UID: \"6fe688d7-09f4-4cb0-afc7-574e6cd26d21\") " pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:34.071181 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.070748 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:34.214394 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.214364 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:34.308071 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.308036 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9"] Jun 10 12:03:34.325709 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:03:34.325671 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe688d7_09f4_4cb0_afc7_574e6cd26d21.slice/crio-163841cc0459549c2c2853320ad71c4355243d9dcda742ea12d3b67fa5f929f4 WatchSource:0}: Error finding container 163841cc0459549c2c2853320ad71c4355243d9dcda742ea12d3b67fa5f929f4: Status 404 returned error can't find the container with id 163841cc0459549c2c2853320ad71c4355243d9dcda742ea12d3b67fa5f929f4 Jun 10 12:03:34.346441 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.346388 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zz5t\" (UniqueName: \"kubernetes.io/projected/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-kube-api-access-4zz5t\") pod \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " Jun 10 12:03:34.346611 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.346455 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-bundle\") pod \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " Jun 10 12:03:34.346611 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.346504 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-util\") pod \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\" (UID: \"77bc6bc3-921a-4ffc-adbe-64af59ddb52c\") " Jun 10 12:03:34.347568 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.347533 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-bundle" (OuterVolumeSpecName: "bundle") pod "77bc6bc3-921a-4ffc-adbe-64af59ddb52c" (UID: "77bc6bc3-921a-4ffc-adbe-64af59ddb52c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:03:34.349256 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.349219 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-kube-api-access-4zz5t" (OuterVolumeSpecName: "kube-api-access-4zz5t") pod "77bc6bc3-921a-4ffc-adbe-64af59ddb52c" (UID: "77bc6bc3-921a-4ffc-adbe-64af59ddb52c"). InnerVolumeSpecName "kube-api-access-4zz5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:03:34.352611 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.352582 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-util" (OuterVolumeSpecName: "util") pod "77bc6bc3-921a-4ffc-adbe-64af59ddb52c" (UID: "77bc6bc3-921a-4ffc-adbe-64af59ddb52c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:03:34.448063 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.448014 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zz5t\" (UniqueName: \"kubernetes.io/projected/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-kube-api-access-4zz5t\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:03:34.448063 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.448056 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:03:34.448063 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:34.448067 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77bc6bc3-921a-4ffc-adbe-64af59ddb52c-util\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:03:35.078096 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:35.078057 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" event={"ID":"77bc6bc3-921a-4ffc-adbe-64af59ddb52c","Type":"ContainerDied","Data":"b96b7c45f26b6fbe1790aa284e8d5d253b87ca5753bbf07f468decbd6ff75c25"} Jun 10 12:03:35.078681 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:35.078113 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b96b7c45f26b6fbe1790aa284e8d5d253b87ca5753bbf07f468decbd6ff75c25" Jun 10 12:03:35.078681 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:35.078077 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06zgvrm" Jun 10 12:03:35.079416 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:35.079384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" event={"ID":"6fe688d7-09f4-4cb0-afc7-574e6cd26d21","Type":"ContainerStarted","Data":"163841cc0459549c2c2853320ad71c4355243d9dcda742ea12d3b67fa5f929f4"} Jun 10 12:03:36.085503 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:36.085470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" event={"ID":"6fe688d7-09f4-4cb0-afc7-574e6cd26d21","Type":"ContainerStarted","Data":"8396efd28bc3b5ece0e85a77bdec1f45dc03b409c7f75365946fc150fc03ca69"} Jun 10 12:03:36.085950 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:36.085624 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:43.942994 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.942942 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" podStartSLOduration=9.370590235 podStartE2EDuration="10.942925447s" totalImagesPullingTime="1.572335212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:36.188971483 +0000 UTC m=+326.267707222" watchObservedRunningTime="2026-06-10 12:03:43.942925447 +0000 UTC m=+334.021661186" Jun 10 12:03:43.943404 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.943343 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg"] Jun 10 12:03:43.943693 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.943681 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bc6bc3-921a-4ffc-adbe-64af59ddb52c" containerName="extract" Jun 10 12:03:43.943740 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.943694 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bc6bc3-921a-4ffc-adbe-64af59ddb52c" containerName="extract" Jun 10 12:03:43.943740 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.943706 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bc6bc3-921a-4ffc-adbe-64af59ddb52c" containerName="pull" Jun 10 12:03:43.943740 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.943712 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bc6bc3-921a-4ffc-adbe-64af59ddb52c" containerName="pull" Jun 10 12:03:43.943740 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.943727 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bc6bc3-921a-4ffc-adbe-64af59ddb52c" containerName="util" Jun 10 12:03:43.943740 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.943733 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bc6bc3-921a-4ffc-adbe-64af59ddb52c" containerName="util" Jun 10 12:03:43.943920 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.943789 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="77bc6bc3-921a-4ffc-adbe-64af59ddb52c" containerName="extract" Jun 10 12:03:43.949970 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.949949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:43.965591 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.965560 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:03:43.967301 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.967280 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:03:43.967449 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.967344 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v8fj7\"" Jun 10 12:03:43.988555 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:43.988520 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg"] Jun 10 12:03:44.037955 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:44.037919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h25g9\" (UniqueName: \"kubernetes.io/projected/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-kube-api-access-h25g9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:44.038145 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:44.037983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:44.038145 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:44.038029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:44.139469 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:44.139434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h25g9\" (UniqueName: \"kubernetes.io/projected/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-kube-api-access-h25g9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:44.139678 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:44.139493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:44.139678 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:44.139533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:44.139913 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:44.139893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:44.139998 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:44.139961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:44.219314 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:44.219241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h25g9\" (UniqueName: \"kubernetes.io/projected/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-kube-api-access-h25g9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:44.259995 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:44.259955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:44.475082 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:44.474996 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg"] Jun 10 12:03:44.478955 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:03:44.478926 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f5f708_55a1_4cac_a7b6_6034dce3b0cf.slice/crio-71d3c58cfc33ab44b4537ccf85fc4f4c8a303736acc42e4a3b69d2b2b59ed7f5 WatchSource:0}: Error finding container 71d3c58cfc33ab44b4537ccf85fc4f4c8a303736acc42e4a3b69d2b2b59ed7f5: Status 404 returned error can't find the container with id 71d3c58cfc33ab44b4537ccf85fc4f4c8a303736acc42e4a3b69d2b2b59ed7f5 Jun 10 12:03:45.131728 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:45.131688 2576 generic.go:356] "Generic (PLEG): container finished" podID="d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" containerID="85ded147b0761b9e602501f6b97dca15d336d0ae7add297c481015895b22e113" exitCode=0 Jun 10 12:03:45.132141 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:45.131766 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" event={"ID":"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf","Type":"ContainerDied","Data":"85ded147b0761b9e602501f6b97dca15d336d0ae7add297c481015895b22e113"} Jun 10 12:03:45.132141 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:45.131816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" event={"ID":"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf","Type":"ContainerStarted","Data":"71d3c58cfc33ab44b4537ccf85fc4f4c8a303736acc42e4a3b69d2b2b59ed7f5"} Jun 10 12:03:47.093454 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:47.093423 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85c5ffbff9-2qrx9" Jun 10 12:03:48.149710 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:48.149678 2576 generic.go:356] "Generic (PLEG): container finished" podID="d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" containerID="238933c9638c8ab2243b8796f3db52f611d5f34ec12b577ff21a893f8fcfab3e" exitCode=0 Jun 10 12:03:48.150210 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:48.149750 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" event={"ID":"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf","Type":"ContainerDied","Data":"238933c9638c8ab2243b8796f3db52f611d5f34ec12b577ff21a893f8fcfab3e"} Jun 10 12:03:49.157190 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:49.157156 2576 generic.go:356] "Generic (PLEG): container finished" podID="d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" containerID="89419b434608fc2f2cd50c41ff9178e1f1fc2fed757c3f2b203165bf658b9d69" exitCode=0 Jun 10 12:03:49.157676 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:49.157240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" event={"ID":"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf","Type":"ContainerDied","Data":"89419b434608fc2f2cd50c41ff9178e1f1fc2fed757c3f2b203165bf658b9d69"} Jun 10 12:03:50.297654 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:50.297618 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:50.390493 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:50.390463 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-bundle\") pod \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " Jun 10 12:03:50.390683 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:50.390500 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h25g9\" (UniqueName: \"kubernetes.io/projected/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-kube-api-access-h25g9\") pod \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " Jun 10 12:03:50.390683 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:50.390557 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-util\") pod \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\" (UID: \"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf\") " Jun 10 12:03:50.391468 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:50.391433 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-bundle" (OuterVolumeSpecName: "bundle") pod "d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" (UID: "d0f5f708-55a1-4cac-a7b6-6034dce3b0cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:03:50.392571 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:50.392548 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-kube-api-access-h25g9" (OuterVolumeSpecName: "kube-api-access-h25g9") pod "d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" (UID: "d0f5f708-55a1-4cac-a7b6-6034dce3b0cf"). InnerVolumeSpecName "kube-api-access-h25g9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:03:50.395249 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:50.395224 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-util" (OuterVolumeSpecName: "util") pod "d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" (UID: "d0f5f708-55a1-4cac-a7b6-6034dce3b0cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:03:50.492002 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:50.491914 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:03:50.492002 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:50.491953 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h25g9\" (UniqueName: \"kubernetes.io/projected/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-kube-api-access-h25g9\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:03:50.492002 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:50.491963 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0f5f708-55a1-4cac-a7b6-6034dce3b0cf-util\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:03:51.169249 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:51.169217 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" Jun 10 12:03:51.169456 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:51.169243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abn8mg" event={"ID":"d0f5f708-55a1-4cac-a7b6-6034dce3b0cf","Type":"ContainerDied","Data":"71d3c58cfc33ab44b4537ccf85fc4f4c8a303736acc42e4a3b69d2b2b59ed7f5"} Jun 10 12:03:51.169456 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:03:51.169331 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71d3c58cfc33ab44b4537ccf85fc4f4c8a303736acc42e4a3b69d2b2b59ed7f5" Jun 10 12:04:41.344149 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.344117 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2"] Jun 10 12:04:41.344612 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.344457 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" containerName="extract" Jun 10 12:04:41.344612 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.344467 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" containerName="extract" Jun 10 12:04:41.344612 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.344479 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" containerName="pull" Jun 10 12:04:41.344612 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.344485 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" containerName="pull" Jun 10 12:04:41.344612 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.344496 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" containerName="util" Jun 10 12:04:41.344612 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.344501 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" containerName="util" Jun 10 12:04:41.344612 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.344576 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0f5f708-55a1-4cac-a7b6-6034dce3b0cf" containerName="extract" Jun 10 12:04:41.347817 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.347799 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:41.350800 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.350778 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bq68q\"" Jun 10 12:04:41.351268 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.351248 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 12:04:41.351853 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.351840 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 12:04:41.359162 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.359139 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2"] Jun 10 12:04:41.454982 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.454949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx9bs\" (UniqueName: \"kubernetes.io/projected/4e1476ab-737e-43af-8086-02bbdb9e2c8b-kube-api-access-rx9bs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:41.455179 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.455004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:41.455179 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.455033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:41.555672 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.555591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:41.555672 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.555672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:41.555926 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.555764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx9bs\" (UniqueName: \"kubernetes.io/projected/4e1476ab-737e-43af-8086-02bbdb9e2c8b-kube-api-access-rx9bs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:41.556122 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.556095 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:41.556122 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.556111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:41.566494 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.566469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx9bs\" (UniqueName: \"kubernetes.io/projected/4e1476ab-737e-43af-8086-02bbdb9e2c8b-kube-api-access-rx9bs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:41.657058 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.657027 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:41.768205 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.768174 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf"] Jun 10 12:04:41.772053 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.772030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:41.785204 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.785177 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf"] Jun 10 12:04:41.807464 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.807439 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2"] Jun 10 12:04:41.809321 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:04:41.809299 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1476ab_737e_43af_8086_02bbdb9e2c8b.slice/crio-edc846c39cf85ea39848d827265c361efa07d089afe8ef841c22a0b44f318a1e WatchSource:0}: Error finding container edc846c39cf85ea39848d827265c361efa07d089afe8ef841c22a0b44f318a1e: Status 404 returned error can't find the container with id edc846c39cf85ea39848d827265c361efa07d089afe8ef841c22a0b44f318a1e Jun 10 12:04:41.859006 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.858981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:41.859122 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.859013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:41.859122 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.859045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w45cf\" (UniqueName: \"kubernetes.io/projected/74020732-2d5e-45b9-bea7-a264c3053dda-kube-api-access-w45cf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:41.960463 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.960430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:41.960463 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.960465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:41.960702 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.960494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w45cf\" (UniqueName: \"kubernetes.io/projected/74020732-2d5e-45b9-bea7-a264c3053dda-kube-api-access-w45cf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:41.960845 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.960826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:41.960885 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.960843 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:41.970940 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:41.970917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w45cf\" (UniqueName: \"kubernetes.io/projected/74020732-2d5e-45b9-bea7-a264c3053dda-kube-api-access-w45cf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:42.083934 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.083901 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:42.136358 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.136324 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75"] Jun 10 12:04:42.142289 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.140868 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:42.149346 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.149290 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75"] Jun 10 12:04:42.163740 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.163168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:42.163740 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.163220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7zjh\" (UniqueName: \"kubernetes.io/projected/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-kube-api-access-j7zjh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:42.163740 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.163291 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:42.225603 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.225577 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf"] Jun 10 12:04:42.227417 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:04:42.227390 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74020732_2d5e_45b9_bea7_a264c3053dda.slice/crio-6bf270215dce7d0197702e1fec0b704bc404c76e1df4935b956d32a420a17ca2 WatchSource:0}: Error finding container 6bf270215dce7d0197702e1fec0b704bc404c76e1df4935b956d32a420a17ca2: Status 404 returned error can't find the container with id 6bf270215dce7d0197702e1fec0b704bc404c76e1df4935b956d32a420a17ca2 Jun 10 12:04:42.264171 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.264141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7zjh\" (UniqueName: \"kubernetes.io/projected/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-kube-api-access-j7zjh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:42.264317 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.264225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:42.264390 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.264319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:42.264595 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.264573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:42.264683 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.264606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:42.274250 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.274227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7zjh\" (UniqueName: \"kubernetes.io/projected/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-kube-api-access-j7zjh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:42.434498 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.434401 2576 generic.go:356] "Generic (PLEG): container finished" podID="74020732-2d5e-45b9-bea7-a264c3053dda" containerID="709f385b314790f7f891e5e07a4656d2cf5c0c734226193d9cb9b5add592e4c8" exitCode=0 Jun 10 12:04:42.434498 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.434474 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" event={"ID":"74020732-2d5e-45b9-bea7-a264c3053dda","Type":"ContainerDied","Data":"709f385b314790f7f891e5e07a4656d2cf5c0c734226193d9cb9b5add592e4c8"} Jun 10 12:04:42.434986 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.434515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" event={"ID":"74020732-2d5e-45b9-bea7-a264c3053dda","Type":"ContainerStarted","Data":"6bf270215dce7d0197702e1fec0b704bc404c76e1df4935b956d32a420a17ca2"} Jun 10 12:04:42.436051 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.436029 2576 generic.go:356] "Generic (PLEG): container finished" podID="4e1476ab-737e-43af-8086-02bbdb9e2c8b" containerID="9dee406ca8ebd2fe8a8af5798219bc7a78bff646ffb2ee05924dbff0d4a2ea3e" exitCode=0 Jun 10 12:04:42.436146 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.436113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" event={"ID":"4e1476ab-737e-43af-8086-02bbdb9e2c8b","Type":"ContainerDied","Data":"9dee406ca8ebd2fe8a8af5798219bc7a78bff646ffb2ee05924dbff0d4a2ea3e"} Jun 10 12:04:42.436211 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.436162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" event={"ID":"4e1476ab-737e-43af-8086-02bbdb9e2c8b","Type":"ContainerStarted","Data":"edc846c39cf85ea39848d827265c361efa07d089afe8ef841c22a0b44f318a1e"} Jun 10 12:04:42.453192 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.453154 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:42.552158 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.552127 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8"] Jun 10 12:04:42.555853 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.555837 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:42.568068 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.568040 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8"] Jun 10 12:04:42.620234 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.620207 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75"] Jun 10 12:04:42.621718 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:04:42.621689 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d4aa2e_b920_4472_a1e1_4439fb9813bd.slice/crio-0b8c0713c87681c44980a8cae03360e36fab754b1c726f78b032644301f91f1e WatchSource:0}: Error finding container 0b8c0713c87681c44980a8cae03360e36fab754b1c726f78b032644301f91f1e: Status 404 returned error can't find the container with id 0b8c0713c87681c44980a8cae03360e36fab754b1c726f78b032644301f91f1e Jun 10 12:04:42.669750 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.669724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:42.669881 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.669761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:42.669881 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.669808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7sct\" (UniqueName: \"kubernetes.io/projected/80c6e0b2-5771-43c7-9692-8fd10030a7a3-kube-api-access-q7sct\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:42.771007 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.770971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:42.771007 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.771013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:42.771275 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.771062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7sct\" (UniqueName: \"kubernetes.io/projected/80c6e0b2-5771-43c7-9692-8fd10030a7a3-kube-api-access-q7sct\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:42.771349 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.771330 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:42.771406 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.771385 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:42.781649 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.781612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7sct\" (UniqueName: \"kubernetes.io/projected/80c6e0b2-5771-43c7-9692-8fd10030a7a3-kube-api-access-q7sct\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:42.869653 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:42.869603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:43.014864 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:43.014835 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8"] Jun 10 12:04:43.017344 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:04:43.017319 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c6e0b2_5771_43c7_9692_8fd10030a7a3.slice/crio-8d1887c3383dd9f7553f92a1867957df16faae04f25d1fbc3e97bd0d67aff352 WatchSource:0}: Error finding container 8d1887c3383dd9f7553f92a1867957df16faae04f25d1fbc3e97bd0d67aff352: Status 404 returned error can't find the container with id 8d1887c3383dd9f7553f92a1867957df16faae04f25d1fbc3e97bd0d67aff352 Jun 10 12:04:43.450213 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:43.450177 2576 generic.go:356] "Generic (PLEG): container finished" podID="74020732-2d5e-45b9-bea7-a264c3053dda" containerID="c6f7a4e2fa69f182eb3ac7ab67e9be7b46dcedfee4573064b5141aeaa125e7ef" exitCode=0 Jun 10 12:04:43.450701 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:43.450262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" event={"ID":"74020732-2d5e-45b9-bea7-a264c3053dda","Type":"ContainerDied","Data":"c6f7a4e2fa69f182eb3ac7ab67e9be7b46dcedfee4573064b5141aeaa125e7ef"} Jun 10 12:04:43.452065 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:43.452042 2576 generic.go:356] "Generic (PLEG): container finished" podID="4e1476ab-737e-43af-8086-02bbdb9e2c8b" containerID="1ab3b302cdb10862e91ff12ec98e09f937778790c151cc9529dd0adcf2f30a5a" exitCode=0 Jun 10 12:04:43.452173 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:43.452104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" event={"ID":"4e1476ab-737e-43af-8086-02bbdb9e2c8b","Type":"ContainerDied","Data":"1ab3b302cdb10862e91ff12ec98e09f937778790c151cc9529dd0adcf2f30a5a"} Jun 10 12:04:43.453603 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:43.453580 2576 generic.go:356] "Generic (PLEG): container finished" podID="f6d4aa2e-b920-4472-a1e1-4439fb9813bd" containerID="840fe02a8381fe8a57602cb565355d487bda06fd4f81cd24b72b371b732717dc" exitCode=0 Jun 10 12:04:43.453708 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:43.453673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" event={"ID":"f6d4aa2e-b920-4472-a1e1-4439fb9813bd","Type":"ContainerDied","Data":"840fe02a8381fe8a57602cb565355d487bda06fd4f81cd24b72b371b732717dc"} Jun 10 12:04:43.453777 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:43.453729 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" event={"ID":"f6d4aa2e-b920-4472-a1e1-4439fb9813bd","Type":"ContainerStarted","Data":"0b8c0713c87681c44980a8cae03360e36fab754b1c726f78b032644301f91f1e"} Jun 10 12:04:43.455182 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:43.455162 2576 generic.go:356] "Generic (PLEG): container finished" podID="80c6e0b2-5771-43c7-9692-8fd10030a7a3" containerID="005a469ede824f2155245cf59d001187668385437eb9824abe6c9030ae2a35bb" exitCode=0 Jun 10 12:04:43.455310 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:43.455292 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" event={"ID":"80c6e0b2-5771-43c7-9692-8fd10030a7a3","Type":"ContainerDied","Data":"005a469ede824f2155245cf59d001187668385437eb9824abe6c9030ae2a35bb"} Jun 10 12:04:43.455383 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:43.455330 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" event={"ID":"80c6e0b2-5771-43c7-9692-8fd10030a7a3","Type":"ContainerStarted","Data":"8d1887c3383dd9f7553f92a1867957df16faae04f25d1fbc3e97bd0d67aff352"} Jun 10 12:04:44.462946 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:44.462858 2576 generic.go:356] "Generic (PLEG): container finished" podID="74020732-2d5e-45b9-bea7-a264c3053dda" containerID="7d8212f93f663d507a1aee4117e7f8d57565b6b16d002de681bbebb344c061e6" exitCode=0 Jun 10 12:04:44.463362 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:44.462939 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" event={"ID":"74020732-2d5e-45b9-bea7-a264c3053dda","Type":"ContainerDied","Data":"7d8212f93f663d507a1aee4117e7f8d57565b6b16d002de681bbebb344c061e6"} Jun 10 12:04:44.464942 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:44.464922 2576 generic.go:356] "Generic (PLEG): container finished" podID="4e1476ab-737e-43af-8086-02bbdb9e2c8b" containerID="2b575844a2c6855f0901372e05f2b16fdda265d1846503bfafbe0e2f89f93311" exitCode=0 Jun 10 12:04:44.465057 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:44.464982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" event={"ID":"4e1476ab-737e-43af-8086-02bbdb9e2c8b","Type":"ContainerDied","Data":"2b575844a2c6855f0901372e05f2b16fdda265d1846503bfafbe0e2f89f93311"} Jun 10 12:04:44.466749 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:44.466730 2576 generic.go:356] "Generic (PLEG): container finished" podID="f6d4aa2e-b920-4472-a1e1-4439fb9813bd" containerID="76427b93bb37a6f9e4590b6b5d3ca39ad46ae27b73c46b098e771f552622bfbf" exitCode=0 Jun 10 12:04:44.466853 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:44.466799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" event={"ID":"f6d4aa2e-b920-4472-a1e1-4439fb9813bd","Type":"ContainerDied","Data":"76427b93bb37a6f9e4590b6b5d3ca39ad46ae27b73c46b098e771f552622bfbf"} Jun 10 12:04:44.468702 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:44.468682 2576 generic.go:356] "Generic (PLEG): container finished" podID="80c6e0b2-5771-43c7-9692-8fd10030a7a3" containerID="6414c5e1f660c2c1303b502273dc1721f42132a3ba2a95d64c76493c503a543c" exitCode=0 Jun 10 12:04:44.468763 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:44.468705 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" event={"ID":"80c6e0b2-5771-43c7-9692-8fd10030a7a3","Type":"ContainerDied","Data":"6414c5e1f660c2c1303b502273dc1721f42132a3ba2a95d64c76493c503a543c"} Jun 10 12:04:45.477092 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.477050 2576 generic.go:356] "Generic (PLEG): container finished" podID="f6d4aa2e-b920-4472-a1e1-4439fb9813bd" containerID="ffb43d126096b6b64cd1bf3c94f090865ecbcb27d5e475a01d2df8ee422192ae" exitCode=0 Jun 10 12:04:45.477810 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.477132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" event={"ID":"f6d4aa2e-b920-4472-a1e1-4439fb9813bd","Type":"ContainerDied","Data":"ffb43d126096b6b64cd1bf3c94f090865ecbcb27d5e475a01d2df8ee422192ae"} Jun 10 12:04:45.479264 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.479243 2576 generic.go:356] "Generic (PLEG): container finished" podID="80c6e0b2-5771-43c7-9692-8fd10030a7a3" containerID="59d712b41ee908dbea2a538eda7b876618a14d9a1eea09ac525cf886814d179f" exitCode=0 Jun 10 12:04:45.479380 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.479309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" event={"ID":"80c6e0b2-5771-43c7-9692-8fd10030a7a3","Type":"ContainerDied","Data":"59d712b41ee908dbea2a538eda7b876618a14d9a1eea09ac525cf886814d179f"} Jun 10 12:04:45.637152 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.637130 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:45.639800 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.639782 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:45.699171 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.699121 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-util\") pod \"74020732-2d5e-45b9-bea7-a264c3053dda\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " Jun 10 12:04:45.699171 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.699177 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-bundle\") pod \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " Jun 10 12:04:45.699429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.699211 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx9bs\" (UniqueName: \"kubernetes.io/projected/4e1476ab-737e-43af-8086-02bbdb9e2c8b-kube-api-access-rx9bs\") pod \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " Jun 10 12:04:45.699429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.699254 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-util\") pod \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\" (UID: \"4e1476ab-737e-43af-8086-02bbdb9e2c8b\") " Jun 10 12:04:45.699429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.699282 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-bundle\") pod \"74020732-2d5e-45b9-bea7-a264c3053dda\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " Jun 10 12:04:45.699429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.699309 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w45cf\" (UniqueName: \"kubernetes.io/projected/74020732-2d5e-45b9-bea7-a264c3053dda-kube-api-access-w45cf\") pod \"74020732-2d5e-45b9-bea7-a264c3053dda\" (UID: \"74020732-2d5e-45b9-bea7-a264c3053dda\") " Jun 10 12:04:45.700131 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.700099 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-bundle" (OuterVolumeSpecName: "bundle") pod "4e1476ab-737e-43af-8086-02bbdb9e2c8b" (UID: "4e1476ab-737e-43af-8086-02bbdb9e2c8b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:04:45.700249 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.700226 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-bundle" (OuterVolumeSpecName: "bundle") pod "74020732-2d5e-45b9-bea7-a264c3053dda" (UID: "74020732-2d5e-45b9-bea7-a264c3053dda"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:04:45.701838 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.701787 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74020732-2d5e-45b9-bea7-a264c3053dda-kube-api-access-w45cf" (OuterVolumeSpecName: "kube-api-access-w45cf") pod "74020732-2d5e-45b9-bea7-a264c3053dda" (UID: "74020732-2d5e-45b9-bea7-a264c3053dda"). InnerVolumeSpecName "kube-api-access-w45cf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:04:45.701959 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.701935 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e1476ab-737e-43af-8086-02bbdb9e2c8b-kube-api-access-rx9bs" (OuterVolumeSpecName: "kube-api-access-rx9bs") pod "4e1476ab-737e-43af-8086-02bbdb9e2c8b" (UID: "4e1476ab-737e-43af-8086-02bbdb9e2c8b"). InnerVolumeSpecName "kube-api-access-rx9bs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:04:45.707326 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.707301 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-util" (OuterVolumeSpecName: "util") pod "74020732-2d5e-45b9-bea7-a264c3053dda" (UID: "74020732-2d5e-45b9-bea7-a264c3053dda"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:04:45.708487 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.708464 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-util" (OuterVolumeSpecName: "util") pod "4e1476ab-737e-43af-8086-02bbdb9e2c8b" (UID: "4e1476ab-737e-43af-8086-02bbdb9e2c8b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:04:45.801071 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.800964 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-util\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:45.801071 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.801012 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:45.801071 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.801022 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w45cf\" (UniqueName: \"kubernetes.io/projected/74020732-2d5e-45b9-bea7-a264c3053dda-kube-api-access-w45cf\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:45.801071 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.801030 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74020732-2d5e-45b9-bea7-a264c3053dda-util\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:45.801071 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.801039 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e1476ab-737e-43af-8086-02bbdb9e2c8b-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:45.801071 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:45.801046 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx9bs\" (UniqueName: \"kubernetes.io/projected/4e1476ab-737e-43af-8086-02bbdb9e2c8b-kube-api-access-rx9bs\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:46.487025 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.486989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" event={"ID":"74020732-2d5e-45b9-bea7-a264c3053dda","Type":"ContainerDied","Data":"6bf270215dce7d0197702e1fec0b704bc404c76e1df4935b956d32a420a17ca2"} Jun 10 12:04:46.487025 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.487007 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf" Jun 10 12:04:46.487478 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.487068 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bf270215dce7d0197702e1fec0b704bc404c76e1df4935b956d32a420a17ca2" Jun 10 12:04:46.489099 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.489079 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" Jun 10 12:04:46.489259 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.489089 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2" event={"ID":"4e1476ab-737e-43af-8086-02bbdb9e2c8b","Type":"ContainerDied","Data":"edc846c39cf85ea39848d827265c361efa07d089afe8ef841c22a0b44f318a1e"} Jun 10 12:04:46.489366 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.489298 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edc846c39cf85ea39848d827265c361efa07d089afe8ef841c22a0b44f318a1e" Jun 10 12:04:46.628560 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.628535 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:46.660790 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.660765 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:46.709738 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.709708 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-bundle\") pod \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " Jun 10 12:04:46.709933 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.709792 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-bundle\") pod \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " Jun 10 12:04:46.709933 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.709829 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-util\") pod \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " Jun 10 12:04:46.709933 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.709848 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7zjh\" (UniqueName: \"kubernetes.io/projected/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-kube-api-access-j7zjh\") pod \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\" (UID: \"f6d4aa2e-b920-4472-a1e1-4439fb9813bd\") " Jun 10 12:04:46.709933 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.709904 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7sct\" (UniqueName: \"kubernetes.io/projected/80c6e0b2-5771-43c7-9692-8fd10030a7a3-kube-api-access-q7sct\") pod \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " Jun 10 12:04:46.709933 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.709922 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-util\") pod \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\" (UID: \"80c6e0b2-5771-43c7-9692-8fd10030a7a3\") " Jun 10 12:04:46.710360 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.710328 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-bundle" (OuterVolumeSpecName: "bundle") pod "f6d4aa2e-b920-4472-a1e1-4439fb9813bd" (UID: "f6d4aa2e-b920-4472-a1e1-4439fb9813bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:04:46.710516 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.710498 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-bundle" (OuterVolumeSpecName: "bundle") pod "80c6e0b2-5771-43c7-9692-8fd10030a7a3" (UID: "80c6e0b2-5771-43c7-9692-8fd10030a7a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:04:46.712194 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.712164 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-kube-api-access-j7zjh" (OuterVolumeSpecName: "kube-api-access-j7zjh") pod "f6d4aa2e-b920-4472-a1e1-4439fb9813bd" (UID: "f6d4aa2e-b920-4472-a1e1-4439fb9813bd"). InnerVolumeSpecName "kube-api-access-j7zjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:04:46.712497 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.712471 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c6e0b2-5771-43c7-9692-8fd10030a7a3-kube-api-access-q7sct" (OuterVolumeSpecName: "kube-api-access-q7sct") pod "80c6e0b2-5771-43c7-9692-8fd10030a7a3" (UID: "80c6e0b2-5771-43c7-9692-8fd10030a7a3"). InnerVolumeSpecName "kube-api-access-q7sct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:04:46.715895 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.715870 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-util" (OuterVolumeSpecName: "util") pod "80c6e0b2-5771-43c7-9692-8fd10030a7a3" (UID: "80c6e0b2-5771-43c7-9692-8fd10030a7a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:04:46.716214 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.716194 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-util" (OuterVolumeSpecName: "util") pod "f6d4aa2e-b920-4472-a1e1-4439fb9813bd" (UID: "f6d4aa2e-b920-4472-a1e1-4439fb9813bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:04:46.810970 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.810936 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7sct\" (UniqueName: \"kubernetes.io/projected/80c6e0b2-5771-43c7-9692-8fd10030a7a3-kube-api-access-q7sct\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:46.810970 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.810964 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-util\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:46.810970 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.810975 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80c6e0b2-5771-43c7-9692-8fd10030a7a3-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:46.811200 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.810983 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:46.811200 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.810991 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-util\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:46.811200 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:46.810999 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7zjh\" (UniqueName: \"kubernetes.io/projected/f6d4aa2e-b920-4472-a1e1-4439fb9813bd-kube-api-access-j7zjh\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:04:47.495770 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:47.495735 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" event={"ID":"f6d4aa2e-b920-4472-a1e1-4439fb9813bd","Type":"ContainerDied","Data":"0b8c0713c87681c44980a8cae03360e36fab754b1c726f78b032644301f91f1e"} Jun 10 12:04:47.496182 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:47.495787 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b8c0713c87681c44980a8cae03360e36fab754b1c726f78b032644301f91f1e" Jun 10 12:04:47.496182 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:47.495747 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75" Jun 10 12:04:47.497541 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:47.497518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" event={"ID":"80c6e0b2-5771-43c7-9692-8fd10030a7a3","Type":"ContainerDied","Data":"8d1887c3383dd9f7553f92a1867957df16faae04f25d1fbc3e97bd0d67aff352"} Jun 10 12:04:47.497617 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:47.497564 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8" Jun 10 12:04:47.497673 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:04:47.497563 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d1887c3383dd9f7553f92a1867957df16faae04f25d1fbc3e97bd0d67aff352" Jun 10 12:05:03.092997 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:03.092941 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6bc5c76f-ntp4h"] Jun 10 12:05:11.023895 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.023860 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-njksc"] Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024224 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d4aa2e-b920-4472-a1e1-4439fb9813bd" containerName="extract" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024236 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d4aa2e-b920-4472-a1e1-4439fb9813bd" containerName="extract" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024245 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c6e0b2-5771-43c7-9692-8fd10030a7a3" containerName="pull" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024251 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c6e0b2-5771-43c7-9692-8fd10030a7a3" containerName="pull" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024258 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c6e0b2-5771-43c7-9692-8fd10030a7a3" containerName="extract" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024264 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c6e0b2-5771-43c7-9692-8fd10030a7a3" containerName="extract" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024273 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e1476ab-737e-43af-8086-02bbdb9e2c8b" containerName="pull" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024278 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e1476ab-737e-43af-8086-02bbdb9e2c8b" containerName="pull" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024283 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e1476ab-737e-43af-8086-02bbdb9e2c8b" containerName="extract" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024288 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e1476ab-737e-43af-8086-02bbdb9e2c8b" containerName="extract" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024299 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74020732-2d5e-45b9-bea7-a264c3053dda" containerName="util" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024304 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="74020732-2d5e-45b9-bea7-a264c3053dda" containerName="util" Jun 10 12:05:11.024306 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024313 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d4aa2e-b920-4472-a1e1-4439fb9813bd" containerName="pull" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024318 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d4aa2e-b920-4472-a1e1-4439fb9813bd" containerName="pull" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024325 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74020732-2d5e-45b9-bea7-a264c3053dda" containerName="pull" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024329 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="74020732-2d5e-45b9-bea7-a264c3053dda" containerName="pull" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024337 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e1476ab-737e-43af-8086-02bbdb9e2c8b" containerName="util" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024341 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e1476ab-737e-43af-8086-02bbdb9e2c8b" containerName="util" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024350 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d4aa2e-b920-4472-a1e1-4439fb9813bd" containerName="util" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024356 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d4aa2e-b920-4472-a1e1-4439fb9813bd" containerName="util" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024364 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c6e0b2-5771-43c7-9692-8fd10030a7a3" containerName="util" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024369 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c6e0b2-5771-43c7-9692-8fd10030a7a3" containerName="util" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024374 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74020732-2d5e-45b9-bea7-a264c3053dda" containerName="extract" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024379 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="74020732-2d5e-45b9-bea7-a264c3053dda" containerName="extract" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024442 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c6e0b2-5771-43c7-9692-8fd10030a7a3" containerName="extract" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024452 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e1476ab-737e-43af-8086-02bbdb9e2c8b" containerName="extract" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024458 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="74020732-2d5e-45b9-bea7-a264c3053dda" containerName="extract" Jun 10 12:05:11.024691 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.024465 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6d4aa2e-b920-4472-a1e1-4439fb9813bd" containerName="extract" Jun 10 12:05:11.027540 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.027522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" Jun 10 12:05:11.036334 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.036307 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 10 12:05:11.036471 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.036334 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 10 12:05:11.036471 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.036369 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 12:05:11.036471 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.036452 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 12:05:11.036676 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.036585 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bq68q\"" Jun 10 12:05:11.044852 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.044828 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-njksc"] Jun 10 12:05:11.128670 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.128604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7gj6\" (UniqueName: \"kubernetes.io/projected/c427c5be-fad7-4f3f-94d5-28af3928822a-kube-api-access-c7gj6\") pod \"kuadrant-console-plugin-66b5774985-njksc\" (UID: \"c427c5be-fad7-4f3f-94d5-28af3928822a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" Jun 10 12:05:11.128912 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.128747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c427c5be-fad7-4f3f-94d5-28af3928822a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-njksc\" (UID: \"c427c5be-fad7-4f3f-94d5-28af3928822a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" Jun 10 12:05:11.128912 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.128789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c427c5be-fad7-4f3f-94d5-28af3928822a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-njksc\" (UID: \"c427c5be-fad7-4f3f-94d5-28af3928822a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" Jun 10 12:05:11.229491 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.229456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c427c5be-fad7-4f3f-94d5-28af3928822a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-njksc\" (UID: \"c427c5be-fad7-4f3f-94d5-28af3928822a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" Jun 10 12:05:11.229654 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.229496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c427c5be-fad7-4f3f-94d5-28af3928822a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-njksc\" (UID: \"c427c5be-fad7-4f3f-94d5-28af3928822a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" Jun 10 12:05:11.229654 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.229551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7gj6\" (UniqueName: \"kubernetes.io/projected/c427c5be-fad7-4f3f-94d5-28af3928822a-kube-api-access-c7gj6\") pod \"kuadrant-console-plugin-66b5774985-njksc\" (UID: \"c427c5be-fad7-4f3f-94d5-28af3928822a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" Jun 10 12:05:11.230226 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.230203 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c427c5be-fad7-4f3f-94d5-28af3928822a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-njksc\" (UID: \"c427c5be-fad7-4f3f-94d5-28af3928822a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" Jun 10 12:05:11.231955 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.231924 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c427c5be-fad7-4f3f-94d5-28af3928822a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-njksc\" (UID: \"c427c5be-fad7-4f3f-94d5-28af3928822a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" Jun 10 12:05:11.242519 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.242491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7gj6\" (UniqueName: \"kubernetes.io/projected/c427c5be-fad7-4f3f-94d5-28af3928822a-kube-api-access-c7gj6\") pod \"kuadrant-console-plugin-66b5774985-njksc\" (UID: \"c427c5be-fad7-4f3f-94d5-28af3928822a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" Jun 10 12:05:11.337397 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.337291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" Jun 10 12:05:11.490247 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.490222 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-njksc"] Jun 10 12:05:11.492691 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:05:11.492664 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc427c5be_fad7_4f3f_94d5_28af3928822a.slice/crio-9bf04a7936ec2f763cc5bc20ddd2b737b9233b048f2d23bee720630167c5ae32 WatchSource:0}: Error finding container 9bf04a7936ec2f763cc5bc20ddd2b737b9233b048f2d23bee720630167c5ae32: Status 404 returned error can't find the container with id 9bf04a7936ec2f763cc5bc20ddd2b737b9233b048f2d23bee720630167c5ae32 Jun 10 12:05:11.629586 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:11.629492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" event={"ID":"c427c5be-fad7-4f3f-94d5-28af3928822a","Type":"ContainerStarted","Data":"9bf04a7936ec2f763cc5bc20ddd2b737b9233b048f2d23bee720630167c5ae32"} Jun 10 12:05:28.123395 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:28.123280 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b6bc5c76f-ntp4h" podUID="f37a2c18-91ef-4689-9fa7-4d958121798e" containerName="console" containerID="cri-o://e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506" gracePeriod=15 Jun 10 12:05:30.488438 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:30.488396 2576 patch_prober.go:28] interesting pod/console-7b6bc5c76f-ntp4h container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" start-of-body= Jun 10 12:05:30.488879 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:30.488466 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-7b6bc5c76f-ntp4h" podUID="f37a2c18-91ef-4689-9fa7-4d958121798e" containerName="console" probeResult="failure" output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" Jun 10 12:05:34.702542 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.702511 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:05:34.756275 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.756238 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-trusted-ca-bundle\") pod \"f37a2c18-91ef-4689-9fa7-4d958121798e\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " Jun 10 12:05:34.756455 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.756295 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-oauth-serving-cert\") pod \"f37a2c18-91ef-4689-9fa7-4d958121798e\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " Jun 10 12:05:34.756455 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.756320 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-serving-cert\") pod \"f37a2c18-91ef-4689-9fa7-4d958121798e\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " Jun 10 12:05:34.756455 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.756367 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-service-ca\") pod \"f37a2c18-91ef-4689-9fa7-4d958121798e\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " Jun 10 12:05:34.756455 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.756384 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjv5x\" (UniqueName: \"kubernetes.io/projected/f37a2c18-91ef-4689-9fa7-4d958121798e-kube-api-access-xjv5x\") pod \"f37a2c18-91ef-4689-9fa7-4d958121798e\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " Jun 10 12:05:34.756455 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.756405 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-console-config\") pod \"f37a2c18-91ef-4689-9fa7-4d958121798e\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " Jun 10 12:05:34.756455 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.756442 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-oauth-config\") pod \"f37a2c18-91ef-4689-9fa7-4d958121798e\" (UID: \"f37a2c18-91ef-4689-9fa7-4d958121798e\") " Jun 10 12:05:34.756862 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.756838 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f37a2c18-91ef-4689-9fa7-4d958121798e" (UID: "f37a2c18-91ef-4689-9fa7-4d958121798e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:05:34.756916 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.756845 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-service-ca" (OuterVolumeSpecName: "service-ca") pod "f37a2c18-91ef-4689-9fa7-4d958121798e" (UID: "f37a2c18-91ef-4689-9fa7-4d958121798e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:05:34.756916 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.756872 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f37a2c18-91ef-4689-9fa7-4d958121798e" (UID: "f37a2c18-91ef-4689-9fa7-4d958121798e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:05:34.757018 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.757001 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-console-config" (OuterVolumeSpecName: "console-config") pod "f37a2c18-91ef-4689-9fa7-4d958121798e" (UID: "f37a2c18-91ef-4689-9fa7-4d958121798e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:05:34.758621 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.758597 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f37a2c18-91ef-4689-9fa7-4d958121798e" (UID: "f37a2c18-91ef-4689-9fa7-4d958121798e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:05:34.758712 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.758618 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f37a2c18-91ef-4689-9fa7-4d958121798e" (UID: "f37a2c18-91ef-4689-9fa7-4d958121798e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:05:34.758712 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.758630 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37a2c18-91ef-4689-9fa7-4d958121798e-kube-api-access-xjv5x" (OuterVolumeSpecName: "kube-api-access-xjv5x") pod "f37a2c18-91ef-4689-9fa7-4d958121798e" (UID: "f37a2c18-91ef-4689-9fa7-4d958121798e"). InnerVolumeSpecName "kube-api-access-xjv5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:05:34.773627 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.773599 2576 generic.go:356] "Generic (PLEG): container finished" podID="f37a2c18-91ef-4689-9fa7-4d958121798e" containerID="e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506" exitCode=0 Jun 10 12:05:34.773772 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.773670 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6bc5c76f-ntp4h" Jun 10 12:05:34.773772 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.773680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6bc5c76f-ntp4h" event={"ID":"f37a2c18-91ef-4689-9fa7-4d958121798e","Type":"ContainerDied","Data":"e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506"} Jun 10 12:05:34.773772 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.773762 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6bc5c76f-ntp4h" event={"ID":"f37a2c18-91ef-4689-9fa7-4d958121798e","Type":"ContainerDied","Data":"002bf05a45d74dfcabe9e19ab03f796387fe4dcba5b6d814e71a7bd89ee7cb28"} Jun 10 12:05:34.773889 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.773789 2576 scope.go:117] "RemoveContainer" containerID="e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506" Jun 10 12:05:34.775400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.775374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" event={"ID":"c427c5be-fad7-4f3f-94d5-28af3928822a","Type":"ContainerStarted","Data":"5bf71e732a828a34347e307a9a47590cd935537c6acb077384f401e7054a2fa2"} Jun 10 12:05:34.782987 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.782969 2576 scope.go:117] "RemoveContainer" containerID="e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506" Jun 10 12:05:34.783229 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:05:34.783208 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506\": container with ID starting with e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506 not found: ID does not exist" containerID="e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506" Jun 10 12:05:34.783291 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.783237 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506"} err="failed to get container status \"e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506\": rpc error: code = NotFound desc = could not find container \"e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506\": container with ID starting with e0fe12cac49b3e4081efa920faaca1c44962aff3fd4366c1eeff7837515ac506 not found: ID does not exist" Jun 10 12:05:34.824955 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.824853 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-njksc" podStartSLOduration=0.695465105 podStartE2EDuration="23.824835672s" totalImagesPullingTime="23.129370567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:05:34.800799205 +0000 UTC m=+444.879534943" watchObservedRunningTime="2026-06-10 12:05:34.824835672 +0000 UTC m=+444.903571415" Jun 10 12:05:34.826766 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.826728 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6bc5c76f-ntp4h"] Jun 10 12:05:34.833744 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.833716 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b6bc5c76f-ntp4h"] Jun 10 12:05:34.857881 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.857850 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-serving-cert\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:05:34.857881 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.857877 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-service-ca\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:05:34.857881 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.857888 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjv5x\" (UniqueName: \"kubernetes.io/projected/f37a2c18-91ef-4689-9fa7-4d958121798e-kube-api-access-xjv5x\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:05:34.858099 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.857897 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-console-config\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:05:34.858099 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.857910 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f37a2c18-91ef-4689-9fa7-4d958121798e-console-oauth-config\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:05:34.858099 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.857923 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-trusted-ca-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:05:34.858099 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:34.857936 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f37a2c18-91ef-4689-9fa7-4d958121798e-oauth-serving-cert\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:05:36.350986 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:05:36.350949 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f37a2c18-91ef-4689-9fa7-4d958121798e" path="/var/lib/kubelet/pods/f37a2c18-91ef-4689-9fa7-4d958121798e/volumes" Jun 10 12:06:10.331084 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.331051 2576 scope.go:117] "RemoveContainer" containerID="2dd105089bbef37b08202565625ff83f6696f3ec169afe02b634c9f1ce15f192" Jun 10 12:06:10.488454 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.488417 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mnr5p"] Jun 10 12:06:10.488808 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.488796 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37a2c18-91ef-4689-9fa7-4d958121798e" containerName="console" Jun 10 12:06:10.488853 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.488810 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37a2c18-91ef-4689-9fa7-4d958121798e" containerName="console" Jun 10 12:06:10.488937 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.488874 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f37a2c18-91ef-4689-9fa7-4d958121798e" containerName="console" Jun 10 12:06:10.510540 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.510503 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mnr5p"] Jun 10 12:06:10.510740 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.510621 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mnr5p" Jun 10 12:06:10.515173 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.515149 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pdqqn\"" Jun 10 12:06:10.574586 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.574542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpndz\" (UniqueName: \"kubernetes.io/projected/a9533d32-133d-4d42-94c6-d5e4dcdbf819-kube-api-access-xpndz\") pod \"authorino-58cd955675-mnr5p\" (UID: \"a9533d32-133d-4d42-94c6-d5e4dcdbf819\") " pod="kuadrant-system/authorino-58cd955675-mnr5p" Jun 10 12:06:10.675385 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.675342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpndz\" (UniqueName: \"kubernetes.io/projected/a9533d32-133d-4d42-94c6-d5e4dcdbf819-kube-api-access-xpndz\") pod \"authorino-58cd955675-mnr5p\" (UID: \"a9533d32-133d-4d42-94c6-d5e4dcdbf819\") " pod="kuadrant-system/authorino-58cd955675-mnr5p" Jun 10 12:06:10.691450 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.691415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpndz\" (UniqueName: \"kubernetes.io/projected/a9533d32-133d-4d42-94c6-d5e4dcdbf819-kube-api-access-xpndz\") pod \"authorino-58cd955675-mnr5p\" (UID: \"a9533d32-133d-4d42-94c6-d5e4dcdbf819\") " pod="kuadrant-system/authorino-58cd955675-mnr5p" Jun 10 12:06:10.820224 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.820188 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mnr5p" Jun 10 12:06:10.960548 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.960517 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mnr5p"] Jun 10 12:06:10.962393 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:06:10.962362 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9533d32_133d_4d42_94c6_d5e4dcdbf819.slice/crio-11d1e3afb8435f3fcd514d955419b9fadc6cafbf1f35eddc40fa25f93376ca7f WatchSource:0}: Error finding container 11d1e3afb8435f3fcd514d955419b9fadc6cafbf1f35eddc40fa25f93376ca7f: Status 404 returned error can't find the container with id 11d1e3afb8435f3fcd514d955419b9fadc6cafbf1f35eddc40fa25f93376ca7f Jun 10 12:06:10.970892 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:10.970866 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mnr5p" event={"ID":"a9533d32-133d-4d42-94c6-d5e4dcdbf819","Type":"ContainerStarted","Data":"11d1e3afb8435f3fcd514d955419b9fadc6cafbf1f35eddc40fa25f93376ca7f"} Jun 10 12:06:11.111328 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:11.111291 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-btfxc"] Jun 10 12:06:11.115975 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:11.115955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btfxc" Jun 10 12:06:11.122829 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:11.122803 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btfxc"] Jun 10 12:06:11.178911 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:11.178878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5v8s\" (UniqueName: \"kubernetes.io/projected/647e4d07-547b-4c95-827f-685cd7e65d11-kube-api-access-q5v8s\") pod \"authorino-75d556bd77-btfxc\" (UID: \"647e4d07-547b-4c95-827f-685cd7e65d11\") " pod="kuadrant-system/authorino-75d556bd77-btfxc" Jun 10 12:06:11.280084 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:11.279978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5v8s\" (UniqueName: \"kubernetes.io/projected/647e4d07-547b-4c95-827f-685cd7e65d11-kube-api-access-q5v8s\") pod \"authorino-75d556bd77-btfxc\" (UID: \"647e4d07-547b-4c95-827f-685cd7e65d11\") " pod="kuadrant-system/authorino-75d556bd77-btfxc" Jun 10 12:06:11.295478 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:11.295447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5v8s\" (UniqueName: \"kubernetes.io/projected/647e4d07-547b-4c95-827f-685cd7e65d11-kube-api-access-q5v8s\") pod \"authorino-75d556bd77-btfxc\" (UID: \"647e4d07-547b-4c95-827f-685cd7e65d11\") " pod="kuadrant-system/authorino-75d556bd77-btfxc" Jun 10 12:06:11.426342 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:11.426307 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btfxc" Jun 10 12:06:11.568576 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:11.568549 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btfxc"] Jun 10 12:06:11.570452 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:06:11.570421 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod647e4d07_547b_4c95_827f_685cd7e65d11.slice/crio-0f5b65c43bd8d9c4971f8a3da3bfb502e69455ca350f701802bc4f2b59c1cdfe WatchSource:0}: Error finding container 0f5b65c43bd8d9c4971f8a3da3bfb502e69455ca350f701802bc4f2b59c1cdfe: Status 404 returned error can't find the container with id 0f5b65c43bd8d9c4971f8a3da3bfb502e69455ca350f701802bc4f2b59c1cdfe Jun 10 12:06:11.981444 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:11.981373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btfxc" event={"ID":"647e4d07-547b-4c95-827f-685cd7e65d11","Type":"ContainerStarted","Data":"0f5b65c43bd8d9c4971f8a3da3bfb502e69455ca350f701802bc4f2b59c1cdfe"} Jun 10 12:06:15.005353 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:15.005258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mnr5p" event={"ID":"a9533d32-133d-4d42-94c6-d5e4dcdbf819","Type":"ContainerStarted","Data":"54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614"} Jun 10 12:06:15.006868 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:15.006833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btfxc" event={"ID":"647e4d07-547b-4c95-827f-685cd7e65d11","Type":"ContainerStarted","Data":"99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7"} Jun 10 12:06:15.024633 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:15.024581 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mnr5p" podStartSLOduration=1.292560003 podStartE2EDuration="5.024566857s" totalImagesPullingTime="3.732006854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:15.024415261 +0000 UTC m=+485.103150999" watchObservedRunningTime="2026-06-10 12:06:15.024566857 +0000 UTC m=+485.103302596" Jun 10 12:06:15.045465 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:15.045408 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-btfxc" podStartSLOduration=0.909350235 podStartE2EDuration="4.045390752s" totalImagesPullingTime="3.136040517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:15.042928337 +0000 UTC m=+485.121664077" watchObservedRunningTime="2026-06-10 12:06:15.045390752 +0000 UTC m=+485.124126490" Jun 10 12:06:15.086121 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:15.086079 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mnr5p"] Jun 10 12:06:17.017500 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:17.017456 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mnr5p" podUID="a9533d32-133d-4d42-94c6-d5e4dcdbf819" containerName="authorino" containerID="cri-o://54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614" gracePeriod=30 Jun 10 12:06:17.268044 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:17.267982 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mnr5p" Jun 10 12:06:17.344580 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:17.344550 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpndz\" (UniqueName: \"kubernetes.io/projected/a9533d32-133d-4d42-94c6-d5e4dcdbf819-kube-api-access-xpndz\") pod \"a9533d32-133d-4d42-94c6-d5e4dcdbf819\" (UID: \"a9533d32-133d-4d42-94c6-d5e4dcdbf819\") " Jun 10 12:06:17.346582 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:17.346556 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9533d32-133d-4d42-94c6-d5e4dcdbf819-kube-api-access-xpndz" (OuterVolumeSpecName: "kube-api-access-xpndz") pod "a9533d32-133d-4d42-94c6-d5e4dcdbf819" (UID: "a9533d32-133d-4d42-94c6-d5e4dcdbf819"). InnerVolumeSpecName "kube-api-access-xpndz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:06:17.446031 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:17.445995 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpndz\" (UniqueName: \"kubernetes.io/projected/a9533d32-133d-4d42-94c6-d5e4dcdbf819-kube-api-access-xpndz\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:06:18.024436 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:18.024402 2576 generic.go:356] "Generic (PLEG): container finished" podID="a9533d32-133d-4d42-94c6-d5e4dcdbf819" containerID="54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614" exitCode=0 Jun 10 12:06:18.024923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:18.024448 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mnr5p" Jun 10 12:06:18.024923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:18.024485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mnr5p" event={"ID":"a9533d32-133d-4d42-94c6-d5e4dcdbf819","Type":"ContainerDied","Data":"54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614"} Jun 10 12:06:18.024923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:18.024531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mnr5p" event={"ID":"a9533d32-133d-4d42-94c6-d5e4dcdbf819","Type":"ContainerDied","Data":"11d1e3afb8435f3fcd514d955419b9fadc6cafbf1f35eddc40fa25f93376ca7f"} Jun 10 12:06:18.024923 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:18.024549 2576 scope.go:117] "RemoveContainer" containerID="54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614" Jun 10 12:06:18.034256 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:18.034238 2576 scope.go:117] "RemoveContainer" containerID="54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614" Jun 10 12:06:18.034515 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:06:18.034498 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614\": container with ID starting with 54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614 not found: ID does not exist" containerID="54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614" Jun 10 12:06:18.034563 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:18.034525 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614"} err="failed to get container status \"54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614\": rpc error: code = NotFound desc = could not find container \"54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614\": container with ID starting with 54b683415511ff8fd955c2f3c1742da09ae73a5f25b631642e3b92fede658614 not found: ID does not exist" Jun 10 12:06:18.050416 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:18.050382 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mnr5p"] Jun 10 12:06:18.054632 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:18.054609 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mnr5p"] Jun 10 12:06:18.348014 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:18.347929 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9533d32-133d-4d42-94c6-d5e4dcdbf819" path="/var/lib/kubelet/pods/a9533d32-133d-4d42-94c6-d5e4dcdbf819/volumes" Jun 10 12:06:41.551601 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.551563 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp"] Jun 10 12:06:41.552239 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.552077 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9533d32-133d-4d42-94c6-d5e4dcdbf819" containerName="authorino" Jun 10 12:06:41.552239 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.552099 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9533d32-133d-4d42-94c6-d5e4dcdbf819" containerName="authorino" Jun 10 12:06:41.552239 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.552204 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9533d32-133d-4d42-94c6-d5e4dcdbf819" containerName="authorino" Jun 10 12:06:41.555308 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.555287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:41.558024 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.558003 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:06:41.558164 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.558039 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v8fj7\"" Jun 10 12:06:41.559029 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.559013 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:06:41.566488 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.566466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp"] Jun 10 12:06:41.663248 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.663212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:41.663436 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.663276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx2nf\" (UniqueName: \"kubernetes.io/projected/739ee7f2-0cc1-438c-b947-b4baed07a7f7-kube-api-access-nx2nf\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:41.663436 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.663343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:41.764284 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.764244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:41.764448 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.764304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx2nf\" (UniqueName: \"kubernetes.io/projected/739ee7f2-0cc1-438c-b947-b4baed07a7f7-kube-api-access-nx2nf\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:41.764448 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.764341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:41.764695 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.764625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:41.764812 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.764793 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:41.779896 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.779862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx2nf\" (UniqueName: \"kubernetes.io/projected/739ee7f2-0cc1-438c-b947-b4baed07a7f7-kube-api-access-nx2nf\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:41.864105 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:41.864018 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:42.019845 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:42.019823 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp"] Jun 10 12:06:42.022044 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:06:42.021994 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod739ee7f2_0cc1_438c_b947_b4baed07a7f7.slice/crio-98bd92cd1e77eaaa1484b6f309d9d9d3f96600ec496b7ec6e0433b1381c031ca WatchSource:0}: Error finding container 98bd92cd1e77eaaa1484b6f309d9d9d3f96600ec496b7ec6e0433b1381c031ca: Status 404 returned error can't find the container with id 98bd92cd1e77eaaa1484b6f309d9d9d3f96600ec496b7ec6e0433b1381c031ca Jun 10 12:06:42.152448 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:42.152417 2576 generic.go:356] "Generic (PLEG): container finished" podID="739ee7f2-0cc1-438c-b947-b4baed07a7f7" containerID="729c74d51f434cc7d2b8f6fc2762ad66faf9dd04ec7314619e5abaf34ab59f50" exitCode=0 Jun 10 12:06:42.152589 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:42.152503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" event={"ID":"739ee7f2-0cc1-438c-b947-b4baed07a7f7","Type":"ContainerDied","Data":"729c74d51f434cc7d2b8f6fc2762ad66faf9dd04ec7314619e5abaf34ab59f50"} Jun 10 12:06:42.152589 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:42.152562 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" event={"ID":"739ee7f2-0cc1-438c-b947-b4baed07a7f7","Type":"ContainerStarted","Data":"98bd92cd1e77eaaa1484b6f309d9d9d3f96600ec496b7ec6e0433b1381c031ca"} Jun 10 12:06:43.159781 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:43.159751 2576 generic.go:356] "Generic (PLEG): container finished" podID="739ee7f2-0cc1-438c-b947-b4baed07a7f7" containerID="58cffc896f92d97fd3741f091c04605d7ac82deabf0bc45ed6d6c657a3e982c4" exitCode=0 Jun 10 12:06:43.160181 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:43.159832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" event={"ID":"739ee7f2-0cc1-438c-b947-b4baed07a7f7","Type":"ContainerDied","Data":"58cffc896f92d97fd3741f091c04605d7ac82deabf0bc45ed6d6c657a3e982c4"} Jun 10 12:06:44.166889 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:44.166858 2576 generic.go:356] "Generic (PLEG): container finished" podID="739ee7f2-0cc1-438c-b947-b4baed07a7f7" containerID="bcc3832b44872817559997a89fd76dbe62065820ccc5852799d49dd389daf5e5" exitCode=0 Jun 10 12:06:44.167341 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:44.166924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" event={"ID":"739ee7f2-0cc1-438c-b947-b4baed07a7f7","Type":"ContainerDied","Data":"bcc3832b44872817559997a89fd76dbe62065820ccc5852799d49dd389daf5e5"} Jun 10 12:06:45.299201 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:45.299179 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:06:45.398729 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:45.398695 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-bundle\") pod \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " Jun 10 12:06:45.398894 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:45.398797 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-util\") pod \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " Jun 10 12:06:45.398894 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:45.398822 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx2nf\" (UniqueName: \"kubernetes.io/projected/739ee7f2-0cc1-438c-b947-b4baed07a7f7-kube-api-access-nx2nf\") pod \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\" (UID: \"739ee7f2-0cc1-438c-b947-b4baed07a7f7\") " Jun 10 12:06:45.399220 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:45.399197 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-bundle" (OuterVolumeSpecName: "bundle") pod "739ee7f2-0cc1-438c-b947-b4baed07a7f7" (UID: "739ee7f2-0cc1-438c-b947-b4baed07a7f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:06:45.401191 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:45.401163 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/739ee7f2-0cc1-438c-b947-b4baed07a7f7-kube-api-access-nx2nf" (OuterVolumeSpecName: "kube-api-access-nx2nf") pod "739ee7f2-0cc1-438c-b947-b4baed07a7f7" (UID: "739ee7f2-0cc1-438c-b947-b4baed07a7f7"). InnerVolumeSpecName "kube-api-access-nx2nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:06:45.405237 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:45.405209 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-util" (OuterVolumeSpecName: "util") pod "739ee7f2-0cc1-438c-b947-b4baed07a7f7" (UID: "739ee7f2-0cc1-438c-b947-b4baed07a7f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:06:45.500009 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:45.499904 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-util\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:06:45.500009 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:45.499946 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx2nf\" (UniqueName: \"kubernetes.io/projected/739ee7f2-0cc1-438c-b947-b4baed07a7f7-kube-api-access-nx2nf\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:06:45.500009 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:45.499967 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/739ee7f2-0cc1-438c-b947-b4baed07a7f7-bundle\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:06:46.179612 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:46.179576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" event={"ID":"739ee7f2-0cc1-438c-b947-b4baed07a7f7","Type":"ContainerDied","Data":"98bd92cd1e77eaaa1484b6f309d9d9d3f96600ec496b7ec6e0433b1381c031ca"} Jun 10 12:06:46.179805 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:46.179624 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98bd92cd1e77eaaa1484b6f309d9d9d3f96600ec496b7ec6e0433b1381c031ca" Jun 10 12:06:46.179805 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:06:46.179622 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qkhdp" Jun 10 12:07:08.074374 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.074288 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:07:08.074924 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.074801 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="739ee7f2-0cc1-438c-b947-b4baed07a7f7" containerName="extract" Jun 10 12:07:08.074924 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.074821 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="739ee7f2-0cc1-438c-b947-b4baed07a7f7" containerName="extract" Jun 10 12:07:08.074924 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.074842 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="739ee7f2-0cc1-438c-b947-b4baed07a7f7" containerName="util" Jun 10 12:07:08.074924 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.074852 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="739ee7f2-0cc1-438c-b947-b4baed07a7f7" containerName="util" Jun 10 12:07:08.074924 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.074869 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="739ee7f2-0cc1-438c-b947-b4baed07a7f7" containerName="pull" Jun 10 12:07:08.074924 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.074877 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="739ee7f2-0cc1-438c-b947-b4baed07a7f7" containerName="pull" Jun 10 12:07:08.075226 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.074967 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="739ee7f2-0cc1-438c-b947-b4baed07a7f7" containerName="extract" Jun 10 12:07:08.078310 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.078289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:07:08.081072 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.081050 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 12:07:08.082072 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.082058 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-cjstq\"" Jun 10 12:07:08.082129 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.082058 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 12:07:08.082129 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.082059 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 12:07:08.090041 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.090017 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:07:08.195592 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.195557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpfms\" (UniqueName: \"kubernetes.io/projected/630c3e2c-f697-47fb-b505-9ff87751199d-kube-api-access-tpfms\") pod \"maas-keycloak-0\" (UID: \"630c3e2c-f697-47fb-b505-9ff87751199d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:07:08.296568 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.296516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpfms\" (UniqueName: \"kubernetes.io/projected/630c3e2c-f697-47fb-b505-9ff87751199d-kube-api-access-tpfms\") pod \"maas-keycloak-0\" (UID: \"630c3e2c-f697-47fb-b505-9ff87751199d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:07:08.311860 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.311832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpfms\" (UniqueName: \"kubernetes.io/projected/630c3e2c-f697-47fb-b505-9ff87751199d-kube-api-access-tpfms\") pod \"maas-keycloak-0\" (UID: \"630c3e2c-f697-47fb-b505-9ff87751199d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:07:08.388485 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.388451 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:07:08.554685 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:08.554506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:07:08.557346 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:07:08.557321 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630c3e2c_f697_47fb_b505_9ff87751199d.slice/crio-6d31e72739a53c53c631fd6f302cf6e5ab385f09f8b01e243738061c1be3f8f9 WatchSource:0}: Error finding container 6d31e72739a53c53c631fd6f302cf6e5ab385f09f8b01e243738061c1be3f8f9: Status 404 returned error can't find the container with id 6d31e72739a53c53c631fd6f302cf6e5ab385f09f8b01e243738061c1be3f8f9 Jun 10 12:07:09.312611 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:09.312573 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"630c3e2c-f697-47fb-b505-9ff87751199d","Type":"ContainerStarted","Data":"6d31e72739a53c53c631fd6f302cf6e5ab385f09f8b01e243738061c1be3f8f9"} Jun 10 12:07:14.343619 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:14.343593 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 12:07:15.355610 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:15.355569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"630c3e2c-f697-47fb-b505-9ff87751199d","Type":"ContainerStarted","Data":"8e34e9ccc4539232b8aec80a16769fa09b193901369a926efff362d8c6a8bfe0"} Jun 10 12:07:15.388723 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:15.388669 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 12:07:15.390864 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:15.390818 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:15.400043 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:15.399980 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.618072369 podStartE2EDuration="7.399958571s" totalImagesPullingTime="5.781886202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:15.394841121 +0000 UTC m=+545.473576861" watchObservedRunningTime="2026-06-10 12:07:15.399958571 +0000 UTC m=+545.478694298" Jun 10 12:07:16.389935 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:16.389886 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:17.389901 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:17.389846 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:18.388993 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:18.388947 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:07:18.390343 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:18.390310 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:19.389843 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:19.389799 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:20.389038 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:20.388954 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:21.389100 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:21.389053 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:22.389020 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:22.388974 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:23.389231 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:23.389180 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:24.389283 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:24.389232 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:25.389343 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:25.389278 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:26.389234 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:26.389186 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:27.388887 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:27.388837 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 10 12:07:28.517305 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:28.517264 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 12:07:28.537584 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:28.537516 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:07:38.523916 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:38.523874 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:07:39.760601 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:39.760560 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npcr9"] Jun 10 12:07:39.767511 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:39.767486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-npcr9" Jun 10 12:07:39.773653 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:39.773613 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npcr9"] Jun 10 12:07:39.801419 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:39.801384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np9xg\" (UniqueName: \"kubernetes.io/projected/51c79635-7add-4007-8018-604b6a5a347f-kube-api-access-np9xg\") pod \"authorino-5d4b67c446-npcr9\" (UID: \"51c79635-7add-4007-8018-604b6a5a347f\") " pod="kuadrant-system/authorino-5d4b67c446-npcr9" Jun 10 12:07:39.902011 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:39.901956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np9xg\" (UniqueName: \"kubernetes.io/projected/51c79635-7add-4007-8018-604b6a5a347f-kube-api-access-np9xg\") pod \"authorino-5d4b67c446-npcr9\" (UID: \"51c79635-7add-4007-8018-604b6a5a347f\") " pod="kuadrant-system/authorino-5d4b67c446-npcr9" Jun 10 12:07:39.912831 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:39.912805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np9xg\" (UniqueName: \"kubernetes.io/projected/51c79635-7add-4007-8018-604b6a5a347f-kube-api-access-np9xg\") pod \"authorino-5d4b67c446-npcr9\" (UID: \"51c79635-7add-4007-8018-604b6a5a347f\") " pod="kuadrant-system/authorino-5d4b67c446-npcr9" Jun 10 12:07:40.067364 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.067276 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npcr9"] Jun 10 12:07:40.067560 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.067542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-npcr9" Jun 10 12:07:40.106180 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.106148 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c6577f64d-p4wp9"] Jun 10 12:07:40.108965 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.108941 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6577f64d-p4wp9" Jun 10 12:07:40.123794 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.123759 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c6577f64d-p4wp9"] Jun 10 12:07:40.203512 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.203472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxm9g\" (UniqueName: \"kubernetes.io/projected/e941f752-7984-4723-854c-d5ddc7a2bf1d-kube-api-access-zxm9g\") pod \"authorino-6c6577f64d-p4wp9\" (UID: \"e941f752-7984-4723-854c-d5ddc7a2bf1d\") " pod="kuadrant-system/authorino-6c6577f64d-p4wp9" Jun 10 12:07:40.212425 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.212399 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npcr9"] Jun 10 12:07:40.214507 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:07:40.214483 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51c79635_7add_4007_8018_604b6a5a347f.slice/crio-a8946f41e892c1816eae9033d2f08ae817b20dcb83604db0ddb488dace49624e WatchSource:0}: Error finding container a8946f41e892c1816eae9033d2f08ae817b20dcb83604db0ddb488dace49624e: Status 404 returned error can't find the container with id a8946f41e892c1816eae9033d2f08ae817b20dcb83604db0ddb488dace49624e Jun 10 12:07:40.304049 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.304010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxm9g\" (UniqueName: \"kubernetes.io/projected/e941f752-7984-4723-854c-d5ddc7a2bf1d-kube-api-access-zxm9g\") pod \"authorino-6c6577f64d-p4wp9\" (UID: \"e941f752-7984-4723-854c-d5ddc7a2bf1d\") " pod="kuadrant-system/authorino-6c6577f64d-p4wp9" Jun 10 12:07:40.322587 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.322528 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxm9g\" (UniqueName: \"kubernetes.io/projected/e941f752-7984-4723-854c-d5ddc7a2bf1d-kube-api-access-zxm9g\") pod \"authorino-6c6577f64d-p4wp9\" (UID: \"e941f752-7984-4723-854c-d5ddc7a2bf1d\") " pod="kuadrant-system/authorino-6c6577f64d-p4wp9" Jun 10 12:07:40.349076 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.349048 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c6577f64d-p4wp9"] Jun 10 12:07:40.349287 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.349275 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6577f64d-p4wp9" Jun 10 12:07:40.388449 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.388404 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cb5c5d45b-xcmbc"] Jun 10 12:07:40.391966 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.391936 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" Jun 10 12:07:40.395424 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.395402 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 12:07:40.404042 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.402615 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cb5c5d45b-xcmbc"] Jun 10 12:07:40.404980 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.404952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf5hr\" (UniqueName: \"kubernetes.io/projected/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-kube-api-access-qf5hr\") pod \"authorino-6cb5c5d45b-xcmbc\" (UID: \"f8254c6f-e996-47d6-b2c4-b1e6500c08bc\") " pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" Jun 10 12:07:40.405098 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.405011 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-tls-cert\") pod \"authorino-6cb5c5d45b-xcmbc\" (UID: \"f8254c6f-e996-47d6-b2c4-b1e6500c08bc\") " pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" Jun 10 12:07:40.491135 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.491100 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c6577f64d-p4wp9"] Jun 10 12:07:40.493165 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:07:40.493141 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode941f752_7984_4723_854c_d5ddc7a2bf1d.slice/crio-b276bd0586418243a398fdf1d0a0524ddd4f74c6646051e2dcb256357592bbd1 WatchSource:0}: Error finding container b276bd0586418243a398fdf1d0a0524ddd4f74c6646051e2dcb256357592bbd1: Status 404 returned error can't find the container with id b276bd0586418243a398fdf1d0a0524ddd4f74c6646051e2dcb256357592bbd1 Jun 10 12:07:40.505997 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.505974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-tls-cert\") pod \"authorino-6cb5c5d45b-xcmbc\" (UID: \"f8254c6f-e996-47d6-b2c4-b1e6500c08bc\") " pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" Jun 10 12:07:40.506122 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.506051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf5hr\" (UniqueName: \"kubernetes.io/projected/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-kube-api-access-qf5hr\") pod \"authorino-6cb5c5d45b-xcmbc\" (UID: \"f8254c6f-e996-47d6-b2c4-b1e6500c08bc\") " pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" Jun 10 12:07:40.508334 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.508310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-tls-cert\") pod \"authorino-6cb5c5d45b-xcmbc\" (UID: \"f8254c6f-e996-47d6-b2c4-b1e6500c08bc\") " pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" Jun 10 12:07:40.523267 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.523244 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf5hr\" (UniqueName: \"kubernetes.io/projected/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-kube-api-access-qf5hr\") pod \"authorino-6cb5c5d45b-xcmbc\" (UID: \"f8254c6f-e996-47d6-b2c4-b1e6500c08bc\") " pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" Jun 10 12:07:40.549965 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.549931 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-npcr9" event={"ID":"51c79635-7add-4007-8018-604b6a5a347f","Type":"ContainerStarted","Data":"a8946f41e892c1816eae9033d2f08ae817b20dcb83604db0ddb488dace49624e"} Jun 10 12:07:40.551184 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.551163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6577f64d-p4wp9" event={"ID":"e941f752-7984-4723-854c-d5ddc7a2bf1d","Type":"ContainerStarted","Data":"b276bd0586418243a398fdf1d0a0524ddd4f74c6646051e2dcb256357592bbd1"} Jun 10 12:07:40.705491 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.705453 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" Jun 10 12:07:40.854662 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:40.854623 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cb5c5d45b-xcmbc"] Jun 10 12:07:40.857020 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:07:40.856994 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8254c6f_e996_47d6_b2c4_b1e6500c08bc.slice/crio-8bec53844bb17eb3c8ced058c5ebcec987fafbe4b41886376e56e6665031b1e7 WatchSource:0}: Error finding container 8bec53844bb17eb3c8ced058c5ebcec987fafbe4b41886376e56e6665031b1e7: Status 404 returned error can't find the container with id 8bec53844bb17eb3c8ced058c5ebcec987fafbe4b41886376e56e6665031b1e7 Jun 10 12:07:41.558206 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.558106 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-npcr9" event={"ID":"51c79635-7add-4007-8018-604b6a5a347f","Type":"ContainerStarted","Data":"3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f"} Jun 10 12:07:41.558206 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.558148 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-npcr9" podUID="51c79635-7add-4007-8018-604b6a5a347f" containerName="authorino" containerID="cri-o://3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f" gracePeriod=30 Jun 10 12:07:41.559749 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.559710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" event={"ID":"f8254c6f-e996-47d6-b2c4-b1e6500c08bc","Type":"ContainerStarted","Data":"c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1"} Jun 10 12:07:41.559749 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.559746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" event={"ID":"f8254c6f-e996-47d6-b2c4-b1e6500c08bc","Type":"ContainerStarted","Data":"8bec53844bb17eb3c8ced058c5ebcec987fafbe4b41886376e56e6665031b1e7"} Jun 10 12:07:41.561439 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.561411 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6577f64d-p4wp9" event={"ID":"e941f752-7984-4723-854c-d5ddc7a2bf1d","Type":"ContainerStarted","Data":"d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7"} Jun 10 12:07:41.561538 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.561467 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6c6577f64d-p4wp9" podUID="e941f752-7984-4723-854c-d5ddc7a2bf1d" containerName="authorino" containerID="cri-o://d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7" gracePeriod=30 Jun 10 12:07:41.579509 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.579462 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-npcr9" podStartSLOduration=2.209027683 podStartE2EDuration="2.579449232s" totalImagesPullingTime="370.421549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:41.578338861 +0000 UTC m=+571.657074611" watchObservedRunningTime="2026-06-10 12:07:41.579449232 +0000 UTC m=+571.658184970" Jun 10 12:07:41.612387 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.612337 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c6577f64d-p4wp9" podStartSLOduration=1.305098106 podStartE2EDuration="1.612320741s" totalImagesPullingTime="307.222635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:41.610311539 +0000 UTC m=+571.689047279" watchObservedRunningTime="2026-06-10 12:07:41.612320741 +0000 UTC m=+571.691056480" Jun 10 12:07:41.640573 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.640517 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" podStartSLOduration=1.3303391 podStartE2EDuration="1.640500995s" totalImagesPullingTime="310.161895ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:41.638138012 +0000 UTC m=+571.716873751" watchObservedRunningTime="2026-06-10 12:07:41.640500995 +0000 UTC m=+571.719236770" Jun 10 12:07:41.695145 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.695111 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btfxc"] Jun 10 12:07:41.695350 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.695324 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-btfxc" podUID="647e4d07-547b-4c95-827f-685cd7e65d11" containerName="authorino" containerID="cri-o://99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7" gracePeriod=30 Jun 10 12:07:41.837822 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.836814 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-npcr9" Jun 10 12:07:41.846182 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.846154 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6577f64d-p4wp9" Jun 10 12:07:41.918325 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.918288 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-np9xg\" (UniqueName: \"kubernetes.io/projected/51c79635-7add-4007-8018-604b6a5a347f-kube-api-access-np9xg\") pod \"51c79635-7add-4007-8018-604b6a5a347f\" (UID: \"51c79635-7add-4007-8018-604b6a5a347f\") " Jun 10 12:07:41.918787 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.918403 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxm9g\" (UniqueName: \"kubernetes.io/projected/e941f752-7984-4723-854c-d5ddc7a2bf1d-kube-api-access-zxm9g\") pod \"e941f752-7984-4723-854c-d5ddc7a2bf1d\" (UID: \"e941f752-7984-4723-854c-d5ddc7a2bf1d\") " Jun 10 12:07:41.920795 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.920757 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e941f752-7984-4723-854c-d5ddc7a2bf1d-kube-api-access-zxm9g" (OuterVolumeSpecName: "kube-api-access-zxm9g") pod "e941f752-7984-4723-854c-d5ddc7a2bf1d" (UID: "e941f752-7984-4723-854c-d5ddc7a2bf1d"). InnerVolumeSpecName "kube-api-access-zxm9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:07:41.920795 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.920770 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c79635-7add-4007-8018-604b6a5a347f-kube-api-access-np9xg" (OuterVolumeSpecName: "kube-api-access-np9xg") pod "51c79635-7add-4007-8018-604b6a5a347f" (UID: "51c79635-7add-4007-8018-604b6a5a347f"). InnerVolumeSpecName "kube-api-access-np9xg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:07:41.961826 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:41.961801 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btfxc" Jun 10 12:07:42.019052 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.019015 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5v8s\" (UniqueName: \"kubernetes.io/projected/647e4d07-547b-4c95-827f-685cd7e65d11-kube-api-access-q5v8s\") pod \"647e4d07-547b-4c95-827f-685cd7e65d11\" (UID: \"647e4d07-547b-4c95-827f-685cd7e65d11\") " Jun 10 12:07:42.019233 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.019225 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxm9g\" (UniqueName: \"kubernetes.io/projected/e941f752-7984-4723-854c-d5ddc7a2bf1d-kube-api-access-zxm9g\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:07:42.019275 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.019238 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-np9xg\" (UniqueName: \"kubernetes.io/projected/51c79635-7add-4007-8018-604b6a5a347f-kube-api-access-np9xg\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:07:42.021086 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.021054 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/647e4d07-547b-4c95-827f-685cd7e65d11-kube-api-access-q5v8s" (OuterVolumeSpecName: "kube-api-access-q5v8s") pod "647e4d07-547b-4c95-827f-685cd7e65d11" (UID: "647e4d07-547b-4c95-827f-685cd7e65d11"). InnerVolumeSpecName "kube-api-access-q5v8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:07:42.120604 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.120518 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5v8s\" (UniqueName: \"kubernetes.io/projected/647e4d07-547b-4c95-827f-685cd7e65d11-kube-api-access-q5v8s\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:07:42.568160 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.568125 2576 generic.go:356] "Generic (PLEG): container finished" podID="e941f752-7984-4723-854c-d5ddc7a2bf1d" containerID="d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7" exitCode=0 Jun 10 12:07:42.568383 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.568172 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6577f64d-p4wp9" Jun 10 12:07:42.568383 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.568215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6577f64d-p4wp9" event={"ID":"e941f752-7984-4723-854c-d5ddc7a2bf1d","Type":"ContainerDied","Data":"d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7"} Jun 10 12:07:42.568383 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.568261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6577f64d-p4wp9" event={"ID":"e941f752-7984-4723-854c-d5ddc7a2bf1d","Type":"ContainerDied","Data":"b276bd0586418243a398fdf1d0a0524ddd4f74c6646051e2dcb256357592bbd1"} Jun 10 12:07:42.568383 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.568283 2576 scope.go:117] "RemoveContainer" containerID="d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7" Jun 10 12:07:42.569629 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.569482 2576 generic.go:356] "Generic (PLEG): container finished" podID="647e4d07-547b-4c95-827f-685cd7e65d11" containerID="99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7" exitCode=0 Jun 10 12:07:42.569629 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.569544 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-btfxc" Jun 10 12:07:42.569629 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.569583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btfxc" event={"ID":"647e4d07-547b-4c95-827f-685cd7e65d11","Type":"ContainerDied","Data":"99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7"} Jun 10 12:07:42.569629 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.569620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-btfxc" event={"ID":"647e4d07-547b-4c95-827f-685cd7e65d11","Type":"ContainerDied","Data":"0f5b65c43bd8d9c4971f8a3da3bfb502e69455ca350f701802bc4f2b59c1cdfe"} Jun 10 12:07:42.571028 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.570997 2576 generic.go:356] "Generic (PLEG): container finished" podID="51c79635-7add-4007-8018-604b6a5a347f" containerID="3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f" exitCode=0 Jun 10 12:07:42.571151 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.571037 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-npcr9" Jun 10 12:07:42.571151 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.571077 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-npcr9" event={"ID":"51c79635-7add-4007-8018-604b6a5a347f","Type":"ContainerDied","Data":"3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f"} Jun 10 12:07:42.571151 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.571110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-npcr9" event={"ID":"51c79635-7add-4007-8018-604b6a5a347f","Type":"ContainerDied","Data":"a8946f41e892c1816eae9033d2f08ae817b20dcb83604db0ddb488dace49624e"} Jun 10 12:07:42.578140 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.578120 2576 scope.go:117] "RemoveContainer" containerID="d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7" Jun 10 12:07:42.578433 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:07:42.578414 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7\": container with ID starting with d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7 not found: ID does not exist" containerID="d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7" Jun 10 12:07:42.578496 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.578442 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7"} err="failed to get container status \"d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7\": rpc error: code = NotFound desc = could not find container \"d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7\": container with ID starting with d4ecc4b8297eaa9eb99bc1969d9850237f1afc12da7a956c0cdfb324d8cfb2d7 not found: ID does not exist" Jun 10 12:07:42.578496 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.578459 2576 scope.go:117] "RemoveContainer" containerID="99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7" Jun 10 12:07:42.586393 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.586376 2576 scope.go:117] "RemoveContainer" containerID="99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7" Jun 10 12:07:42.586763 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:07:42.586737 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7\": container with ID starting with 99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7 not found: ID does not exist" containerID="99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7" Jun 10 12:07:42.586867 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.586767 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7"} err="failed to get container status \"99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7\": rpc error: code = NotFound desc = could not find container \"99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7\": container with ID starting with 99fcbe507532176007c4f029b4049eea43434bf37e47d188bed9e97c53f573b7 not found: ID does not exist" Jun 10 12:07:42.586867 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.586792 2576 scope.go:117] "RemoveContainer" containerID="3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f" Jun 10 12:07:42.594550 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.594532 2576 scope.go:117] "RemoveContainer" containerID="3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f" Jun 10 12:07:42.594819 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:07:42.594799 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f\": container with ID starting with 3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f not found: ID does not exist" containerID="3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f" Jun 10 12:07:42.594910 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.594824 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f"} err="failed to get container status \"3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f\": rpc error: code = NotFound desc = could not find container \"3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f\": container with ID starting with 3c8b0e6ef0fe2718ceefd3172be85e7c181fbe31ddcd6c59e9bbbbb381b82d9f not found: ID does not exist" Jun 10 12:07:42.603792 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.603770 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npcr9"] Jun 10 12:07:42.612936 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.612915 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npcr9"] Jun 10 12:07:42.627471 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.627447 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c6577f64d-p4wp9"] Jun 10 12:07:42.637701 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.637675 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c6577f64d-p4wp9"] Jun 10 12:07:42.659940 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.659917 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btfxc"] Jun 10 12:07:42.671419 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:42.671393 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-btfxc"] Jun 10 12:07:44.352459 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:44.352425 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51c79635-7add-4007-8018-604b6a5a347f" path="/var/lib/kubelet/pods/51c79635-7add-4007-8018-604b6a5a347f/volumes" Jun 10 12:07:44.352875 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:44.352751 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="647e4d07-547b-4c95-827f-685cd7e65d11" path="/var/lib/kubelet/pods/647e4d07-547b-4c95-827f-685cd7e65d11/volumes" Jun 10 12:07:44.353129 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:44.353116 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e941f752-7984-4723-854c-d5ddc7a2bf1d" path="/var/lib/kubelet/pods/e941f752-7984-4723-854c-d5ddc7a2bf1d/volumes" Jun 10 12:07:47.292041 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.292001 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f866f59f7-cqcph"] Jun 10 12:07:47.292426 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.292387 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e941f752-7984-4723-854c-d5ddc7a2bf1d" containerName="authorino" Jun 10 12:07:47.292426 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.292399 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e941f752-7984-4723-854c-d5ddc7a2bf1d" containerName="authorino" Jun 10 12:07:47.292426 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.292406 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647e4d07-547b-4c95-827f-685cd7e65d11" containerName="authorino" Jun 10 12:07:47.292426 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.292412 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="647e4d07-547b-4c95-827f-685cd7e65d11" containerName="authorino" Jun 10 12:07:47.292597 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.292432 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c79635-7add-4007-8018-604b6a5a347f" containerName="authorino" Jun 10 12:07:47.292597 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.292439 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c79635-7add-4007-8018-604b6a5a347f" containerName="authorino" Jun 10 12:07:47.292597 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.292504 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="647e4d07-547b-4c95-827f-685cd7e65d11" containerName="authorino" Jun 10 12:07:47.292597 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.292518 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="51c79635-7add-4007-8018-604b6a5a347f" containerName="authorino" Jun 10 12:07:47.292597 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.292526 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e941f752-7984-4723-854c-d5ddc7a2bf1d" containerName="authorino" Jun 10 12:07:47.295789 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.295768 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:07:47.298882 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.298861 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 12:07:47.300406 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.300390 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-shf8j\"" Jun 10 12:07:47.300511 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.300417 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 12:07:47.315197 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.315166 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f866f59f7-cqcph"] Jun 10 12:07:47.365733 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.365699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14369b94-fb97-41a5-8a87-35412f67e496-webhook-cert\") pod \"maas-controller-6f866f59f7-cqcph\" (UID: \"14369b94-fb97-41a5-8a87-35412f67e496\") " pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:07:47.365934 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.365795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg4vj\" (UniqueName: \"kubernetes.io/projected/14369b94-fb97-41a5-8a87-35412f67e496-kube-api-access-jg4vj\") pod \"maas-controller-6f866f59f7-cqcph\" (UID: \"14369b94-fb97-41a5-8a87-35412f67e496\") " pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:07:47.467138 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.467098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg4vj\" (UniqueName: \"kubernetes.io/projected/14369b94-fb97-41a5-8a87-35412f67e496-kube-api-access-jg4vj\") pod \"maas-controller-6f866f59f7-cqcph\" (UID: \"14369b94-fb97-41a5-8a87-35412f67e496\") " pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:07:47.467321 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.467161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14369b94-fb97-41a5-8a87-35412f67e496-webhook-cert\") pod \"maas-controller-6f866f59f7-cqcph\" (UID: \"14369b94-fb97-41a5-8a87-35412f67e496\") " pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:07:47.469596 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.469578 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14369b94-fb97-41a5-8a87-35412f67e496-webhook-cert\") pod \"maas-controller-6f866f59f7-cqcph\" (UID: \"14369b94-fb97-41a5-8a87-35412f67e496\") " pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:07:47.480217 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.480181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg4vj\" (UniqueName: \"kubernetes.io/projected/14369b94-fb97-41a5-8a87-35412f67e496-kube-api-access-jg4vj\") pod \"maas-controller-6f866f59f7-cqcph\" (UID: \"14369b94-fb97-41a5-8a87-35412f67e496\") " pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:07:47.572418 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.572338 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b55cc999b-6n8b2"] Jun 10 12:07:47.575038 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.575020 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:07:47.597550 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.597521 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b55cc999b-6n8b2"] Jun 10 12:07:47.606224 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.606199 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:07:47.668621 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.668591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d25caa14-5413-4649-a9ba-86296fb4c3fb-webhook-cert\") pod \"maas-controller-6b55cc999b-6n8b2\" (UID: \"d25caa14-5413-4649-a9ba-86296fb4c3fb\") " pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:07:47.668811 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.668719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mzkm\" (UniqueName: \"kubernetes.io/projected/d25caa14-5413-4649-a9ba-86296fb4c3fb-kube-api-access-7mzkm\") pod \"maas-controller-6b55cc999b-6n8b2\" (UID: \"d25caa14-5413-4649-a9ba-86296fb4c3fb\") " pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:07:47.754292 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.754262 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f866f59f7-cqcph"] Jun 10 12:07:47.756363 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:07:47.756333 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14369b94_fb97_41a5_8a87_35412f67e496.slice/crio-3d51cba96be6d42098dbfda1613ff9bb9860484aba2867174d127a11229147c6 WatchSource:0}: Error finding container 3d51cba96be6d42098dbfda1613ff9bb9860484aba2867174d127a11229147c6: Status 404 returned error can't find the container with id 3d51cba96be6d42098dbfda1613ff9bb9860484aba2867174d127a11229147c6 Jun 10 12:07:47.769182 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.769155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d25caa14-5413-4649-a9ba-86296fb4c3fb-webhook-cert\") pod \"maas-controller-6b55cc999b-6n8b2\" (UID: \"d25caa14-5413-4649-a9ba-86296fb4c3fb\") " pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:07:47.769327 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.769306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzkm\" (UniqueName: \"kubernetes.io/projected/d25caa14-5413-4649-a9ba-86296fb4c3fb-kube-api-access-7mzkm\") pod \"maas-controller-6b55cc999b-6n8b2\" (UID: \"d25caa14-5413-4649-a9ba-86296fb4c3fb\") " pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:07:47.771560 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.771541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d25caa14-5413-4649-a9ba-86296fb4c3fb-webhook-cert\") pod \"maas-controller-6b55cc999b-6n8b2\" (UID: \"d25caa14-5413-4649-a9ba-86296fb4c3fb\") " pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:07:47.781030 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.781008 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mzkm\" (UniqueName: \"kubernetes.io/projected/d25caa14-5413-4649-a9ba-86296fb4c3fb-kube-api-access-7mzkm\") pod \"maas-controller-6b55cc999b-6n8b2\" (UID: \"d25caa14-5413-4649-a9ba-86296fb4c3fb\") " pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:07:47.885477 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:47.885443 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:07:48.027964 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:48.027927 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b55cc999b-6n8b2"] Jun 10 12:07:48.028906 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:07:48.028882 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25caa14_5413_4649_a9ba_86296fb4c3fb.slice/crio-1cc746dcaebc20ff12f365d7ec0cc3bcbe5983a87ceb0183024823627c6f67aa WatchSource:0}: Error finding container 1cc746dcaebc20ff12f365d7ec0cc3bcbe5983a87ceb0183024823627c6f67aa: Status 404 returned error can't find the container with id 1cc746dcaebc20ff12f365d7ec0cc3bcbe5983a87ceb0183024823627c6f67aa Jun 10 12:07:48.610398 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:48.610360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" event={"ID":"d25caa14-5413-4649-a9ba-86296fb4c3fb","Type":"ContainerStarted","Data":"1cc746dcaebc20ff12f365d7ec0cc3bcbe5983a87ceb0183024823627c6f67aa"} Jun 10 12:07:48.611841 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:48.611809 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f866f59f7-cqcph" event={"ID":"14369b94-fb97-41a5-8a87-35412f67e496","Type":"ContainerStarted","Data":"3d51cba96be6d42098dbfda1613ff9bb9860484aba2867174d127a11229147c6"} Jun 10 12:07:51.636482 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:51.636446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" event={"ID":"d25caa14-5413-4649-a9ba-86296fb4c3fb","Type":"ContainerStarted","Data":"21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34"} Jun 10 12:07:51.637077 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:51.636678 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:07:51.638073 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:51.638049 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f866f59f7-cqcph" event={"ID":"14369b94-fb97-41a5-8a87-35412f67e496","Type":"ContainerStarted","Data":"24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5"} Jun 10 12:07:51.638176 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:51.638106 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:07:51.666064 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:51.666002 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" podStartSLOduration=2.004826833 podStartE2EDuration="4.665980425s" totalImagesPullingTime="2.661153592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:51.66106047 +0000 UTC m=+581.739796212" watchObservedRunningTime="2026-06-10 12:07:51.665980425 +0000 UTC m=+581.744716166" Jun 10 12:07:51.688145 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:07:51.688088 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f866f59f7-cqcph" podStartSLOduration=1.7474796320000001 podStartE2EDuration="4.688074033s" totalImagesPullingTime="2.940594401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:51.684986224 +0000 UTC m=+581.763721983" watchObservedRunningTime="2026-06-10 12:07:51.688074033 +0000 UTC m=+581.766809771" Jun 10 12:08:02.656662 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:02.656601 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:08:02.657076 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:02.656713 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:08:02.775456 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:02.775423 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f866f59f7-cqcph"] Jun 10 12:08:02.775707 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:02.775662 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6f866f59f7-cqcph" podUID="14369b94-fb97-41a5-8a87-35412f67e496" containerName="manager" containerID="cri-o://24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5" gracePeriod=30 Jun 10 12:08:03.034864 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.034834 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:08:03.125879 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.125844 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14369b94-fb97-41a5-8a87-35412f67e496-webhook-cert\") pod \"14369b94-fb97-41a5-8a87-35412f67e496\" (UID: \"14369b94-fb97-41a5-8a87-35412f67e496\") " Jun 10 12:08:03.126061 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.125925 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg4vj\" (UniqueName: \"kubernetes.io/projected/14369b94-fb97-41a5-8a87-35412f67e496-kube-api-access-jg4vj\") pod \"14369b94-fb97-41a5-8a87-35412f67e496\" (UID: \"14369b94-fb97-41a5-8a87-35412f67e496\") " Jun 10 12:08:03.128055 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.128023 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14369b94-fb97-41a5-8a87-35412f67e496-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "14369b94-fb97-41a5-8a87-35412f67e496" (UID: "14369b94-fb97-41a5-8a87-35412f67e496"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:03.128149 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.128114 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14369b94-fb97-41a5-8a87-35412f67e496-kube-api-access-jg4vj" (OuterVolumeSpecName: "kube-api-access-jg4vj") pod "14369b94-fb97-41a5-8a87-35412f67e496" (UID: "14369b94-fb97-41a5-8a87-35412f67e496"). InnerVolumeSpecName "kube-api-access-jg4vj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:08:03.227360 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.227277 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg4vj\" (UniqueName: \"kubernetes.io/projected/14369b94-fb97-41a5-8a87-35412f67e496-kube-api-access-jg4vj\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:08:03.227360 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.227307 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14369b94-fb97-41a5-8a87-35412f67e496-webhook-cert\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:08:03.705446 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.705408 2576 generic.go:356] "Generic (PLEG): container finished" podID="14369b94-fb97-41a5-8a87-35412f67e496" containerID="24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5" exitCode=0 Jun 10 12:08:03.705934 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.705456 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f866f59f7-cqcph" Jun 10 12:08:03.705934 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.705501 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f866f59f7-cqcph" event={"ID":"14369b94-fb97-41a5-8a87-35412f67e496","Type":"ContainerDied","Data":"24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5"} Jun 10 12:08:03.705934 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.705550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f866f59f7-cqcph" event={"ID":"14369b94-fb97-41a5-8a87-35412f67e496","Type":"ContainerDied","Data":"3d51cba96be6d42098dbfda1613ff9bb9860484aba2867174d127a11229147c6"} Jun 10 12:08:03.705934 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.705575 2576 scope.go:117] "RemoveContainer" containerID="24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5" Jun 10 12:08:03.715128 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.715112 2576 scope.go:117] "RemoveContainer" containerID="24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5" Jun 10 12:08:03.715394 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:08:03.715377 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5\": container with ID starting with 24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5 not found: ID does not exist" containerID="24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5" Jun 10 12:08:03.715460 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.715402 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5"} err="failed to get container status \"24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5\": rpc error: code = NotFound desc = could not find container \"24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5\": container with ID starting with 24e4c50acbef939e1b61a053bf4348b95c595bec623e6223a0d90b1955667da5 not found: ID does not exist" Jun 10 12:08:03.731590 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.731559 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f866f59f7-cqcph"] Jun 10 12:08:03.738019 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:03.737995 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f866f59f7-cqcph"] Jun 10 12:08:04.347488 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:04.347452 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14369b94-fb97-41a5-8a87-35412f67e496" path="/var/lib/kubelet/pods/14369b94-fb97-41a5-8a87-35412f67e496/volumes" Jun 10 12:08:10.341167 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:10.341137 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:08:10.341657 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:10.341465 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:08:22.895851 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.895813 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5"] Jun 10 12:08:22.900431 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.896337 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14369b94-fb97-41a5-8a87-35412f67e496" containerName="manager" Jun 10 12:08:22.900431 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.896354 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14369b94-fb97-41a5-8a87-35412f67e496" containerName="manager" Jun 10 12:08:22.900431 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.896424 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="14369b94-fb97-41a5-8a87-35412f67e496" containerName="manager" Jun 10 12:08:22.900431 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.900422 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" Jun 10 12:08:22.903162 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.903116 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 10 12:08:22.903286 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.903176 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 10 12:08:22.903286 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.903211 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-mnlxd\"" Jun 10 12:08:22.904155 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.904138 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 10 12:08:22.909610 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.909584 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5"] Jun 10 12:08:22.999497 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.999458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69-maas-api-tls\") pod \"maas-api-6fb88d5d9d-2p4z5\" (UID: \"e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69\") " pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" Jun 10 12:08:22.999738 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:22.999533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk8s4\" (UniqueName: \"kubernetes.io/projected/e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69-kube-api-access-hk8s4\") pod \"maas-api-6fb88d5d9d-2p4z5\" (UID: \"e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69\") " pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" Jun 10 12:08:23.100721 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.100675 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69-maas-api-tls\") pod \"maas-api-6fb88d5d9d-2p4z5\" (UID: \"e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69\") " pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" Jun 10 12:08:23.100924 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.100774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8s4\" (UniqueName: \"kubernetes.io/projected/e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69-kube-api-access-hk8s4\") pod \"maas-api-6fb88d5d9d-2p4z5\" (UID: \"e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69\") " pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" Jun 10 12:08:23.103186 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.103161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69-maas-api-tls\") pod \"maas-api-6fb88d5d9d-2p4z5\" (UID: \"e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69\") " pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" Jun 10 12:08:23.119134 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.119099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8s4\" (UniqueName: \"kubernetes.io/projected/e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69-kube-api-access-hk8s4\") pod \"maas-api-6fb88d5d9d-2p4z5\" (UID: \"e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69\") " pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" Jun 10 12:08:23.212666 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.212562 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" Jun 10 12:08:23.363264 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.363234 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5"] Jun 10 12:08:23.364543 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:08:23.364519 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0aaa56e_6fc5_4aa9_932f_f8d0d8a40c69.slice/crio-de46fbd25b6218b48cec7d43a04fff4050ec0fef8c5fffca608595e27fa7bb39 WatchSource:0}: Error finding container de46fbd25b6218b48cec7d43a04fff4050ec0fef8c5fffca608595e27fa7bb39: Status 404 returned error can't find the container with id de46fbd25b6218b48cec7d43a04fff4050ec0fef8c5fffca608595e27fa7bb39 Jun 10 12:08:23.661190 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.661153 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-24rcn"] Jun 10 12:08:23.664222 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.664204 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-24rcn" Jun 10 12:08:23.666812 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.666787 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 12:08:23.675676 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.675626 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-24rcn"] Jun 10 12:08:23.678308 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.678277 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-x8vc9"] Jun 10 12:08:23.681705 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.681683 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-x8vc9" Jun 10 12:08:23.684380 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.684358 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8pqgh\"" Jun 10 12:08:23.692615 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.692594 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-x8vc9"] Jun 10 12:08:23.704729 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.704692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wmn4\" (UniqueName: \"kubernetes.io/projected/8cee6228-e0bb-4dc3-8a88-82656d4c719e-kube-api-access-8wmn4\") pod \"payload-processing-699b6cd6c-x8vc9\" (UID: \"8cee6228-e0bb-4dc3-8a88-82656d4c719e\") " pod="openshift-ingress/payload-processing-699b6cd6c-x8vc9" Jun 10 12:08:23.704962 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.704812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-449fq\" (UniqueName: \"kubernetes.io/projected/28c15021-4b0c-48b8-b4fc-2ded77584918-kube-api-access-449fq\") pod \"payload-pre-processing-579785bc64-24rcn\" (UID: \"28c15021-4b0c-48b8-b4fc-2ded77584918\") " pod="openshift-ingress/payload-pre-processing-579785bc64-24rcn" Jun 10 12:08:23.805877 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.805838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wmn4\" (UniqueName: \"kubernetes.io/projected/8cee6228-e0bb-4dc3-8a88-82656d4c719e-kube-api-access-8wmn4\") pod \"payload-processing-699b6cd6c-x8vc9\" (UID: \"8cee6228-e0bb-4dc3-8a88-82656d4c719e\") " pod="openshift-ingress/payload-processing-699b6cd6c-x8vc9" Jun 10 12:08:23.806086 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.805960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-449fq\" (UniqueName: \"kubernetes.io/projected/28c15021-4b0c-48b8-b4fc-2ded77584918-kube-api-access-449fq\") pod \"payload-pre-processing-579785bc64-24rcn\" (UID: \"28c15021-4b0c-48b8-b4fc-2ded77584918\") " pod="openshift-ingress/payload-pre-processing-579785bc64-24rcn" Jun 10 12:08:23.819167 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.819139 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-449fq\" (UniqueName: \"kubernetes.io/projected/28c15021-4b0c-48b8-b4fc-2ded77584918-kube-api-access-449fq\") pod \"payload-pre-processing-579785bc64-24rcn\" (UID: \"28c15021-4b0c-48b8-b4fc-2ded77584918\") " pod="openshift-ingress/payload-pre-processing-579785bc64-24rcn" Jun 10 12:08:23.819340 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.819260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wmn4\" (UniqueName: \"kubernetes.io/projected/8cee6228-e0bb-4dc3-8a88-82656d4c719e-kube-api-access-8wmn4\") pod \"payload-processing-699b6cd6c-x8vc9\" (UID: \"8cee6228-e0bb-4dc3-8a88-82656d4c719e\") " pod="openshift-ingress/payload-processing-699b6cd6c-x8vc9" Jun 10 12:08:23.826393 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.826358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" event={"ID":"e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69","Type":"ContainerStarted","Data":"de46fbd25b6218b48cec7d43a04fff4050ec0fef8c5fffca608595e27fa7bb39"} Jun 10 12:08:23.975487 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.975404 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-24rcn" Jun 10 12:08:23.993655 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:23.993616 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-x8vc9" Jun 10 12:08:24.144305 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:24.144275 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-24rcn"] Jun 10 12:08:24.146433 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:08:24.146400 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c15021_4b0c_48b8_b4fc_2ded77584918.slice/crio-50ff5e8b31aa11b7b8d6c75f6b03c96bdeae1b7032db3061ebe2bea077ad44b1 WatchSource:0}: Error finding container 50ff5e8b31aa11b7b8d6c75f6b03c96bdeae1b7032db3061ebe2bea077ad44b1: Status 404 returned error can't find the container with id 50ff5e8b31aa11b7b8d6c75f6b03c96bdeae1b7032db3061ebe2bea077ad44b1 Jun 10 12:08:24.178664 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:24.178615 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-x8vc9"] Jun 10 12:08:24.179810 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:08:24.179782 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cee6228_e0bb_4dc3_8a88_82656d4c719e.slice/crio-1312d0f0d222d26f351632fd114426e9e59a2f259a62c0d24460380f7b9778a4 WatchSource:0}: Error finding container 1312d0f0d222d26f351632fd114426e9e59a2f259a62c0d24460380f7b9778a4: Status 404 returned error can't find the container with id 1312d0f0d222d26f351632fd114426e9e59a2f259a62c0d24460380f7b9778a4 Jun 10 12:08:24.845978 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:24.845888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-x8vc9" event={"ID":"8cee6228-e0bb-4dc3-8a88-82656d4c719e","Type":"ContainerStarted","Data":"1312d0f0d222d26f351632fd114426e9e59a2f259a62c0d24460380f7b9778a4"} Jun 10 12:08:24.849887 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:24.849815 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-24rcn" event={"ID":"28c15021-4b0c-48b8-b4fc-2ded77584918","Type":"ContainerStarted","Data":"50ff5e8b31aa11b7b8d6c75f6b03c96bdeae1b7032db3061ebe2bea077ad44b1"} Jun 10 12:08:26.865160 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:26.865054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" event={"ID":"e0aaa56e-6fc5-4aa9-932f-f8d0d8a40c69","Type":"ContainerStarted","Data":"88fffa9d35255da09dc29a9837c04ad34a7fd9fa3bcc3cad6a1e36360597d4f0"} Jun 10 12:08:26.865613 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:26.865173 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" Jun 10 12:08:26.867252 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:26.867217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-x8vc9" event={"ID":"8cee6228-e0bb-4dc3-8a88-82656d4c719e","Type":"ContainerStarted","Data":"0226ce3bb51bb9e25ad38f1b38dfabe292de2abf648cbf9603fa2ebd14fb2e70"} Jun 10 12:08:26.867434 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:26.867295 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-x8vc9" Jun 10 12:08:26.869240 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:26.869212 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-24rcn" event={"ID":"28c15021-4b0c-48b8-b4fc-2ded77584918","Type":"ContainerStarted","Data":"572a18022375bac1011bf4f022be14fb8a21ee05dc5b78076db797541d1cb84c"} Jun 10 12:08:26.869364 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:26.869314 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-24rcn" Jun 10 12:08:26.890520 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:26.890469 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" podStartSLOduration=1.722459103 podStartE2EDuration="4.890452338s" totalImagesPullingTime="3.167993235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:08:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:08:26.888809123 +0000 UTC m=+616.967544863" watchObservedRunningTime="2026-06-10 12:08:26.890452338 +0000 UTC m=+616.969188077" Jun 10 12:08:26.908951 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:26.908902 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-24rcn" podStartSLOduration=1.4623920830000001 podStartE2EDuration="3.908888642s" totalImagesPullingTime="2.446496559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:08:26.907715298 +0000 UTC m=+616.986451037" watchObservedRunningTime="2026-06-10 12:08:26.908888642 +0000 UTC m=+616.987624381" Jun 10 12:08:26.929216 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:26.929161 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-x8vc9" podStartSLOduration=1.504840818 podStartE2EDuration="3.929144086s" totalImagesPullingTime="2.424303268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:08:26.927978485 +0000 UTC m=+617.006714226" watchObservedRunningTime="2026-06-10 12:08:26.929144086 +0000 UTC m=+617.007879824" Jun 10 12:08:32.882206 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:32.882179 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-6fb88d5d9d-2p4z5" Jun 10 12:08:35.269600 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:35.269565 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:08:35.270050 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:35.269768 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" containerID="cri-o://8e34e9ccc4539232b8aec80a16769fa09b193901369a926efff362d8c6a8bfe0" gracePeriod=30 Jun 10 12:08:36.931298 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:36.931203 2576 generic.go:356] "Generic (PLEG): container finished" podID="630c3e2c-f697-47fb-b505-9ff87751199d" containerID="8e34e9ccc4539232b8aec80a16769fa09b193901369a926efff362d8c6a8bfe0" exitCode=143 Jun 10 12:08:36.931298 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:36.931253 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"630c3e2c-f697-47fb-b505-9ff87751199d","Type":"ContainerDied","Data":"8e34e9ccc4539232b8aec80a16769fa09b193901369a926efff362d8c6a8bfe0"} Jun 10 12:08:37.321375 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.321347 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:37.442249 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.442151 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpfms\" (UniqueName: \"kubernetes.io/projected/630c3e2c-f697-47fb-b505-9ff87751199d-kube-api-access-tpfms\") pod \"630c3e2c-f697-47fb-b505-9ff87751199d\" (UID: \"630c3e2c-f697-47fb-b505-9ff87751199d\") " Jun 10 12:08:37.444328 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.444296 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/630c3e2c-f697-47fb-b505-9ff87751199d-kube-api-access-tpfms" (OuterVolumeSpecName: "kube-api-access-tpfms") pod "630c3e2c-f697-47fb-b505-9ff87751199d" (UID: "630c3e2c-f697-47fb-b505-9ff87751199d"). InnerVolumeSpecName "kube-api-access-tpfms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:08:37.543546 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.543510 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpfms\" (UniqueName: \"kubernetes.io/projected/630c3e2c-f697-47fb-b505-9ff87751199d-kube-api-access-tpfms\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:08:37.878073 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.877975 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-x8vc9" Jun 10 12:08:37.878304 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.878286 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-24rcn" Jun 10 12:08:37.938943 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.938913 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:37.938943 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.938925 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"630c3e2c-f697-47fb-b505-9ff87751199d","Type":"ContainerDied","Data":"6d31e72739a53c53c631fd6f302cf6e5ab385f09f8b01e243738061c1be3f8f9"} Jun 10 12:08:37.939464 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.938999 2576 scope.go:117] "RemoveContainer" containerID="8e34e9ccc4539232b8aec80a16769fa09b193901369a926efff362d8c6a8bfe0" Jun 10 12:08:37.966520 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.966488 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:08:37.972038 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.972008 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:08:37.999179 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.999148 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:08:37.999525 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.999513 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" Jun 10 12:08:37.999572 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.999527 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" Jun 10 12:08:37.999614 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:37.999593 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" containerName="keycloak" Jun 10 12:08:38.004027 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.004009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:38.006966 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.006941 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 12:08:38.007100 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.006944 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 12:08:38.007253 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.007237 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 12:08:38.007301 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.007261 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-cjstq\"" Jun 10 12:08:38.007362 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.007345 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 12:08:38.013523 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.013498 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:08:38.147897 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.147857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/29d6ca16-99b9-4991-85fb-97e4f9b76a3d-test-realms\") pod \"maas-keycloak-0\" (UID: \"29d6ca16-99b9-4991-85fb-97e4f9b76a3d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:38.148105 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.147997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrdks\" (UniqueName: \"kubernetes.io/projected/29d6ca16-99b9-4991-85fb-97e4f9b76a3d-kube-api-access-wrdks\") pod \"maas-keycloak-0\" (UID: \"29d6ca16-99b9-4991-85fb-97e4f9b76a3d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:38.248933 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.248894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/29d6ca16-99b9-4991-85fb-97e4f9b76a3d-test-realms\") pod \"maas-keycloak-0\" (UID: \"29d6ca16-99b9-4991-85fb-97e4f9b76a3d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:38.249100 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.248963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrdks\" (UniqueName: \"kubernetes.io/projected/29d6ca16-99b9-4991-85fb-97e4f9b76a3d-kube-api-access-wrdks\") pod \"maas-keycloak-0\" (UID: \"29d6ca16-99b9-4991-85fb-97e4f9b76a3d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:38.249752 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.249732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/29d6ca16-99b9-4991-85fb-97e4f9b76a3d-test-realms\") pod \"maas-keycloak-0\" (UID: \"29d6ca16-99b9-4991-85fb-97e4f9b76a3d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:38.260191 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.260165 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrdks\" (UniqueName: \"kubernetes.io/projected/29d6ca16-99b9-4991-85fb-97e4f9b76a3d-kube-api-access-wrdks\") pod \"maas-keycloak-0\" (UID: \"29d6ca16-99b9-4991-85fb-97e4f9b76a3d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:38.315198 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.315158 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:38.348502 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.348465 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="630c3e2c-f697-47fb-b505-9ff87751199d" path="/var/lib/kubelet/pods/630c3e2c-f697-47fb-b505-9ff87751199d/volumes" Jun 10 12:08:38.457420 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.457394 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:08:38.460210 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:08:38.460185 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d6ca16_99b9_4991_85fb_97e4f9b76a3d.slice/crio-ddcfecc22642b5d0d6aa3e24d1b01d8fc3b3cf6959bc5f098737c33ee789a4a9 WatchSource:0}: Error finding container ddcfecc22642b5d0d6aa3e24d1b01d8fc3b3cf6959bc5f098737c33ee789a4a9: Status 404 returned error can't find the container with id ddcfecc22642b5d0d6aa3e24d1b01d8fc3b3cf6959bc5f098737c33ee789a4a9 Jun 10 12:08:38.461631 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.461609 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:08:38.947701 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.947663 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"29d6ca16-99b9-4991-85fb-97e4f9b76a3d","Type":"ContainerStarted","Data":"54d40bf9fcdba6b864deb48effe4bc688ea253e2841dd959e4f0a77a74238133"} Jun 10 12:08:38.948085 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.947725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"29d6ca16-99b9-4991-85fb-97e4f9b76a3d","Type":"ContainerStarted","Data":"ddcfecc22642b5d0d6aa3e24d1b01d8fc3b3cf6959bc5f098737c33ee789a4a9"} Jun 10 12:08:38.970573 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:38.970516 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.63136064 podStartE2EDuration="1.970498154s" totalImagesPullingTime="339.137514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:08:38.968540929 +0000 UTC m=+629.047276681" watchObservedRunningTime="2026-06-10 12:08:38.970498154 +0000 UTC m=+629.049233894" Jun 10 12:08:39.315401 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:39.315355 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:39.317209 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:39.317174 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:40.315588 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:40.315535 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:41.316160 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:41.316112 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:42.315988 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:42.315927 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:43.316118 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:43.316070 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:44.316630 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:44.316580 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:45.316426 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:45.316372 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:46.316008 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:46.315944 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:47.316364 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:47.316324 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:48.316142 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:48.316097 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:48.316500 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:48.316465 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:49.315934 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:49.315879 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:50.315947 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:50.315893 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:51.316130 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:51.316077 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.55:9000/health/started\": dial tcp 10.132.0.55:9000: connect: connection refused" Jun 10 12:08:52.423794 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:52.423754 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 12:08:52.439232 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:08:52.439178 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:09:02.428220 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:02.428154 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="29d6ca16-99b9-4991-85fb-97e4f9b76a3d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:09:12.429767 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:12.429732 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:09:23.320362 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.320324 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b4dcfcccd-r2vlk"] Jun 10 12:09:23.325286 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.325266 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:09:23.327959 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.327938 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 12:09:23.333667 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.333627 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b4dcfcccd-r2vlk"] Jun 10 12:09:23.393497 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.393459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgvqc\" (UniqueName: \"kubernetes.io/projected/d5323a0b-7243-41b6-80cd-5b533d8b0221-kube-api-access-bgvqc\") pod \"authorino-b4dcfcccd-r2vlk\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:09:23.393497 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.393500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5323a0b-7243-41b6-80cd-5b533d8b0221-oidc-ca\") pod \"authorino-b4dcfcccd-r2vlk\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:09:23.393762 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.393599 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5323a0b-7243-41b6-80cd-5b533d8b0221-tls-cert\") pod \"authorino-b4dcfcccd-r2vlk\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:09:23.494081 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.494045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5323a0b-7243-41b6-80cd-5b533d8b0221-tls-cert\") pod \"authorino-b4dcfcccd-r2vlk\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:09:23.494302 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.494123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgvqc\" (UniqueName: \"kubernetes.io/projected/d5323a0b-7243-41b6-80cd-5b533d8b0221-kube-api-access-bgvqc\") pod \"authorino-b4dcfcccd-r2vlk\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:09:23.494302 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.494146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5323a0b-7243-41b6-80cd-5b533d8b0221-oidc-ca\") pod \"authorino-b4dcfcccd-r2vlk\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:09:23.494770 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.494747 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5323a0b-7243-41b6-80cd-5b533d8b0221-oidc-ca\") pod \"authorino-b4dcfcccd-r2vlk\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:09:23.496957 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.496929 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5323a0b-7243-41b6-80cd-5b533d8b0221-tls-cert\") pod \"authorino-b4dcfcccd-r2vlk\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:09:23.504437 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.504399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgvqc\" (UniqueName: \"kubernetes.io/projected/d5323a0b-7243-41b6-80cd-5b533d8b0221-kube-api-access-bgvqc\") pod \"authorino-b4dcfcccd-r2vlk\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:09:23.635528 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.635498 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:09:23.783375 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:23.783342 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b4dcfcccd-r2vlk"] Jun 10 12:09:23.784251 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:09:23.784220 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5323a0b_7243_41b6_80cd_5b533d8b0221.slice/crio-ed78e302cc1d623bd7db4d74b75a873f734de2ae172a307bb4de91082b154efc WatchSource:0}: Error finding container ed78e302cc1d623bd7db4d74b75a873f734de2ae172a307bb4de91082b154efc: Status 404 returned error can't find the container with id ed78e302cc1d623bd7db4d74b75a873f734de2ae172a307bb4de91082b154efc Jun 10 12:09:24.271027 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:24.270991 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" event={"ID":"d5323a0b-7243-41b6-80cd-5b533d8b0221","Type":"ContainerStarted","Data":"ed78e302cc1d623bd7db4d74b75a873f734de2ae172a307bb4de91082b154efc"} Jun 10 12:09:25.278717 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:25.278678 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" event={"ID":"d5323a0b-7243-41b6-80cd-5b533d8b0221","Type":"ContainerStarted","Data":"8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5"} Jun 10 12:09:25.301542 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:25.301487 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" podStartSLOduration=1.729632424 podStartE2EDuration="2.301470926s" totalImagesPullingTime="571.838502ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:09:25.299359084 +0000 UTC m=+675.378094820" watchObservedRunningTime="2026-06-10 12:09:25.301470926 +0000 UTC m=+675.380206666" Jun 10 12:09:25.340784 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:25.340745 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6cb5c5d45b-xcmbc"] Jun 10 12:09:25.341012 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:25.340983 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" podUID="f8254c6f-e996-47d6-b2c4-b1e6500c08bc" containerName="authorino" containerID="cri-o://c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1" gracePeriod=30 Jun 10 12:09:25.615317 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:25.615289 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" Jun 10 12:09:25.713172 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:25.713137 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-tls-cert\") pod \"f8254c6f-e996-47d6-b2c4-b1e6500c08bc\" (UID: \"f8254c6f-e996-47d6-b2c4-b1e6500c08bc\") " Jun 10 12:09:25.713367 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:25.713249 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf5hr\" (UniqueName: \"kubernetes.io/projected/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-kube-api-access-qf5hr\") pod \"f8254c6f-e996-47d6-b2c4-b1e6500c08bc\" (UID: \"f8254c6f-e996-47d6-b2c4-b1e6500c08bc\") " Jun 10 12:09:25.715188 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:25.715156 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-kube-api-access-qf5hr" (OuterVolumeSpecName: "kube-api-access-qf5hr") pod "f8254c6f-e996-47d6-b2c4-b1e6500c08bc" (UID: "f8254c6f-e996-47d6-b2c4-b1e6500c08bc"). InnerVolumeSpecName "kube-api-access-qf5hr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:09:25.724101 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:25.724067 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f8254c6f-e996-47d6-b2c4-b1e6500c08bc" (UID: "f8254c6f-e996-47d6-b2c4-b1e6500c08bc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:09:25.814040 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:25.813999 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf5hr\" (UniqueName: \"kubernetes.io/projected/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-kube-api-access-qf5hr\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:09:25.814040 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:25.814031 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8254c6f-e996-47d6-b2c4-b1e6500c08bc-tls-cert\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:09:26.286008 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:26.285969 2576 generic.go:356] "Generic (PLEG): container finished" podID="f8254c6f-e996-47d6-b2c4-b1e6500c08bc" containerID="c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1" exitCode=0 Jun 10 12:09:26.286008 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:26.286009 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" Jun 10 12:09:26.286517 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:26.286052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" event={"ID":"f8254c6f-e996-47d6-b2c4-b1e6500c08bc","Type":"ContainerDied","Data":"c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1"} Jun 10 12:09:26.286517 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:26.286092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cb5c5d45b-xcmbc" event={"ID":"f8254c6f-e996-47d6-b2c4-b1e6500c08bc","Type":"ContainerDied","Data":"8bec53844bb17eb3c8ced058c5ebcec987fafbe4b41886376e56e6665031b1e7"} Jun 10 12:09:26.286517 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:26.286114 2576 scope.go:117] "RemoveContainer" containerID="c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1" Jun 10 12:09:26.295858 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:26.295836 2576 scope.go:117] "RemoveContainer" containerID="c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1" Jun 10 12:09:26.296171 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:09:26.296148 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1\": container with ID starting with c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1 not found: ID does not exist" containerID="c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1" Jun 10 12:09:26.296248 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:26.296178 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1"} err="failed to get container status \"c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1\": rpc error: code = NotFound desc = could not find container \"c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1\": container with ID starting with c9a473994e44f7bb5d365a9c5a26cd289373b31e6e8040a000aed12e42126ca1 not found: ID does not exist" Jun 10 12:09:26.338014 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:26.337979 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6cb5c5d45b-xcmbc"] Jun 10 12:09:26.350290 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:26.350259 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6cb5c5d45b-xcmbc"] Jun 10 12:09:28.348587 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:28.348550 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8254c6f-e996-47d6-b2c4-b1e6500c08bc" path="/var/lib/kubelet/pods/f8254c6f-e996-47d6-b2c4-b1e6500c08bc/volumes" Jun 10 12:09:47.002811 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.002778 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl"] Jun 10 12:09:47.003300 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.003160 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8254c6f-e996-47d6-b2c4-b1e6500c08bc" containerName="authorino" Jun 10 12:09:47.003300 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.003171 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8254c6f-e996-47d6-b2c4-b1e6500c08bc" containerName="authorino" Jun 10 12:09:47.003300 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.003235 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8254c6f-e996-47d6-b2c4-b1e6500c08bc" containerName="authorino" Jun 10 12:09:47.006557 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.006517 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.009451 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.009425 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 12:09:47.009864 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.009850 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 12:09:47.010611 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.010596 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 12:09:47.023435 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.023410 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl"] Jun 10 12:09:47.027555 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.027537 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7ktg4\"" Jun 10 12:09:47.101789 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.101749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.101968 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.101842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.101968 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.101914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.101968 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.101936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.101968 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.101961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.102111 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.101976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj4s5\" (UniqueName: \"kubernetes.io/projected/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-kube-api-access-dj4s5\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.202812 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.202765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.203005 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.202944 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.203005 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.202981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.203083 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.203008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.203083 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.203035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj4s5\" (UniqueName: \"kubernetes.io/projected/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-kube-api-access-dj4s5\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.203162 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.203082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.203327 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.203309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.203424 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.203402 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.203516 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.203492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.205111 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.205087 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.205505 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.205485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.216370 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.216340 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj4s5\" (UniqueName: \"kubernetes.io/projected/7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3-kube-api-access-dj4s5\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z46tl\" (UID: \"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.317204 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.317100 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:09:47.464468 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:47.464438 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl"] Jun 10 12:09:47.466672 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:09:47.466621 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4f3ff2_0681_4371_9d20_a0ac1d62fdb3.slice/crio-6df291d42f7fd1ff586baed60c92b43d388a762c3784dc0bb4e562edc5346f4d WatchSource:0}: Error finding container 6df291d42f7fd1ff586baed60c92b43d388a762c3784dc0bb4e562edc5346f4d: Status 404 returned error can't find the container with id 6df291d42f7fd1ff586baed60c92b43d388a762c3784dc0bb4e562edc5346f4d Jun 10 12:09:48.413390 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:48.413350 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" event={"ID":"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3","Type":"ContainerStarted","Data":"6df291d42f7fd1ff586baed60c92b43d388a762c3784dc0bb4e562edc5346f4d"} Jun 10 12:09:51.437474 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:51.437437 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" event={"ID":"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3","Type":"ContainerStarted","Data":"c484467bf8f0ee6f1436516fde19c3130c73b40d621ad70e125100925b6239ca"} Jun 10 12:09:58.478584 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:58.478551 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3" containerID="c484467bf8f0ee6f1436516fde19c3130c73b40d621ad70e125100925b6239ca" exitCode=0 Jun 10 12:09:58.479033 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:09:58.478622 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" event={"ID":"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3","Type":"ContainerDied","Data":"c484467bf8f0ee6f1436516fde19c3130c73b40d621ad70e125100925b6239ca"} Jun 10 12:10:00.494172 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:10:00.494134 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" event={"ID":"7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3","Type":"ContainerStarted","Data":"e6c5369a38c53d970f6e62c8a2e002eaaa635389db89c8ed43e5885c500d6a2b"} Jun 10 12:10:00.543874 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:10:00.543823 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" podStartSLOduration=3.294451455 podStartE2EDuration="14.543805441s" totalImagesPullingTime="4.30939362s" totalInitContainerRuntime="6.939960366s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:09:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:10:00.539938539 +0000 UTC m=+710.618674278" watchObservedRunningTime="2026-06-10 12:10:00.543805441 +0000 UTC m=+710.622541179" Jun 10 12:10:07.318008 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:10:07.317961 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:10:07.318544 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:10:07.318026 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:10:07.330684 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:10:07.330650 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:10:07.545016 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:10:07.544979 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z46tl" Jun 10 12:11:51.421693 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.421649 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58c5c5788c-dhr5b"] Jun 10 12:11:51.425385 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.425361 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58c5c5788c-dhr5b" Jun 10 12:11:51.434364 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.434336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58c5c5788c-dhr5b"] Jun 10 12:11:51.577110 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.577071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3cb67b60-70c4-438a-ae3d-8497aaa1bc3c-tls-cert\") pod \"authorino-58c5c5788c-dhr5b\" (UID: \"3cb67b60-70c4-438a-ae3d-8497aaa1bc3c\") " pod="kuadrant-system/authorino-58c5c5788c-dhr5b" Jun 10 12:11:51.577298 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.577123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3cb67b60-70c4-438a-ae3d-8497aaa1bc3c-oidc-ca\") pod \"authorino-58c5c5788c-dhr5b\" (UID: \"3cb67b60-70c4-438a-ae3d-8497aaa1bc3c\") " pod="kuadrant-system/authorino-58c5c5788c-dhr5b" Jun 10 12:11:51.577298 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.577144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtxfp\" (UniqueName: \"kubernetes.io/projected/3cb67b60-70c4-438a-ae3d-8497aaa1bc3c-kube-api-access-vtxfp\") pod \"authorino-58c5c5788c-dhr5b\" (UID: \"3cb67b60-70c4-438a-ae3d-8497aaa1bc3c\") " pod="kuadrant-system/authorino-58c5c5788c-dhr5b" Jun 10 12:11:51.678040 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.677943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3cb67b60-70c4-438a-ae3d-8497aaa1bc3c-tls-cert\") pod \"authorino-58c5c5788c-dhr5b\" (UID: \"3cb67b60-70c4-438a-ae3d-8497aaa1bc3c\") " pod="kuadrant-system/authorino-58c5c5788c-dhr5b" Jun 10 12:11:51.678040 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.678004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3cb67b60-70c4-438a-ae3d-8497aaa1bc3c-oidc-ca\") pod \"authorino-58c5c5788c-dhr5b\" (UID: \"3cb67b60-70c4-438a-ae3d-8497aaa1bc3c\") " pod="kuadrant-system/authorino-58c5c5788c-dhr5b" Jun 10 12:11:51.678040 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.678038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtxfp\" (UniqueName: \"kubernetes.io/projected/3cb67b60-70c4-438a-ae3d-8497aaa1bc3c-kube-api-access-vtxfp\") pod \"authorino-58c5c5788c-dhr5b\" (UID: \"3cb67b60-70c4-438a-ae3d-8497aaa1bc3c\") " pod="kuadrant-system/authorino-58c5c5788c-dhr5b" Jun 10 12:11:51.678759 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.678732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3cb67b60-70c4-438a-ae3d-8497aaa1bc3c-oidc-ca\") pod \"authorino-58c5c5788c-dhr5b\" (UID: \"3cb67b60-70c4-438a-ae3d-8497aaa1bc3c\") " pod="kuadrant-system/authorino-58c5c5788c-dhr5b" Jun 10 12:11:51.680489 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.680469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3cb67b60-70c4-438a-ae3d-8497aaa1bc3c-tls-cert\") pod \"authorino-58c5c5788c-dhr5b\" (UID: \"3cb67b60-70c4-438a-ae3d-8497aaa1bc3c\") " pod="kuadrant-system/authorino-58c5c5788c-dhr5b" Jun 10 12:11:51.697091 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.697051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtxfp\" (UniqueName: \"kubernetes.io/projected/3cb67b60-70c4-438a-ae3d-8497aaa1bc3c-kube-api-access-vtxfp\") pod \"authorino-58c5c5788c-dhr5b\" (UID: \"3cb67b60-70c4-438a-ae3d-8497aaa1bc3c\") " pod="kuadrant-system/authorino-58c5c5788c-dhr5b" Jun 10 12:11:51.735435 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.735403 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58c5c5788c-dhr5b" Jun 10 12:11:51.878826 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:51.878800 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58c5c5788c-dhr5b"] Jun 10 12:11:51.880503 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:11:51.880472 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cb67b60_70c4_438a_ae3d_8497aaa1bc3c.slice/crio-aa8ceaaab52dde5f4734c73fcfbe4f84ab625b3e8b3cf8c82c028449b816ae0a WatchSource:0}: Error finding container aa8ceaaab52dde5f4734c73fcfbe4f84ab625b3e8b3cf8c82c028449b816ae0a: Status 404 returned error can't find the container with id aa8ceaaab52dde5f4734c73fcfbe4f84ab625b3e8b3cf8c82c028449b816ae0a Jun 10 12:11:52.131245 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:52.131160 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58c5c5788c-dhr5b" event={"ID":"3cb67b60-70c4-438a-ae3d-8497aaa1bc3c","Type":"ContainerStarted","Data":"aa8ceaaab52dde5f4734c73fcfbe4f84ab625b3e8b3cf8c82c028449b816ae0a"} Jun 10 12:11:53.138364 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.138327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58c5c5788c-dhr5b" event={"ID":"3cb67b60-70c4-438a-ae3d-8497aaa1bc3c","Type":"ContainerStarted","Data":"64faaf8c8c3dd9317a45c531e40a56da8dd1643b5c390d9b8f810301886ebe44"} Jun 10 12:11:53.160751 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.160698 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58c5c5788c-dhr5b" podStartSLOduration=1.74324664 podStartE2EDuration="2.16068339s" totalImagesPullingTime="417.43675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:11:53.158291113 +0000 UTC m=+823.237026868" watchObservedRunningTime="2026-06-10 12:11:53.16068339 +0000 UTC m=+823.239419128" Jun 10 12:11:53.199033 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.199002 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b4dcfcccd-r2vlk"] Jun 10 12:11:53.199203 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.199173 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" podUID="d5323a0b-7243-41b6-80cd-5b533d8b0221" containerName="authorino" containerID="cri-o://8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5" gracePeriod=30 Jun 10 12:11:53.471488 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.471458 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:11:53.596221 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.596183 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgvqc\" (UniqueName: \"kubernetes.io/projected/d5323a0b-7243-41b6-80cd-5b533d8b0221-kube-api-access-bgvqc\") pod \"d5323a0b-7243-41b6-80cd-5b533d8b0221\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " Jun 10 12:11:53.596439 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.596291 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5323a0b-7243-41b6-80cd-5b533d8b0221-tls-cert\") pod \"d5323a0b-7243-41b6-80cd-5b533d8b0221\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " Jun 10 12:11:53.596439 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.596331 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5323a0b-7243-41b6-80cd-5b533d8b0221-oidc-ca\") pod \"d5323a0b-7243-41b6-80cd-5b533d8b0221\" (UID: \"d5323a0b-7243-41b6-80cd-5b533d8b0221\") " Jun 10 12:11:53.598504 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.598471 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5323a0b-7243-41b6-80cd-5b533d8b0221-kube-api-access-bgvqc" (OuterVolumeSpecName: "kube-api-access-bgvqc") pod "d5323a0b-7243-41b6-80cd-5b533d8b0221" (UID: "d5323a0b-7243-41b6-80cd-5b533d8b0221"). InnerVolumeSpecName "kube-api-access-bgvqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:11:53.601524 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.601495 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5323a0b-7243-41b6-80cd-5b533d8b0221-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "d5323a0b-7243-41b6-80cd-5b533d8b0221" (UID: "d5323a0b-7243-41b6-80cd-5b533d8b0221"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:11:53.606847 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.606818 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5323a0b-7243-41b6-80cd-5b533d8b0221-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d5323a0b-7243-41b6-80cd-5b533d8b0221" (UID: "d5323a0b-7243-41b6-80cd-5b533d8b0221"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:11:53.697983 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.697892 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5323a0b-7243-41b6-80cd-5b533d8b0221-tls-cert\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:11:53.697983 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.697922 2576 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5323a0b-7243-41b6-80cd-5b533d8b0221-oidc-ca\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:11:53.697983 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:53.697933 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgvqc\" (UniqueName: \"kubernetes.io/projected/d5323a0b-7243-41b6-80cd-5b533d8b0221-kube-api-access-bgvqc\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:11:54.145815 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:54.145783 2576 generic.go:356] "Generic (PLEG): container finished" podID="d5323a0b-7243-41b6-80cd-5b533d8b0221" containerID="8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5" exitCode=0 Jun 10 12:11:54.146429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:54.145829 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" Jun 10 12:11:54.146429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:54.145867 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" event={"ID":"d5323a0b-7243-41b6-80cd-5b533d8b0221","Type":"ContainerDied","Data":"8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5"} Jun 10 12:11:54.146429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:54.145908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b4dcfcccd-r2vlk" event={"ID":"d5323a0b-7243-41b6-80cd-5b533d8b0221","Type":"ContainerDied","Data":"ed78e302cc1d623bd7db4d74b75a873f734de2ae172a307bb4de91082b154efc"} Jun 10 12:11:54.146429 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:54.145926 2576 scope.go:117] "RemoveContainer" containerID="8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5" Jun 10 12:11:54.157590 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:54.157561 2576 scope.go:117] "RemoveContainer" containerID="8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5" Jun 10 12:11:54.158007 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:11:54.157977 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5\": container with ID starting with 8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5 not found: ID does not exist" containerID="8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5" Jun 10 12:11:54.158093 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:54.158021 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5"} err="failed to get container status \"8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5\": rpc error: code = NotFound desc = could not find container \"8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5\": container with ID starting with 8204a7ba8bca50a4e628f12260ac68eaab111ef3f51107c6763fcbf639dcabf5 not found: ID does not exist" Jun 10 12:11:54.173508 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:54.173475 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b4dcfcccd-r2vlk"] Jun 10 12:11:54.178908 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:54.178875 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b4dcfcccd-r2vlk"] Jun 10 12:11:54.348727 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:11:54.348693 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5323a0b-7243-41b6-80cd-5b533d8b0221" path="/var/lib/kubelet/pods/d5323a0b-7243-41b6-80cd-5b533d8b0221/volumes" Jun 10 12:13:10.389161 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:10.389085 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:13:10.391814 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:10.391788 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:13:43.755702 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:43.755663 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b55cc999b-6n8b2"] Jun 10 12:13:43.758145 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:43.755894 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" podUID="d25caa14-5413-4649-a9ba-86296fb4c3fb" containerName="manager" containerID="cri-o://21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34" gracePeriod=30 Jun 10 12:13:44.012917 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.012852 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:13:44.125678 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.125592 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mzkm\" (UniqueName: \"kubernetes.io/projected/d25caa14-5413-4649-a9ba-86296fb4c3fb-kube-api-access-7mzkm\") pod \"d25caa14-5413-4649-a9ba-86296fb4c3fb\" (UID: \"d25caa14-5413-4649-a9ba-86296fb4c3fb\") " Jun 10 12:13:44.125887 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.125716 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d25caa14-5413-4649-a9ba-86296fb4c3fb-webhook-cert\") pod \"d25caa14-5413-4649-a9ba-86296fb4c3fb\" (UID: \"d25caa14-5413-4649-a9ba-86296fb4c3fb\") " Jun 10 12:13:44.127821 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.127787 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25caa14-5413-4649-a9ba-86296fb4c3fb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d25caa14-5413-4649-a9ba-86296fb4c3fb" (UID: "d25caa14-5413-4649-a9ba-86296fb4c3fb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:13:44.127939 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.127822 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25caa14-5413-4649-a9ba-86296fb4c3fb-kube-api-access-7mzkm" (OuterVolumeSpecName: "kube-api-access-7mzkm") pod "d25caa14-5413-4649-a9ba-86296fb4c3fb" (UID: "d25caa14-5413-4649-a9ba-86296fb4c3fb"). InnerVolumeSpecName "kube-api-access-7mzkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:13:44.227000 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.226963 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mzkm\" (UniqueName: \"kubernetes.io/projected/d25caa14-5413-4649-a9ba-86296fb4c3fb-kube-api-access-7mzkm\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:13:44.227000 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.226995 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d25caa14-5413-4649-a9ba-86296fb4c3fb-webhook-cert\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:13:44.796004 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.795965 2576 generic.go:356] "Generic (PLEG): container finished" podID="d25caa14-5413-4649-a9ba-86296fb4c3fb" containerID="21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34" exitCode=0 Jun 10 12:13:44.796004 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.796003 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" Jun 10 12:13:44.796505 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.796051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" event={"ID":"d25caa14-5413-4649-a9ba-86296fb4c3fb","Type":"ContainerDied","Data":"21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34"} Jun 10 12:13:44.796505 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.796102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b55cc999b-6n8b2" event={"ID":"d25caa14-5413-4649-a9ba-86296fb4c3fb","Type":"ContainerDied","Data":"1cc746dcaebc20ff12f365d7ec0cc3bcbe5983a87ceb0183024823627c6f67aa"} Jun 10 12:13:44.796505 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.796125 2576 scope.go:117] "RemoveContainer" containerID="21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34" Jun 10 12:13:44.805919 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.805899 2576 scope.go:117] "RemoveContainer" containerID="21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34" Jun 10 12:13:44.806197 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:13:44.806174 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34\": container with ID starting with 21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34 not found: ID does not exist" containerID="21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34" Jun 10 12:13:44.806252 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.806206 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34"} err="failed to get container status \"21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34\": rpc error: code = NotFound desc = could not find container \"21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34\": container with ID starting with 21bc066d1f8ceaea7ca320b5399f84bf61c5c6b2f337ed318fc656b0b550fc34 not found: ID does not exist" Jun 10 12:13:44.819622 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.819582 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b55cc999b-6n8b2"] Jun 10 12:13:44.825398 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:44.825364 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b55cc999b-6n8b2"] Jun 10 12:13:46.349186 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:13:46.349151 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d25caa14-5413-4649-a9ba-86296fb4c3fb" path="/var/lib/kubelet/pods/d25caa14-5413-4649-a9ba-86296fb4c3fb/volumes" Jun 10 12:15:00.159117 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.159080 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9"] Jun 10 12:15:00.159586 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.159457 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d25caa14-5413-4649-a9ba-86296fb4c3fb" containerName="manager" Jun 10 12:15:00.159586 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.159467 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d25caa14-5413-4649-a9ba-86296fb4c3fb" containerName="manager" Jun 10 12:15:00.159586 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.159483 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5323a0b-7243-41b6-80cd-5b533d8b0221" containerName="authorino" Jun 10 12:15:00.159586 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.159488 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5323a0b-7243-41b6-80cd-5b533d8b0221" containerName="authorino" Jun 10 12:15:00.159586 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.159560 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d25caa14-5413-4649-a9ba-86296fb4c3fb" containerName="manager" Jun 10 12:15:00.159586 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.159571 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5323a0b-7243-41b6-80cd-5b533d8b0221" containerName="authorino" Jun 10 12:15:00.162688 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.162668 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" Jun 10 12:15:00.172988 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.172956 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9"] Jun 10 12:15:00.330230 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.330189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct7x5\" (UniqueName: \"kubernetes.io/projected/ca863e7d-df68-449b-8ffd-0f2b969956ef-kube-api-access-ct7x5\") pod \"maas-api-key-cleanup-29684895-k4qp9\" (UID: \"ca863e7d-df68-449b-8ffd-0f2b969956ef\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" Jun 10 12:15:00.431510 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.431411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct7x5\" (UniqueName: \"kubernetes.io/projected/ca863e7d-df68-449b-8ffd-0f2b969956ef-kube-api-access-ct7x5\") pod \"maas-api-key-cleanup-29684895-k4qp9\" (UID: \"ca863e7d-df68-449b-8ffd-0f2b969956ef\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" Jun 10 12:15:00.441976 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.441942 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct7x5\" (UniqueName: \"kubernetes.io/projected/ca863e7d-df68-449b-8ffd-0f2b969956ef-kube-api-access-ct7x5\") pod \"maas-api-key-cleanup-29684895-k4qp9\" (UID: \"ca863e7d-df68-449b-8ffd-0f2b969956ef\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" Jun 10 12:15:00.473863 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.473826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" Jun 10 12:15:00.630398 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.630369 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9"] Jun 10 12:15:00.631896 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:15:00.631866 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca863e7d_df68_449b_8ffd_0f2b969956ef.slice/crio-f87fc6337ba663ba598ef5bad7d464210f06ae15fb545f938723c7cd626bec66 WatchSource:0}: Error finding container f87fc6337ba663ba598ef5bad7d464210f06ae15fb545f938723c7cd626bec66: Status 404 returned error can't find the container with id f87fc6337ba663ba598ef5bad7d464210f06ae15fb545f938723c7cd626bec66 Jun 10 12:15:00.633772 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:00.633754 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:15:01.249067 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:01.249024 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" event={"ID":"ca863e7d-df68-449b-8ffd-0f2b969956ef","Type":"ContainerStarted","Data":"f87fc6337ba663ba598ef5bad7d464210f06ae15fb545f938723c7cd626bec66"} Jun 10 12:15:03.271192 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:03.271154 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" event={"ID":"ca863e7d-df68-449b-8ffd-0f2b969956ef","Type":"ContainerStarted","Data":"c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e"} Jun 10 12:15:03.294413 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:15:03.294356 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" podStartSLOduration=1.130895168 podStartE2EDuration="3.294340171s" totalImagesPullingTime="2.163445003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:15:03.293006101 +0000 UTC m=+1013.371741839" watchObservedRunningTime="2026-06-10 12:15:03.294340171 +0000 UTC m=+1013.373075910" Jun 10 12:16:00.015118 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:00.015030 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9"] Jun 10 12:16:00.015588 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:00.015266 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" podUID="ca863e7d-df68-449b-8ffd-0f2b969956ef" containerName="cleanup" containerID="cri-o://c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e" gracePeriod=30 Jun 10 12:16:30.213422 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.213393 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" Jun 10 12:16:30.358918 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.358812 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct7x5\" (UniqueName: \"kubernetes.io/projected/ca863e7d-df68-449b-8ffd-0f2b969956ef-kube-api-access-ct7x5\") pod \"ca863e7d-df68-449b-8ffd-0f2b969956ef\" (UID: \"ca863e7d-df68-449b-8ffd-0f2b969956ef\") " Jun 10 12:16:30.361049 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.361016 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca863e7d-df68-449b-8ffd-0f2b969956ef-kube-api-access-ct7x5" (OuterVolumeSpecName: "kube-api-access-ct7x5") pod "ca863e7d-df68-449b-8ffd-0f2b969956ef" (UID: "ca863e7d-df68-449b-8ffd-0f2b969956ef"). InnerVolumeSpecName "kube-api-access-ct7x5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:16:30.460092 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.460026 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct7x5\" (UniqueName: \"kubernetes.io/projected/ca863e7d-df68-449b-8ffd-0f2b969956ef-kube-api-access-ct7x5\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:16:30.788792 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.788750 2576 generic.go:356] "Generic (PLEG): container finished" podID="ca863e7d-df68-449b-8ffd-0f2b969956ef" containerID="c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e" exitCode=137 Jun 10 12:16:30.789011 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.788815 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" Jun 10 12:16:30.789011 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.788840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" event={"ID":"ca863e7d-df68-449b-8ffd-0f2b969956ef","Type":"ContainerDied","Data":"c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e"} Jun 10 12:16:30.789011 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.788936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9" event={"ID":"ca863e7d-df68-449b-8ffd-0f2b969956ef","Type":"ContainerDied","Data":"f87fc6337ba663ba598ef5bad7d464210f06ae15fb545f938723c7cd626bec66"} Jun 10 12:16:30.789011 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.788967 2576 scope.go:117] "RemoveContainer" containerID="c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e" Jun 10 12:16:30.798451 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.798428 2576 scope.go:117] "RemoveContainer" containerID="c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e" Jun 10 12:16:30.798784 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:16:30.798764 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e\": container with ID starting with c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e not found: ID does not exist" containerID="c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e" Jun 10 12:16:30.798843 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.798794 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e"} err="failed to get container status \"c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e\": rpc error: code = NotFound desc = could not find container \"c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e\": container with ID starting with c866b916fdf1ec192da0c77dcfffa27802b299e08d7d94c1d27386bdcb83d15e not found: ID does not exist" Jun 10 12:16:30.814877 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.814845 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9"] Jun 10 12:16:30.820931 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:30.820889 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684895-k4qp9"] Jun 10 12:16:32.348248 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:16:32.348214 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca863e7d-df68-449b-8ffd-0f2b969956ef" path="/var/lib/kubelet/pods/ca863e7d-df68-449b-8ffd-0f2b969956ef/volumes" Jun 10 12:18:10.429803 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:18:10.429770 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:18:10.433689 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:18:10.433663 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:23:10.469658 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:23:10.469606 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:23:10.475086 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:23:10.475059 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:28:10.509045 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:28:10.508933 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:28:10.516472 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:28:10.516444 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:30:00.188957 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:00.188859 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl"] Jun 10 12:30:00.189569 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:00.189471 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca863e7d-df68-449b-8ffd-0f2b969956ef" containerName="cleanup" Jun 10 12:30:00.189569 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:00.189492 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca863e7d-df68-449b-8ffd-0f2b969956ef" containerName="cleanup" Jun 10 12:30:00.189740 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:00.189598 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca863e7d-df68-449b-8ffd-0f2b969956ef" containerName="cleanup" Jun 10 12:30:00.192763 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:00.192740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" Jun 10 12:30:00.236624 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:00.236588 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl"] Jun 10 12:30:00.269846 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:00.269801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pllld\" (UniqueName: \"kubernetes.io/projected/a0de2111-591d-4ea4-9f60-404f4ae18748-kube-api-access-pllld\") pod \"maas-api-key-cleanup-29684910-99gbl\" (UID: \"a0de2111-591d-4ea4-9f60-404f4ae18748\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" Jun 10 12:30:00.371311 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:00.371268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pllld\" (UniqueName: \"kubernetes.io/projected/a0de2111-591d-4ea4-9f60-404f4ae18748-kube-api-access-pllld\") pod \"maas-api-key-cleanup-29684910-99gbl\" (UID: \"a0de2111-591d-4ea4-9f60-404f4ae18748\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" Jun 10 12:30:00.390047 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:00.390010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pllld\" (UniqueName: \"kubernetes.io/projected/a0de2111-591d-4ea4-9f60-404f4ae18748-kube-api-access-pllld\") pod \"maas-api-key-cleanup-29684910-99gbl\" (UID: \"a0de2111-591d-4ea4-9f60-404f4ae18748\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" Jun 10 12:30:00.504036 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:00.503937 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" Jun 10 12:30:00.657952 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:00.657922 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl"] Jun 10 12:30:00.660348 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:30:00.660321 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0de2111_591d_4ea4_9f60_404f4ae18748.slice/crio-86a8045ea1d06ce311633f91e39d17e1f144bffcdf8fc239ad0f692b0f089b63 WatchSource:0}: Error finding container 86a8045ea1d06ce311633f91e39d17e1f144bffcdf8fc239ad0f692b0f089b63: Status 404 returned error can't find the container with id 86a8045ea1d06ce311633f91e39d17e1f144bffcdf8fc239ad0f692b0f089b63 Jun 10 12:30:01.512590 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:01.512551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" event={"ID":"a0de2111-591d-4ea4-9f60-404f4ae18748","Type":"ContainerStarted","Data":"5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694"} Jun 10 12:30:01.513034 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:01.512607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" event={"ID":"a0de2111-591d-4ea4-9f60-404f4ae18748","Type":"ContainerStarted","Data":"86a8045ea1d06ce311633f91e39d17e1f144bffcdf8fc239ad0f692b0f089b63"} Jun 10 12:30:01.545255 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:30:01.545195 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" podStartSLOduration=1.5451762580000001 podStartE2EDuration="1.545176258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:30:01.53831288 +0000 UTC m=+1911.617048615" watchObservedRunningTime="2026-06-10 12:30:01.545176258 +0000 UTC m=+1911.623911998" Jun 10 12:31:00.016665 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:00.016560 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl"] Jun 10 12:31:00.017160 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:00.016816 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" podUID="a0de2111-591d-4ea4-9f60-404f4ae18748" containerName="cleanup" containerID="cri-o://5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694" gracePeriod=30 Jun 10 12:31:30.216874 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:30.216846 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" Jun 10 12:31:30.392201 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:30.392166 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pllld\" (UniqueName: \"kubernetes.io/projected/a0de2111-591d-4ea4-9f60-404f4ae18748-kube-api-access-pllld\") pod \"a0de2111-591d-4ea4-9f60-404f4ae18748\" (UID: \"a0de2111-591d-4ea4-9f60-404f4ae18748\") " Jun 10 12:31:30.394261 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:30.394225 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0de2111-591d-4ea4-9f60-404f4ae18748-kube-api-access-pllld" (OuterVolumeSpecName: "kube-api-access-pllld") pod "a0de2111-591d-4ea4-9f60-404f4ae18748" (UID: "a0de2111-591d-4ea4-9f60-404f4ae18748"). InnerVolumeSpecName "kube-api-access-pllld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:31:30.493400 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:30.493362 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pllld\" (UniqueName: \"kubernetes.io/projected/a0de2111-591d-4ea4-9f60-404f4ae18748-kube-api-access-pllld\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:31:31.049267 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:31.049228 2576 generic.go:356] "Generic (PLEG): container finished" podID="a0de2111-591d-4ea4-9f60-404f4ae18748" containerID="5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694" exitCode=137 Jun 10 12:31:31.049446 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:31.049272 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" Jun 10 12:31:31.049446 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:31.049283 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" event={"ID":"a0de2111-591d-4ea4-9f60-404f4ae18748","Type":"ContainerDied","Data":"5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694"} Jun 10 12:31:31.049446 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:31.049345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl" event={"ID":"a0de2111-591d-4ea4-9f60-404f4ae18748","Type":"ContainerDied","Data":"86a8045ea1d06ce311633f91e39d17e1f144bffcdf8fc239ad0f692b0f089b63"} Jun 10 12:31:31.049446 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:31.049371 2576 scope.go:117] "RemoveContainer" containerID="5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694" Jun 10 12:31:31.059476 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:31.059457 2576 scope.go:117] "RemoveContainer" containerID="5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694" Jun 10 12:31:31.059782 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:31:31.059760 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694\": container with ID starting with 5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694 not found: ID does not exist" containerID="5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694" Jun 10 12:31:31.059877 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:31.059795 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694"} err="failed to get container status \"5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694\": rpc error: code = NotFound desc = could not find container \"5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694\": container with ID starting with 5f4b9b045a50a8277525d2503d83457edacb6e5c5672ad3c8f1d193d490ce694 not found: ID does not exist" Jun 10 12:31:31.078562 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:31.078530 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl"] Jun 10 12:31:31.093744 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:31.093708 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29684910-99gbl"] Jun 10 12:31:32.348077 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:31:32.348040 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0de2111-591d-4ea4-9f60-404f4ae18748" path="/var/lib/kubelet/pods/a0de2111-591d-4ea4-9f60-404f4ae18748/volumes" Jun 10 12:33:10.548733 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:33:10.548611 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:33:10.557937 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:33:10.557912 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:34:13.954314 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.954227 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr"] Jun 10 12:34:13.954822 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.954678 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0de2111-591d-4ea4-9f60-404f4ae18748" containerName="cleanup" Jun 10 12:34:13.954822 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.954693 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0de2111-591d-4ea4-9f60-404f4ae18748" containerName="cleanup" Jun 10 12:34:13.954822 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.954768 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0de2111-591d-4ea4-9f60-404f4ae18748" containerName="cleanup" Jun 10 12:34:13.957884 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.957866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:13.960475 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.960450 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 12:34:13.960602 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.960569 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-def7da80-openshift-default-dockercfg-hr72d\"" Jun 10 12:34:13.980539 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.980501 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr"] Jun 10 12:34:13.985253 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.985222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-podinfo\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:13.985412 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.985263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-data\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:13.985412 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.985284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkbsp\" (UniqueName: \"kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-kube-api-access-vkbsp\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:13.985412 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.985358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-certs\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:13.985412 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.985392 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-credential-socket\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:13.985412 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.985410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istiod-ca-cert\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:13.985580 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.985524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-envoy\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:13.985615 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.985588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-token\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:13.985677 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:13.985617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-socket\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.086906 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.086870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-podinfo\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.086906 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.086914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-data\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.087186 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.086937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbsp\" (UniqueName: \"kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-kube-api-access-vkbsp\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.087186 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.086957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-certs\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.087186 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.086980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-credential-socket\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.087186 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.086996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istiod-ca-cert\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.087186 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.087037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-envoy\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.087186 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.087075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-token\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.087186 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.087099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-socket\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.087538 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.087374 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-data\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.087608 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.087530 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-credential-socket\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.087608 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.087559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-certs\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.087735 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.087628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-socket\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.088033 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.088010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istiod-ca-cert\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.089442 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.089419 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-envoy\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.089629 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.089610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-podinfo\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.098224 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.098198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-token\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.098339 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.098310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkbsp\" (UniqueName: \"kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-kube-api-access-vkbsp\") pod \"e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.269101 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.269003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:14.424607 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.424578 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr"] Jun 10 12:34:14.425930 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:34:14.425901 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88fe2a53_b85b_467e_b417_9f0820c3c7b2.slice/crio-94c13f65dd0223bed370106b6495e2d7b7c2723001a7733d9891626577836c8f WatchSource:0}: Error finding container 94c13f65dd0223bed370106b6495e2d7b7c2723001a7733d9891626577836c8f: Status 404 returned error can't find the container with id 94c13f65dd0223bed370106b6495e2d7b7c2723001a7733d9891626577836c8f Jun 10 12:34:14.427921 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.427905 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:34:14.989978 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:14.989944 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" event={"ID":"88fe2a53-b85b-467e-b417-9f0820c3c7b2","Type":"ContainerStarted","Data":"94c13f65dd0223bed370106b6495e2d7b7c2723001a7733d9891626577836c8f"} Jun 10 12:34:17.588734 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:17.588687 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 12:34:17.589039 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:17.588769 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 12:34:17.589039 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:17.588797 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 12:34:18.010437 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:18.010400 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" event={"ID":"88fe2a53-b85b-467e-b417-9f0820c3c7b2","Type":"ContainerStarted","Data":"4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7"} Jun 10 12:34:18.035159 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:18.035106 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" podStartSLOduration=1.87476899 podStartE2EDuration="5.035087795s" totalImagesPullingTime="3.160318805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:34:18.033459466 +0000 UTC m=+2168.112195243" watchObservedRunningTime="2026-06-10 12:34:18.035087795 +0000 UTC m=+2168.113823534" Jun 10 12:34:18.270147 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:18.270106 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:18.271527 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:18.271502 2576 patch_prober.go:28] interesting pod/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jun 10 12:34:18.271591 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:18.271554 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" podUID="88fe2a53-b85b-467e-b417-9f0820c3c7b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jun 10 12:34:19.269467 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:19.269428 2576 patch_prober.go:28] interesting pod/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jun 10 12:34:19.269893 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:19.269494 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" podUID="88fe2a53-b85b-467e-b417-9f0820c3c7b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jun 10 12:34:20.269631 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:20.269590 2576 patch_prober.go:28] interesting pod/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jun 10 12:34:20.270113 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:20.269682 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" podUID="88fe2a53-b85b-467e-b417-9f0820c3c7b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jun 10 12:34:20.460706 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:20.460664 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr"] Jun 10 12:34:21.027554 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:21.027484 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" podUID="88fe2a53-b85b-467e-b417-9f0820c3c7b2" containerName="istio-proxy" containerID="cri-o://4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7" gracePeriod=30 Jun 10 12:34:27.785742 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.785712 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:27.939597 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.939509 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-certs\") pod \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " Jun 10 12:34:27.939597 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.939550 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkbsp\" (UniqueName: \"kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-kube-api-access-vkbsp\") pod \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " Jun 10 12:34:27.939597 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.939595 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-podinfo\") pod \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " Jun 10 12:34:27.939927 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.939692 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-envoy\") pod \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " Jun 10 12:34:27.939927 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.939717 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-socket\") pod \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " Jun 10 12:34:27.939927 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.939790 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-data\") pod \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " Jun 10 12:34:27.939927 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.939818 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "88fe2a53-b85b-467e-b417-9f0820c3c7b2" (UID: "88fe2a53-b85b-467e-b417-9f0820c3c7b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:34:27.939927 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.939852 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-token\") pod \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " Jun 10 12:34:27.939927 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.939924 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istiod-ca-cert\") pod \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " Jun 10 12:34:27.940255 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.939952 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-credential-socket\") pod \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\" (UID: \"88fe2a53-b85b-467e-b417-9f0820c3c7b2\") " Jun 10 12:34:27.940255 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.940053 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "88fe2a53-b85b-467e-b417-9f0820c3c7b2" (UID: "88fe2a53-b85b-467e-b417-9f0820c3c7b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:34:27.940255 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.940242 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "88fe2a53-b85b-467e-b417-9f0820c3c7b2" (UID: "88fe2a53-b85b-467e-b417-9f0820c3c7b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:34:27.940386 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.940300 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-certs\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:34:27.940386 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.940320 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-workload-socket\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:34:27.940386 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.940323 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "88fe2a53-b85b-467e-b417-9f0820c3c7b2" (UID: "88fe2a53-b85b-467e-b417-9f0820c3c7b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:34:27.940982 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.940953 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "88fe2a53-b85b-467e-b417-9f0820c3c7b2" (UID: "88fe2a53-b85b-467e-b417-9f0820c3c7b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:34:27.942063 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.942035 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-kube-api-access-vkbsp" (OuterVolumeSpecName: "kube-api-access-vkbsp") pod "88fe2a53-b85b-467e-b417-9f0820c3c7b2" (UID: "88fe2a53-b85b-467e-b417-9f0820c3c7b2"). InnerVolumeSpecName "kube-api-access-vkbsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:34:27.942171 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.942034 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "88fe2a53-b85b-467e-b417-9f0820c3c7b2" (UID: "88fe2a53-b85b-467e-b417-9f0820c3c7b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 12:34:27.942234 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.942212 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "88fe2a53-b85b-467e-b417-9f0820c3c7b2" (UID: "88fe2a53-b85b-467e-b417-9f0820c3c7b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:34:27.942321 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:27.942303 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "88fe2a53-b85b-467e-b417-9f0820c3c7b2" (UID: "88fe2a53-b85b-467e-b417-9f0820c3c7b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:34:28.041069 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.041025 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-envoy\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:34:28.041069 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.041061 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-data\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:34:28.041069 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.041069 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-token\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:34:28.041069 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.041077 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istiod-ca-cert\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:34:28.041589 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.041086 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fe2a53-b85b-467e-b417-9f0820c3c7b2-credential-socket\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:34:28.041589 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.041095 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkbsp\" (UniqueName: \"kubernetes.io/projected/88fe2a53-b85b-467e-b417-9f0820c3c7b2-kube-api-access-vkbsp\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:34:28.041589 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.041106 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88fe2a53-b85b-467e-b417-9f0820c3c7b2-istio-podinfo\") on node \"ip-10-0-128-88.ec2.internal\" DevicePath \"\"" Jun 10 12:34:28.071315 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.071279 2576 generic.go:356] "Generic (PLEG): container finished" podID="88fe2a53-b85b-467e-b417-9f0820c3c7b2" containerID="4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7" exitCode=0 Jun 10 12:34:28.071492 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.071340 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" Jun 10 12:34:28.071492 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.071359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" event={"ID":"88fe2a53-b85b-467e-b417-9f0820c3c7b2","Type":"ContainerDied","Data":"4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7"} Jun 10 12:34:28.071492 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.071434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr" event={"ID":"88fe2a53-b85b-467e-b417-9f0820c3c7b2","Type":"ContainerDied","Data":"94c13f65dd0223bed370106b6495e2d7b7c2723001a7733d9891626577836c8f"} Jun 10 12:34:28.071492 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.071458 2576 scope.go:117] "RemoveContainer" containerID="4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7" Jun 10 12:34:28.081590 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.081566 2576 scope.go:117] "RemoveContainer" containerID="4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7" Jun 10 12:34:28.082229 ip-10-0-128-88 kubenswrapper[2576]: E0610 12:34:28.082198 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7\": container with ID starting with 4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7 not found: ID does not exist" containerID="4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7" Jun 10 12:34:28.082329 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.082239 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7"} err="failed to get container status \"4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7\": rpc error: code = NotFound desc = could not find container \"4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7\": container with ID starting with 4ef87e36b4693a56cf36be6d009393180f0d14af4e6966a7c41a5b2fbf84e0c7 not found: ID does not exist" Jun 10 12:34:28.102199 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.102157 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr"] Jun 10 12:34:28.108871 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.108828 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-def7da80-openshift-default-7dc799d4f6-jwchr"] Jun 10 12:34:28.348698 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:28.348613 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88fe2a53-b85b-467e-b417-9f0820c3c7b2" path="/var/lib/kubelet/pods/88fe2a53-b85b-467e-b417-9f0820c3c7b2/volumes" Jun 10 12:34:47.920845 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:47.920808 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58c5c5788c-dhr5b_3cb67b60-70c4-438a-ae3d-8497aaa1bc3c/authorino/0.log" Jun 10 12:34:53.447830 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:53.447799 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c45549f7-8hrnx_f588f053-e8b4-4093-a374-2b9abac9806d/copy-manifests/0.log" Jun 10 12:34:53.456455 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:53.456427 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c45549f7-8hrnx_f588f053-e8b4-4093-a374-2b9abac9806d/manager/0.log" Jun 10 12:34:54.368310 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.368279 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75_f6d4aa2e-b920-4472-a1e1-4439fb9813bd/util/0.log" Jun 10 12:34:54.379105 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.379076 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75_f6d4aa2e-b920-4472-a1e1-4439fb9813bd/pull/0.log" Jun 10 12:34:54.387688 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.387658 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75_f6d4aa2e-b920-4472-a1e1-4439fb9813bd/extract/0.log" Jun 10 12:34:54.500664 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.500613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf_74020732-2d5e-45b9-bea7-a264c3053dda/util/0.log" Jun 10 12:34:54.508780 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.508756 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf_74020732-2d5e-45b9-bea7-a264c3053dda/pull/0.log" Jun 10 12:34:54.519961 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.519939 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf_74020732-2d5e-45b9-bea7-a264c3053dda/extract/0.log" Jun 10 12:34:54.636063 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.636031 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8_80c6e0b2-5771-43c7-9692-8fd10030a7a3/util/0.log" Jun 10 12:34:54.644649 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.644620 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8_80c6e0b2-5771-43c7-9692-8fd10030a7a3/pull/0.log" Jun 10 12:34:54.653037 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.653010 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8_80c6e0b2-5771-43c7-9692-8fd10030a7a3/extract/0.log" Jun 10 12:34:54.773837 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.773810 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2_4e1476ab-737e-43af-8086-02bbdb9e2c8b/util/0.log" Jun 10 12:34:54.782496 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.782459 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2_4e1476ab-737e-43af-8086-02bbdb9e2c8b/pull/0.log" Jun 10 12:34:54.791055 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.791029 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2_4e1476ab-737e-43af-8086-02bbdb9e2c8b/extract/0.log" Jun 10 12:34:54.919930 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:54.919830 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58c5c5788c-dhr5b_3cb67b60-70c4-438a-ae3d-8497aaa1bc3c/authorino/0.log" Jun 10 12:34:55.258376 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:55.258294 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-njksc_c427c5be-fad7-4f3f-94d5-28af3928822a/kuadrant-console-plugin/0.log" Jun 10 12:34:56.339758 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:56.339731 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cb945c55-cm2vl_ef1d7611-7c83-45a2-a745-5316819c5e9d/kube-auth-proxy/0.log" Jun 10 12:34:56.703425 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:56.703390 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-24rcn_28c15021-4b0c-48b8-b4fc-2ded77584918/payload-pre-processing/0.log" Jun 10 12:34:56.827335 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:56.827305 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-x8vc9_8cee6228-e0bb-4dc3-8a88-82656d4c719e/payload-processing/0.log" Jun 10 12:34:56.949086 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:56.949045 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64c7bf7d77-hmnqn_7c21563e-02b7-4654-84e0-17338ce9b7a4/router/0.log" Jun 10 12:34:57.441458 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:57.441426 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-z46tl_7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3/storage-initializer/0.log" Jun 10 12:34:57.454395 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:34:57.454368 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-z46tl_7f4f3ff2-0681-4371-9d20-a0ac1d62fdb3/main/0.log" Jun 10 12:35:05.696036 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:05.696003 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hmlxw_3b50d6a5-e5d6-42f2-84bf-bcf1783784cb/global-pull-secret-syncer/0.log" Jun 10 12:35:05.891422 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:05.891385 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dwd67_d9ba8ee4-86e3-4522-918f-a8da5b8c474e/konnectivity-agent/0.log" Jun 10 12:35:05.961190 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:05.961099 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-88.ec2.internal_00c515e36f41ac35aafa9632c3bd77c9/haproxy/0.log" Jun 10 12:35:09.974988 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:09.974951 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75_f6d4aa2e-b920-4472-a1e1-4439fb9813bd/extract/0.log" Jun 10 12:35:10.005006 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.004976 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75_f6d4aa2e-b920-4472-a1e1-4439fb9813bd/util/0.log" Jun 10 12:35:10.033114 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.033083 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594wt75_f6d4aa2e-b920-4472-a1e1-4439fb9813bd/pull/0.log" Jun 10 12:35:10.066784 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.066752 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf_74020732-2d5e-45b9-bea7-a264c3053dda/extract/0.log" Jun 10 12:35:10.095365 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.095335 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf_74020732-2d5e-45b9-bea7-a264c3053dda/util/0.log" Jun 10 12:35:10.124225 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.124197 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vbzmf_74020732-2d5e-45b9-bea7-a264c3053dda/pull/0.log" Jun 10 12:35:10.161874 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.161845 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8_80c6e0b2-5771-43c7-9692-8fd10030a7a3/extract/0.log" Jun 10 12:35:10.189699 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.189595 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8_80c6e0b2-5771-43c7-9692-8fd10030a7a3/util/0.log" Jun 10 12:35:10.220275 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.220245 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bfl8_80c6e0b2-5771-43c7-9692-8fd10030a7a3/pull/0.log" Jun 10 12:35:10.253705 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.253676 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2_4e1476ab-737e-43af-8086-02bbdb9e2c8b/extract/0.log" Jun 10 12:35:10.291892 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.291850 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2_4e1476ab-737e-43af-8086-02bbdb9e2c8b/util/0.log" Jun 10 12:35:10.320171 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.320126 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rz8b2_4e1476ab-737e-43af-8086-02bbdb9e2c8b/pull/0.log" Jun 10 12:35:10.667519 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.667476 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58c5c5788c-dhr5b_3cb67b60-70c4-438a-ae3d-8497aaa1bc3c/authorino/0.log" Jun 10 12:35:10.780414 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:10.780382 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-njksc_c427c5be-fad7-4f3f-94d5-28af3928822a/kuadrant-console-plugin/0.log" Jun 10 12:35:12.750506 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:12.750471 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a/alertmanager/0.log" Jun 10 12:35:12.779541 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:12.779508 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a/config-reloader/0.log" Jun 10 12:35:12.809054 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:12.809009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a/kube-rbac-proxy-web/0.log" Jun 10 12:35:12.836506 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:12.836477 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a/kube-rbac-proxy/0.log" Jun 10 12:35:12.871547 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:12.871504 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a/kube-rbac-proxy-metric/0.log" Jun 10 12:35:12.897860 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:12.897834 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a/prom-label-proxy/0.log" Jun 10 12:35:12.925289 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:12.925260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae1cfa59-f1b7-40f0-afd9-8e7451b5b15a/init-config-reloader/0.log" Jun 10 12:35:12.992701 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:12.992672 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-fnmj6_79e94e31-a537-469c-8642-4c2a4e546fec/cluster-monitoring-operator/0.log" Jun 10 12:35:13.129486 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:13.129411 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-657fc6c5f8-5zr9t_27bb85ad-43aa-467c-a16d-bde84dd2fecd/metrics-server/0.log" Jun 10 12:35:13.163771 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:13.163739 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-wbr7v_e974c50f-2167-40f6-a270-b9bd1bc67630/monitoring-plugin/0.log" Jun 10 12:35:13.446118 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:13.446092 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8hgl_19e0570c-7c69-491c-adf7-6657afb60fe9/node-exporter/0.log" Jun 10 12:35:13.480470 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:13.480444 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8hgl_19e0570c-7c69-491c-adf7-6657afb60fe9/kube-rbac-proxy/0.log" Jun 10 12:35:13.515048 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:13.515019 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8hgl_19e0570c-7c69-491c-adf7-6657afb60fe9/init-textfile/0.log" Jun 10 12:35:13.921360 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:13.921329 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-htn46_43b41183-6a54-42f4-9570-3f51d940e222/prometheus-operator/0.log" Jun 10 12:35:13.946918 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:13.946890 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-htn46_43b41183-6a54-42f4-9570-3f51d940e222/kube-rbac-proxy/0.log" Jun 10 12:35:16.295592 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:16.295556 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/2.log" Jun 10 12:35:16.303346 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:16.303313 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lrr5x_c5667979-e921-450c-b03c-20a7eb49c704/console-operator/3.log" Jun 10 12:35:17.582353 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.582317 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx"] Jun 10 12:35:17.582934 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.582914 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88fe2a53-b85b-467e-b417-9f0820c3c7b2" containerName="istio-proxy" Jun 10 12:35:17.583019 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.582936 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88fe2a53-b85b-467e-b417-9f0820c3c7b2" containerName="istio-proxy" Jun 10 12:35:17.583077 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.583066 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="88fe2a53-b85b-467e-b417-9f0820c3c7b2" containerName="istio-proxy" Jun 10 12:35:17.587344 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.587320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.590033 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.590008 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vd9h2\"/\"kube-root-ca.crt\"" Jun 10 12:35:17.590497 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.590465 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vd9h2\"/\"default-dockercfg-27c5p\"" Jun 10 12:35:17.591043 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.591023 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vd9h2\"/\"openshift-service-ca.crt\"" Jun 10 12:35:17.596928 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.596903 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx"] Jun 10 12:35:17.680972 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.680916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-sys\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.680972 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.680973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfdbq\" (UniqueName: \"kubernetes.io/projected/548f2a13-94c6-49b5-abed-502ce2251399-kube-api-access-qfdbq\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.681302 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.681049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-lib-modules\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.681302 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.681091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-proc\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.681302 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.681141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-podres\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.744754 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.744724 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-7zx2q_68e452c4-b404-4c88-97fe-1926f9483930/volume-data-source-validator/0.log" Jun 10 12:35:17.781989 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.781949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-sys\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.781989 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.781996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfdbq\" (UniqueName: \"kubernetes.io/projected/548f2a13-94c6-49b5-abed-502ce2251399-kube-api-access-qfdbq\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.782271 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.782100 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-sys\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.782271 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.782125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-lib-modules\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.782271 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.782155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-proc\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.782271 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.782198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-podres\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.782271 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.782251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-proc\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.782496 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.782277 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-lib-modules\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.782496 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.782336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/548f2a13-94c6-49b5-abed-502ce2251399-podres\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.792777 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.792746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfdbq\" (UniqueName: \"kubernetes.io/projected/548f2a13-94c6-49b5-abed-502ce2251399-kube-api-access-qfdbq\") pod \"perf-node-gather-daemonset-zw6lx\" (UID: \"548f2a13-94c6-49b5-abed-502ce2251399\") " pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:17.899661 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:17.899613 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:18.046814 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:18.046787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx"] Jun 10 12:35:18.049332 ip-10-0-128-88 kubenswrapper[2576]: W0610 12:35:18.049301 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod548f2a13_94c6_49b5_abed_502ce2251399.slice/crio-a4b3f28fcfde5ed3f85640a3b2e20c8950801787743208dc1b45c34ea29e60d6 WatchSource:0}: Error finding container a4b3f28fcfde5ed3f85640a3b2e20c8950801787743208dc1b45c34ea29e60d6: Status 404 returned error can't find the container with id a4b3f28fcfde5ed3f85640a3b2e20c8950801787743208dc1b45c34ea29e60d6 Jun 10 12:35:18.369384 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:18.369349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" event={"ID":"548f2a13-94c6-49b5-abed-502ce2251399","Type":"ContainerStarted","Data":"c792efbafec37fda36166e86ee0feede156635242e9abbe5a49b464efb394de1"} Jun 10 12:35:18.369594 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:18.369404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" event={"ID":"548f2a13-94c6-49b5-abed-502ce2251399","Type":"ContainerStarted","Data":"a4b3f28fcfde5ed3f85640a3b2e20c8950801787743208dc1b45c34ea29e60d6"} Jun 10 12:35:18.369594 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:18.369431 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:18.394547 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:18.394485 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" podStartSLOduration=1.394468442 podStartE2EDuration="1.394468442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:35:18.391930263 +0000 UTC m=+2228.470666003" watchObservedRunningTime="2026-06-10 12:35:18.394468442 +0000 UTC m=+2228.473204225" Jun 10 12:35:19.152969 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:19.152938 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wp22l_25db935a-cbc3-4cb8-a8c4-d5c31417a345/dns/0.log" Jun 10 12:35:19.176411 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:19.176384 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wp22l_25db935a-cbc3-4cb8-a8c4-d5c31417a345/kube-rbac-proxy/0.log" Jun 10 12:35:19.281270 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:19.281238 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fpjjk_a3b64f01-ced8-439f-b2ce-5f9a8db234e9/dns-node-resolver/0.log" Jun 10 12:35:19.987494 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:19.987454 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-22d66_dd70b2e4-b0b9-46bd-b9b1-3234e3502b0b/node-ca/0.log" Jun 10 12:35:21.200460 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:21.200428 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cb945c55-cm2vl_ef1d7611-7c83-45a2-a745-5316819c5e9d/kube-auth-proxy/0.log" Jun 10 12:35:21.353727 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:21.353694 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-24rcn_28c15021-4b0c-48b8-b4fc-2ded77584918/payload-pre-processing/0.log" Jun 10 12:35:21.450319 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:21.450281 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-x8vc9_8cee6228-e0bb-4dc3-8a88-82656d4c719e/payload-processing/0.log" Jun 10 12:35:21.476814 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:21.476726 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64c7bf7d77-hmnqn_7c21563e-02b7-4654-84e0-17338ce9b7a4/router/0.log" Jun 10 12:35:22.162019 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:22.161977 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cm4bl_827e1371-fb46-44f1-944d-6bbf824e350a/serve-healthcheck-canary/0.log" Jun 10 12:35:22.799051 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:22.798998 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-hbng4_1e3989bc-4357-4c9e-b974-b2ccfe2ab358/insights-operator/0.log" Jun 10 12:35:22.801854 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:22.801827 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-hbng4_1e3989bc-4357-4c9e-b974-b2ccfe2ab358/insights-operator/1.log" Jun 10 12:35:22.826922 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:22.826886 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4v4fn_679bd396-1ce0-4416-bda2-d9aa6c8a8b0e/kube-rbac-proxy/0.log" Jun 10 12:35:22.854375 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:22.854343 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4v4fn_679bd396-1ce0-4416-bda2-d9aa6c8a8b0e/exporter/0.log" Jun 10 12:35:22.881443 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:22.881397 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4v4fn_679bd396-1ce0-4416-bda2-d9aa6c8a8b0e/extractor/0.log" Jun 10 12:35:24.385706 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:24.385680 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vd9h2/perf-node-gather-daemonset-zw6lx" Jun 10 12:35:25.811419 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:25.811382 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c45549f7-8hrnx_f588f053-e8b4-4093-a374-2b9abac9806d/manager/0.log" Jun 10 12:35:25.838613 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:25.838581 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c45549f7-8hrnx_f588f053-e8b4-4093-a374-2b9abac9806d/copy-manifests/0.log" Jun 10 12:35:27.807521 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:27.807485 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85c5ffbff9-2qrx9_6fe688d7-09f4-4cb0-afc7-574e6cd26d21/manager/0.log" Jun 10 12:35:27.852224 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:27.852196 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rlk8c_dc2eb4e9-6235-474c-bd76-b60f3ae43113/openshift-lws-operator/0.log" Jun 10 12:35:30.340589 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:30.340536 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cb945c55-cm2vl_ef1d7611-7c83-45a2-a745-5316819c5e9d/kube-auth-proxy/0.log" Jun 10 12:35:30.479376 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:30.479337 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-24rcn_28c15021-4b0c-48b8-b4fc-2ded77584918/payload-pre-processing/0.log" Jun 10 12:35:30.566816 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:30.566778 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-x8vc9_8cee6228-e0bb-4dc3-8a88-82656d4c719e/payload-processing/0.log" Jun 10 12:35:30.583516 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:30.583486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64c7bf7d77-hmnqn_7c21563e-02b7-4654-84e0-17338ce9b7a4/router/0.log" Jun 10 12:35:31.787675 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:31.787613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cb945c55-cm2vl_ef1d7611-7c83-45a2-a745-5316819c5e9d/kube-auth-proxy/0.log" Jun 10 12:35:31.926178 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:31.926139 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-24rcn_28c15021-4b0c-48b8-b4fc-2ded77584918/payload-pre-processing/0.log" Jun 10 12:35:32.012995 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:32.012964 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-x8vc9_8cee6228-e0bb-4dc3-8a88-82656d4c719e/payload-processing/0.log" Jun 10 12:35:32.036626 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:32.036591 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64c7bf7d77-hmnqn_7c21563e-02b7-4654-84e0-17338ce9b7a4/router/0.log" Jun 10 12:35:33.906195 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:33.906165 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cb945c55-cm2vl_ef1d7611-7c83-45a2-a745-5316819c5e9d/kube-auth-proxy/0.log" Jun 10 12:35:34.027961 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:34.027933 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-24rcn_28c15021-4b0c-48b8-b4fc-2ded77584918/payload-pre-processing/0.log" Jun 10 12:35:34.108194 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:34.108162 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-x8vc9_8cee6228-e0bb-4dc3-8a88-82656d4c719e/payload-processing/0.log" Jun 10 12:35:34.127548 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:34.127520 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64c7bf7d77-hmnqn_7c21563e-02b7-4654-84e0-17338ce9b7a4/router/0.log" Jun 10 12:35:34.406155 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:34.406116 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-tnk74_f149e6da-2d3d-4296-9bee-9c0addca9a71/kube-storage-version-migrator-operator/1.log" Jun 10 12:35:34.408003 ip-10-0-128-88 kubenswrapper[2576]: I0610 12:35:34.407959 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-tnk74_f149e6da-2d3d-4296-9bee-9c0addca9a71/kube-storage-version-migrator-operator/0.log"